Skip to main content

The Workflow Editor

Workflows are a canvas on which you can build a set of sequential processes to be scheduled and run to create your first-party graph.

Procedure. To access the Workflow Editor:
  1. Log in to the Data Collaboration Platform. The home page appears.

  2. If you belong to multiple organizations, use the organization switcher to select your Identity Engine organization.

    Home_Page-Select-Identity_Engine-Org.png
  3. From the left navigation pane, click 1st Party Data Consolidation. The Workflow Editor displays a new unsaved workflow.

    Identity_Engine-Workflow_Editor-Overview.png

Actions You Can Perform in the Workflow Editor

You can use the Workflow Editor to do the following:

Building a Workflow

You can create the following types of workflows:

  • Guided identity resolution workflows: To streamline implementation, use identity resolution templates and wizards that support the data preparation, resolution, and export processes.

  • Generic workflows: Build flexible workflows that can be plugged into other types of processes.

When you open the Workflow Editor, a new unsaved workflow is displayed where you can begin building a workflow.

You can add new processes to a new or an existing workflow by dragging them onto the canvas.

Identity_Engine-New_Workflow.png

Configure a process

Each process will first appear with a yellow warning icon Identity_Engine-Workflow_Warning_Icon.png to indicate you need to configure the process. You need to configure them in the following order:

Once you have configured a process, you can download it as a JSON file and upload it to another process of the same type to re-apply the same settings. You can upload a process to both non-configured and configured processes.

Identity_engine__upload_download.png

Once you've created a workflow, you must click Save, enter a unique name for the workflow, and enter a description. The Workflows page displays your new workflow.

Editing a Workflow

If your organization has existing workflows, you can open them by selecting MoreOpen Existing Workflow.

Identity_Engine_Edit_Workflow_Upload_Download.png

The Open Workflow dialog displays your existing workflows. Select a workflow and click Open.

Once you open an existing workflow for editing, you can edit its processes.

Download and Upload a Workflow

To efficiently create multiple workflows with the same configuration, you can use the download and upload functionality. Once you have built a workflow, you can download it as a JSON file. You can then upload the JSON file to a new blank workflow to re-apply the same processes and configuration.

You can download existing workflows and upload them only to new workflows.

To download or upload a workflow, select MoreDownload or Upload.

Identity_engine_Workflow_Download.png
Identity_engine_Workflow_Upload.png

Running a Workflow

Once you build a valid workflow, you can run it by selecting MoreRun Workflow.

Identity_ENgine_Run_Workflow_Download_upload.png

The Run Workflow dialog displays the options for the current workflow.

Identity_Engine-Run_Workflow.png

For each task in the process, you can configure the Dataproc cluster profile which determines the cluster size, machine type, disk type, and disk size. Depending on the size of the input data and the workflow's usage, you can override the default cluster profile by selecting another cluster profile. To create a new cluster profile, see "Configure Advanced Settings".

You can make any needed adjustments and click Confirm.