Run a flow

Selecting a flow

Click ‘Run a Flow’ on the main menu or homepage to configure a RunFlow job.

First, select the flow you want to use…

trac Run a flow screen showing the flow selection list

Note

If the flow you selected has multiple versions available the latest version will be selected by default. Moving the toggle to off allows you to manually pick a prior version of the model object.

Configuring the job

Clicking ‘Show chain’ expands a list of the models which make up the flow.

If more than one model object or version matches the criteria for use in the flow, you will have the option to ‘Change version’.

trac flow job showing the model chain and version selection

Below this the default values of any parameters are pre-populated, as are the data inputs.

If no suitable data is found you see an error message. If multiple options are found you can select which object to use via the drop-downs.

trac flow job data input selection drop-downs

Note

By default, the most recent versions of each data set will be used. If any data object you select has multiple versions available then moving the toggle to off allows you to manually select which versions to use.

Once finished, click ‘Review’ to see a final breakdown of what will be in the job.

Review & launch

Clicking ‘View full info’ brings up the full details of the flow including visualisation

trac flow visualisation showing full lineage details

You can also see full lineage information for each model and data input via the ‘More info’ buttons.

If it all looks correct, populate the general attributes and click ‘Run’. A tag is not required but if populated, all the data outputs will have this tag assigned, making them easier to find.

You will get a message telling you the job has started. It won’t tell you the outcome, so (find the job) to check its status.

trac confirmation message showing a RunFlow job has started

If there’s an issue with the job set-up you will see a red message instead. The most common issues are missing attribute information or mis-aligned data schemas.

Schema validation

trac applies strict schema validation when compiling a job. Key things to remember are:

  • It occurs between schemas, not between data content

  • It considers Field name, Field Type, Business key, Categorical and Not nullable

  • The order in which field names appear is not important

  • A source schema must contain all the fields needed by the target schema

  • The source schema can contain extra fields