How to import tables with reference relationships in order when automating data import

[lipan]

Hi Everyone

I use the following enginery for data import automation:
Data source （upload csv and trigger flow)
Flow (call Scheduled data import)
Scheduled data import (execute Data Source)
Transformer map (transform data)

The relationship between importing the intermediate table and the target table is as follows
u_company→ core_company
u_incident→ incident

The data of incident is ref to core_company,

So I think the order of imports must be as follows
core_company 1
incident 2

When I uploaded a file to the incident Data Source and core_company Data Source, two import Flows started simultaneously, due to the file being large enough (over 20000 records), two Transforms ran simultaneously.

How to determine whether the transfer of core_company is complete during the import flow of an incident make imports execute in order?

[Maik Skoddow · Accepted solution]

I would try to put all the data in one source file and have two transform maps right after another for one data source. Both transform maps will be executed one after another and you have no sync issues.

If this is not possible, you need to store a status for the first import anywhere in the system which can be watched by the second Flow.