Using Last Run Date time?

[urmilla]

Hi,

We are currently importing around 75k server records on a daily basis using two JDBC data sources. These data sources utilize one import set table and one transform map. The transforms take over 3 hours per data source to run, however we do run   other data sources   which bring similar quantity of data and the transforms re ni are

not that time consuming.

We have a date/time field being sent from our data source "Last Modified Date". We want to leverage this field for using the last run datetime functionality. If anyone has successfully implemented this functionality. Kindly guide us.

The wiki page gives us a gist but would appreciate a more real time example.

Best Regards,

Urmilla

[Ankur Bawiskar]

Hi Urmilla,

You need to enable the field "last_run_datetime" on the data source, so that it imports only the records which have been changed

Mark Correct if this solves your issue and also hit Like and Helpful if you find my response worthy based on the impact.

Thanks

Ankur

[urmilla]

So yes, I have used this field and filled the run date time fields as such. I ran the data source. The data source consumes as much time. Will it not consume the same amount of time in the subsequent runs.

[Kalaiarasan Pus]

You will need to fill these fields

[urmilla]

So yes, I have used this field and filled the run date time fields as such. I ran the data source. The data source consumes as much time. Will it not consume the same amount of time in the subsequent runs.