Remote file import and transform

[rhofing]

I am trying to understand how a process of remote file import and transform works. The scenario I am trying to understand is the following:

- Import a remote file (it contains new users )

- run a transform map to insert the new records into the user table

- execute this process on a scheduled basis

So, I created a remote file import scheduled job that imports a CSV file.   Then created a transform map that takes the data from the import table and inserts user records. The job runs correctly at the scheduled time and imports the records into the import table. The transform (which uses the import table as the data source) works correctly as well, but I am running the transform manually.   My question is, how do I run the transform map after the remote file import completes?   Can I have the remote import trigger the transform?   Can I schedule the transform?   What I want to do is have the import and transform work a "unit".

Additionally, the import table gets larger every time the import runs since new records are added but the older records are not removed.   How does the transform know to only take records from the latest import?   And, what is the best practice regarding the older records?   The table will keep getting larger and larger if it is not purged from time to time.

Ric

[Chuck Tomasi]

Hi Ric,

For scheduled imports, the transform is automatically recognized as associated to the import. Not much to worry about that.

As for the file getting larger and larger...   How many records are we talking about? Hundreds? Thousands? It knows how to update vs. insert based on the coalesce values.

reference:

Scheduling Data Imports - ServiceNow Wiki

Import Sets - ServiceNow Wiki

[california123]

Hi Can you please check this once am unable ti use Schedule file import

Scheduled import through SFTP

[Pradeep Sharma]

Hi Ric,

If you insert records in import set table then transformation will happen automatically.

To answer your second question there is OOTB scheduled job "Import Set Deleter" which deletes record created 7 days ago. I don't think you need to worry about records inserted in staging table.

http://wiki.servicenow.com/index.php?title=Import_Sets

[rhofing]

Thank you Pradeep and Chuck!

Ric