Wanting to Import data using external REST service on a schedule using Import Set / Transform Map

[james_whitt]

We're running into an issue where right now we are using Scheduled Jobs to kick off a script include that uses a MID Server to connect to a 3rd party system for importing data into a ServiceNow table directly. What we want to do is use Import Sets and Transform maps also, so that we aren't pulling for 3rd part software using REST and entering data directly into the tables using the script.

With that said, we are stuck on figuring out how exactly how to "Load Data" into the import set and then kicking off then "Run Transform". We know the transform map needs to be asynchronous and that if we were using odbc, file, xml, we would go the Import Sources route, but we can't. Have to be ServiceNow scheduled import using MID server to consume the REST services.

Any help would be appreciated.

[Anders Pr_stega]

Hi

Before the recent change to the community system this thread was much longer containing several useful comments. Does anyone know if they are still anywhere to be found?

-Anders

[ChrisBurks]

Hi Anders,

All comments are still here. They are just nested and collapsed. If you look at the bottom right corner of a particular comment and see "View [n] replies to [user name] ▾" , you'll need to click on everyone to see the replies related to that comment.

[Anders Pr_stega]

Thank you!

[Anders Pr_stega]

In a community thread that must have copied this thread to help in on his way, there's a question that is relevant to me:

"When you open an import set entry, the upper table shows the transform history and lower table shows the import set rows.You will notice that for a web service import set by not specifying a hard coded sys_import_set, Transform History table(sys_import_set_run) will have as many entries as the import set rows. Which makes me think that each import set row is run separately. If   you specify a import set sys_id, there will be only one row in the Transform History table(sys_import_set_run) table."

Every tranformation is successful and related to the same Import Set (sys_import_set) but the behaviour is as described above. Does anyone know how to prevent this behaviour?

In the thread is also mentioned this behaviour that I also see and would like to know how to mitigate:

"davidself3, were you able to change the status of the import set from 'loading' to 'processed' once the load from web service is complete?

Karthik, No, after a certain time period, the import set flips to "processed". I haven't paid close attention to the time, but I believe it's a day or two. In our instance it's not important to know when the import is complete, only that the locations are current with our corporate location API."

Thank you!