Scripted Rest API - Bulk Operation

[Khanna Ji]

Hi Friends,

I am working on an interface where third party will be pushing the data into ServiceNow in one by one through Scripted Rest API. Entries created will be like 100K per hour. To improve the performance, I want to use import sets and transform map to that I can manage the data load as well as transform in bulk way rather than keeping the system busy for such transaction. Interface will be real time but I would like to run the transform map only once in an hour so that performance is improved. Also I do not want to keep the logic or lot of script in the scripted rest API. Maybe a fields on the import set table can be used in the scripted rest API to map/accept data from third party through scripted Rest API.

Please help me how can I proceed with this approach and things I need to be aware of it.

Appreciate your help and guidance on this.

[Khanna Ji]

@Ankur Bawiskar - Any update on my previous comment?

[Ankur Bawiskar]

@Khanna Ji 

but you will require those records which came in that 1 hour to be stored somewhere ?

custom table?

💡 If my response helped, please mark it as correct ✅ and close the thread 🔒— this helps future readers find the solution faster! 🙏

[Ankur Bawiskar]

@Khanna Ji 

seems you got your solution here, see and enhance

Making import sets created for Import Set API calls "Asynchronous" to prevent Synchronous transform,... 

also check this

Running transform maps asynchronously 

Different Ways to Implement Asynchronous Inbound APIs in ServiceNow 

How to change import set row mode to asynchronous ? 

💡 If my response helped, please mark it as correct ✅ and close the thread 🔒— this helps future readers find the solution faster! 🙏

[Khanna Ji]

You are wrong. It's not a separate import set for each record, I see rows are added to the same import set.

Unable to understand how system is picking same import set even after 17 hours from last import set record? Does it consider 24 hours before creating a new import set? If yes then where does that setting resides?

[Ankur Bawiskar]

@Khanna Ji 

the links I shared has approach to do that asynchronously and many of the developers have used that same logic.