Scripted Rest API - Bulk Operation

[Khanna Ji]

Hi Friends,

I am working on an interface where third party will be pushing the data into ServiceNow in one by one through Scripted Rest API. Entries created will be like 100K per hour. To improve the performance, I want to use import sets and transform map to that I can manage the data load as well as transform in bulk way rather than keeping the system busy for such transaction. Interface will be real time but I would like to run the transform map only once in an hour so that performance is improved. Also I do not want to keep the logic or lot of script in the scripted rest API. Maybe a fields on the import set table can be used in the scripted rest API to map/accept data from third party through scripted Rest API.

Please help me how can I proceed with this approach and things I need to be aware of it.

Appreciate your help and guidance on this.

[Ankur Bawiskar]

@Khanna Ji 

My thoughts

-> Create import set table with your fields etc, create transform map and map it with target table

-> In your scripted REST API simply insert data into staging/import set table and transformation will kick automatically, you need not worry and this will be async operation and Scripted Rest API will have light code which simply inserts into staging and won't do anything in target table

-> since data will be huge, try to setup from cleanup script to delete import set records. OOTB they are kept for 7 days but you can reduce that

💡 If my response helped, please mark it as correct ✅ and close the thread 🔒— this helps future readers find the solution faster! 🙏