Does the Table API have a coalesce function?

Todd O · ‎09-20-2016

I have mostly used the Import set API for loading data into ServiceNow. Often times, I need to do this because I have a script that will run in SN to prep and transform the data. However, for some of my loads, it may be a better approach to use the Table API instead. I'm thinking I may get some performance improvements since it wouldn't have to go through a transformation process. But, I need the coalesce feature so I don't create duplicates. Does the Table API have this? I don't see it mentioned in the documentation and my basic tests indicate it doesn't exist.

Second part to my question is what is the MOST efficient way to pump a lot of data into SN using the Rest API? The only performance approach that looks like will help is using the X-No-Response-Body set to true which saves some data from being sent back. I need more than this because it's taking close to 1 second per transaction and when I have 40,000 of these, it's running 1/2 day long. It needs to remain as a Rest API though as the data is remote and sent through a program with Rest API. Thanks!!!!

Todd

p.s., I should also add that I'm following this recommendation as well but still need further perf improvements if possible. http://wiki.servicenow.com/index.php?title=Troubleshooting_Import_Set_Performance#gsc.tab=0

Chuck Tomasi · ‎09-21-2016

Hi Todd,

For Importing bulk data with coalesce requirement rest import set API is the way to go. If you want to improve perf suggestion is to turn off business rules on transform maps if possible, another tip is to make sure the import set cleanup jobs are running to keep import set tables small. We are looking at enhancing async import set rest API processing to improve this as well.

View solution in original post

tony_barratt · ‎09-20-2016

Hi Todd,

There is no coalesce feature with REST Table api.

You do have insert - POST - or update - PUT or PATCH however.

Best Regards

Tony

Chuck Tomasi · ‎09-21-2016

Hi Todd,

For Importing bulk data with coalesce requirement rest import set API is the way to go. If you want to improve perf suggestion is to turn off business rules on transform maps if possible, another tip is to make sure the import set cleanup jobs are running to keep import set tables small. We are looking at enhancing async import set rest API processing to improve this as well.

Todd O · ‎09-21-2016

Thanks Chuck. That's what I thought but glad you confirmed.

Ash41 · ‎05-15-2018

Hello Chuck,

I'm trying to POST with REST API, but it is creating duplicates, I need to know how to add coalesce here in REST API for one field without using business rule, I'm using Jakarta. Please help me with this.

Thanks,

Ashok.