Possible workaround to extract data from ServiceNow

[pablor]

Hi all,

Could somebody advice how to face the extraction of huge amount of data from ServiceNow?

When trying to query tables with more than 200k records (including joins), our ODBC connector is not working as expected.

We have come with 4 different ideas how to get the data, but I will like to hear from you. Thanks in advance

• Possibility of getting database backup from SNOW?
• Snow Mirror tool
• Find a way how to use ODBC on tables with more than 200k records?
• How to raise limit of exported data from ServiceNow GUI?

[Pradeep Sharma]

Hi Pablo,

You may find the below blog helpful.

https://community.servicenow.com/community/blogs/blog/2014/08/01/increasing-the-export-limit

[pablor]

Hi Pradeep,

Thanks, but I'm talking up to 200.000 records. I need other kind of solution

[sarahbr]

I ran into this issue before, and we bundled the records into smaller batches to extract the data.   We did clone production to our test instance, so we wouldn't impact performance of production, then continued to update the extract with sys_updated_on once all of the records for the fact table were extracted.  

Try a query sorting by sys_id and then do a second where sys_id>= last one of the prev query or on the task number (assuming you are trying to get something like Incident extracted), its a pain to do this in batches, but I was able to get 50K+ records at a time.

I also recommend pulling the fact table and the dimension tables individually, and perform the join on your ms-sql server.  

[pablor]

Hi sarahbr,

Many thanks for your answer.But, at the end, we have considered to try Snow - Mirror and see if really help us to get the results we are looking for.

http://www.snow-mirror.com/