Slow data retrieval from REST API Call to Service Now (More than 6 hours for about a million records)

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-19-2018 02:24 PM
I am trying to retrieve data from Incident table in ServiceNow via an REST API Call to integrate data to Snowflake. The data retrieval is extremely low taking about 6 hours for about a million records.
Request your help in figuring out if this throughput can be increased or if there are alternates for data retrieval (like directly connecting to and accessing the underlying database)
- Labels:
-
Incident Management
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-11-2019 12:35 PM
Not sure if my response is still relevant but push technology is going to be higher throughput as compared to inbound REST calls.
At Perspectium we specialize in exporting large volumes of data from ServiceNow to Snowflake
https://www.perspectium.com/enterprise-solutions/data-integration-datasync/
David
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-24-2020 05:14 AM
Snowflake is directly supported by SnowMirror replication tool:
You can replicate selected tables directly to Snowflake.