Azure Data Lake ServiceNow Data Connection Options

[jdeken]

Our team is looking for the best approach to pull cmdb data, including custom fields, out of ServiceNow into Azure Data Lake for reporting and analysis. When trying to pull data from using Azure it does not appear to want to pull the data that is in custom fields in ServiceNow. Would anyone be able to assist me in understanding how we could use Azure Data Lake and pull all data from ServiceNow? What would be the best approach to share the data to. Thanks so much!!!

[Riya Verma]

Hi @jdeken ,

Hope you are doing great.

To pull data from ServiceNow into Azure Data Lake using the REST API, you can follow these general steps:

1. Authenticate with ServiceNow

2. Construct API requests: For example, to retrieve all records from the "cmdb_ci_server" table, you can make a GET request to the following endpoint: https://instance.service-now.com/api/now/table/cmdb_ci_server.

3. Handle pagination: ServiceNow API supports pagination through the "sysparm_limit" and "sysparm_offset" parameters.

4. Extract and transform data: Once you receive the data from ServiceNow, you can process and transform it as per your requirements before storing it in Azure Data Lake. 

5. Load data into Azure Data Lake

[amarparthas]

I am not sure if you are still looking for an answer.

There are multiple ways to export data from Service Now. You could use Snow Mirror  <OR> Create Scheduled Data Export/Data Export Set etc. assuming the Mid Server is running on Azure VM, the Export Target will be directly to Azure Data Lake storage. This is assuming you have necessary access on SNow & Azure.

Good luck anyone looking for an answer.