on - edited on by
Steph Morillo
If you miss any content, please leave it as a comment and I will add it to this article.
| Table of Contents |
My library Knowledge Sources To Go is very popular, but it was intended mainly as a thematically grouped guide to standard sources and was provided by me as a PDF file. For certain topics, however, there is so much content that I can no longer include it in that document, as it cannot continue to grow forever.
For this reason, I have decided to handle such topics in individual community articles like this one instead.
What is Importing?
ServiceNow offers a wide range of different approaches and tools to import, transform and distribute external data to target tables. Pretty much all common formats and protocols are supported, for example Excel files, external databases or data streams.
Easy Import
Easy Import is a simplified data import feature in ServiceNow that allows users to quickly import data into tables without the need for complex transform maps or scripts. It provides a user-friendly interface where administrators can generate an Excel template with predefined columns matching the target table's fields. Users can then fill out this template with data and upload it back into ServiceNow. The system automatically maps the columns to the corresponding fields and inserts or updates records accordingly. However, Easy Import is primarily designed for admin users, as it requires the admin role by default due to security considerations. While it offers a streamlined process for one-time or simple data imports, it may not be suitable for more complex import scenarios that require custom transformations or advanced data manipulation
Entry point to the official product documentation
Articles & Blog Posts
2020-12-02 by @darius_koohmare
Using Easy Import for quick one-time data loads
Videos & Podcasts
2020-12-02 by ServiceNow Dev Program
In this video, we demonstrate how to import a spreadsheet in to an existing table. We'll do two examples of both creating new records and updating existing records using the Easy Import feature from a standard list.
Data Sources
Data sources are used to create an import set so that data can be processed, if necessary, prior to being mapped onto a production table.
Entry point to the official product documentation
Videos & Podcasts
2020-12-02, by ServiceNow Dev Program
In this video, we're going to explore a few more features about import sets. This video covers data sources and the fields involved to help you understand what your options are and when to use them.
2021-01-21, by ServiceNow Dev Program
IntegrationHub Data Stream for Import Data Source
On this episode, join Chuck and Brad as we explore the Paris feature of using an IntegrationHub Data Stream as a data source to an import set! We will import records from another ServiceNow instance, transform them, and load them into a target table.
2023-03-01 by Jeff Thies
Creating a Data Source in ServiceNow
Integrations in ServiceNow start with the creation of a DataSource. This tutorial walks through the steps of creating a DataSource record in ServiceNow to load data from some external data collection and importing into the ServiceNow platform.
Data Loading & Transforming via Import Sets & Transform Maps
Import Sets allow administrators and developers to pull in data from different sources and import them into the ServiceNow platform. During that process, the data is first stored in an import set table and then copied to the target table based on a transform map.
Entry point to the official product documentation
Trainings & Courses
Learn how data from external systems can be imported and transformed for integrations on the Now Platform, regardless of data set size.
Importing data into ServiceNow applications is a fast and easy way to create records in application tables. Use the import data feature to import legacy records into new applications to preserve history or seed tables with critical application data.
Articles & Blog Posts
2016-12-15, by Josh Nerius
This initial post is focused on building an import set.
2017-03-31, by Josh Nerius
In this post, we’re going to address:
- Just what exactly is happening when you use the “Load Data” module?
- How do all of these pieces fit together?
I’ll address these questions and take a closer look at the things happening behind the scenes
2021-01-08, by ServiceNow Support
Import/Transform Execution Flow and Table Reference (KB0867752)
The purpose of this KB article is to provide you with a general view (or bird's eye view) of the ServiceNow platform's import/transform feature.
2021-01-08, by ServiceNow Support
Import Transform Summary Tool (KB0870045)
This is a tool specifically for troubleshooting import and/or transform issues. It will give you the configuration and runtime summary for an Import Set
2020-11-02, by Alikutty A
While working with transform maps, we generally have a habit of creating temporary tables for the load and leave i
2021-06-29, by cesar_sandoval
A Guide to Troubleshooting Import Set Issues
The purpose of this article is to introduce new users to this feature and gives them a blueprint on how to begin to troubleshoot issues that may arise while using Import Sets.
2022-01-13, by Kieran Anson
Import Set API - Goodbye SRAPIs?
The Import Set API allows for you to push data into an import set table and either asynchronously or synchronously transform it. The API will then either return the results or a sys_id for you to check the results in a separate call.
2022-10-24, by Martin Ivanov
Scheduled import from FTP data source: full tutorial incl. Testing
Recently I’ve been asked to explore the possibility of a scheduled import (e.g., once per month) of a file, which will be stored on an FTP server. As always, my one stop shop for information was the community. I found some pieces of information how to set up the data source, but I never found a full tutorial on how to setup and test the solution. And this is what you are currently reading.
2023-07 by David McDonald
ServiceNow Import Tips
- Part 1: Simple Import row-by-row
Typically there's a song and dance to import data into ServiceNow, but did you know that you can run imports faster and easier if the transform is already there? - Part 2: Scripts to start imports
Make imports and transforms part of your ServiceNow automations. Did you know that you can kick-off data sources and transforms using scripts? So many possibilties!
by ServiceNow Support
Understanding Concurrent Import Sets (KB0720801)
This article provides an overview of how hierarchical scheduled imports and concurrent imports work.
Videos & Podcasts
2020-12-02, by ServiceNow Dev Program
In this video we're going to get a little more advanced to cover those situations when you need to create new records AND update existing ones at the same time. For this, we need what's called an import set.
2020-12-02, by ServiceNow Dev Program
In this video we're going to cover transform map settings. Transform maps are part of the import set process that defines how data is processed between the import set table and the target table. This could involve how fields are mapped, any data manipulation, and more.
2020-12-02, by ServiceNow Dev Program
Discover how to map fields in a transform map and some of the finer details of what is possible.
2020-12-02, by ServiceNow Dev Program
Discover how to map fields in a transform map and some of the finer details of what is possible.
2020-12-02, by ServiceNow Dev Program
In this video we'll cover the concept of concurrent import sets - what they are, when to use them, and also importantly, when NOT to use them.
2020-12-02, by ServiceNow Dev Program
In this video, we discuss some ways to identify import set issues and what we can do about them.
2020-12-02, by ServiceNow Dev Program
There are a lot of system properties related to import sets. In this video we'll cover some of the most common system properties ones to be aware of.
2021-03-30, by GlideFast Consulting
How to Load Data Into an Import Set
In this ServiceNow Tutorial, Chris Sanford gives a demonstration on How to Load Data Into an Import Set in ServiceNow.
2021-04-19, by Lui lacobellis
How To Import Data Into ServiceNow
This tutorial will show you how to import data to ServiceNow. Specifically, this tutorial will show you how to import data from a spreadsheet into ServiceNow.
2022-09-12, by ServiceNerd
ServiceNow Inbound REST API | Import Set API
Setup an ServiceNow inbound integration using the import set API. In this video we look at how to create an inbound web service, import set, transform map and map the fields to our target table in order to use REST POST to update an incident from a 3d party system. We then use the REST API explorer to test it all out.
2023-03-01 by Jeff Thies
Understanding Import Sets in ServiceNow
Import Sets are an integral part of how ServiceNow integrations operate. They provide a staging area for data that has been imported into the platform but not yet transformed and loaded into a destination table. This tutorial teaches how import sets are created and how they provide the ability to transform data and map individual fields to target tables.
2023-03-01 by Jeff Thies
ServiceNow Transform Maps & Field Maps
This ServiceNow tutorial teaches you all you need to know about importing, transforming, and mapping imported data into ServiceNow.
Troubleshooting
Pre-configured filter for the respective topic. Remove the query string or modify the filters on the left side if you want to narrow down the search results in a different way.
Selected Articles
Determining if there is a significant number of records being imported (KB0538405)
Determining if a business rule is running on top of the transform map (KB0538161)
Determining if another process is running at the same time as the import (KB0538402)
Troubleshooting an import that is taking a long time to complete (KB0538436)
Troubleshooting an import that does not complete or is missing data (KB0538437)
Troubleshooting an import that fails (KB0538434)
Determining if an import failed due to resource constraints on MID Server (VM) (KB0538131)
Troubleshooting Inbound Integrations performance for ServiceNow Admins and Developers (KB0564204)
Import sets do not show loading data errors (KB0676136)
Import Sets Cleanup: The Cleanup module does not allow a non Admin user to clean up import sets data... (KB0681665)
Timezone issues in imported data sets (KB0721447)
All Import sets fail when run automatically; re-processing them manually works (KB0754968)
Import Deleter schedule job doesn't cleanup 7 days older data in ImportSet tables (KB0755790)
Web service imports stuck on 'Transform Synchronously' business rule and cancelled after 5 minutes (KB0758158)
Concurrent Import Sets are running single threaded after cloning (KB0759265)
Making import sets created for Import Set API calls "Asynchronous" to prevent Synchronous transform,... (KB0781666)
Import set Date field not importing (KB0790001)
How to identify slow data import due to coalesce? (KB0818304 🔒)
Work notes or additional comments are not being updated via import sets (KB0953784)
API Failures with 500 Internal Server Error and 429 Rejections caused by ImportSetTransformer spins ... (KB0961318 🔒)
Synchronous Import Sets Remain in 'Loading' State (KB0996698)
Integration Performance Diagnosis: Validating Import Set Transformer Jobs in Customer Instance (KB1002706 🔒)
Inconsistent Runtime on Import Set Transform Jobs (KB1117341 🔒)
Data Loading & Transforming via Integration Hub Import
Automate data import tasks from a new design environment that consolidates several legacy forms into a single modern interface. Managing imports through IntegrationHub simplifies the process of importing data from external sources and transforming it to ServiceNow tables. You can configure, run, and schedule your data imports all through a single interface.
Entry point to the official product documentation
Videos & Podcasts
2020-12-02 by ServiceNow Dev Program
This video demonstrates how to use an IntegrationHub Import to simplify the process of data sources, transform maps, and scheduling into one easy to use interface using a Data Stream Action.
2021-10-21 by ServiceNow Support
Manage complex integrations without code using IntegrationHub Import
IntegrationHub Import offers a structured framework with an intuitive user interface to help you tackle large and complex import jobs.
2022-08-12 by Secretary of Simplification
Import XLSX in Integration Hub
Starting with the Rome release of ServiceNow, it's possible to import spreadsheets using Integration Hub, with an interface that's easier to use than the traditional one. There is also another huge advantage: the ability to transform data without scripting! This video takes you through these simple steps.
2022-09-20 by ServiceNerd
ServiceNow Integration Hub Import
Let's look at how to use ServiceNow Integration Hub import to import some simple asset data. We use a spreadsheet (XLS) to upload as a data source and use the simple low code interface to map the source data (imported) to our target data fields. All this in a simple to use, modern looking screen.
Data Loading & Transforming via Integration Hub ETL
Use the Integration Hub ETL store app to create and manage ETL transform maps, which integrate third-party data into the CMDB without compromising the integrity of the CMDB. Integration Hub ETL provides a simplified user interface that guides you through the integration process end-to-end, including a test integration run of sample data.
Entry point to the official product documentation
Articles & Blog Posts
2021-01-05 by GlideFast Consulting
Introducing IntegrationHub ETL in ServiceNow
ServiceNow introduced IntegrationHub ETL alongside Service Graph Connectors in the Paris release. IntegrationHub ETL is the framework in which Service Graph Connectors populate the CMDB with data. ServiceNow continues to adapt the platform with new features and capabilities that allow us to populate the CMDB, leveraging new approaches that utilize the native Integration and Reconciliation Engine (IRE).
2021-01-05 by @Siyou Li
The following articles provide guidance on using IntegrationHub ETL (IH-ETL) application to integrate and ingest third-party data into CMDB.
2023-07-20 by praktisha5
Insert data in non-cmdb table using IH ETL
Starting from the Utah release, IRE now provides support for certain non-CMDB tables. To utilize all IRE features with these tables, you must first establish identification rules (CI identifiers and identifier entries) specific to those tables.
Videos & Podcasts
2020-05-14 by ServiceNow Support
IntegrationHub ETL | Importing resources into the CMDB
How to use ServiceNow’s IntegrationHub ETL application to import configuration items from a third-party source into your CMDB.
2021-04-02 by ServiceNow Community
Integration Hub - ETL nested payload feature demo
This is a demo of a new Quebec feature in Integration Hub ETL that natively processes nested payloads without scripting by Siyou Li. This powerful new feature can process structured data from data sources like XML or JSON for example.
2021-06-13 by Abdul Azeez
In this video we are going to see how to import the CSV file to Business Application and Business Capability table and build the relationship between these two tables.
2021-04-02 by ServiceNow Community
Creating a CMDB integration tutorial using IH-ETL
This video series demonstrates how to create a CMDB integration using IH-ETL. The tutorial uses Kong's API Gateway as the data ingestion source.
2024-02-26 by SnowIT
In this video, we'll dive deep into the setup process for IntegrationHub ETL in ServiceNow, focusing on seamlessly uploading data into the system using the powerful IRE engine
Troubleshooting
Pre-configured filter for the respective topic. Remove the query string or modify the filters on the left side if you want to narrow down the search results in a different way.
Selected Articles
Is it possible to add scripts while transforming data similar to traditional way - Integration Hub E... (KB0869735)
How to see count of inserts and updates on "sys_import_set_run" table when using IntegrationHub ETL (KB0952584 🔒)
Service Graph Connectors
Service Graph Connectors allow you to quickly and easily load large volumes of third-party data into your CMDB, ensuring data quality, timeliness, and consistency. Service Graph Connectors also make sure that third-party data is mapped to the right locations in the CMDB (as specified by the CSDM), which allows ServiceNow apps to use the data out of the box and increases reporting accuracy.
Entry point to the official product information pages
Summarized overview in one PDF file.
Introducing the Service Graph Connector Program
In this overview, we explain the purpose of the Service Graph Connector Program, its benefits and requirements, and how to get started..
Trainings & Courses
Service Graph Connector Essentials
This course is designed for ServiceNow administrators and consultants who need to implement and administer Service Graph Connectors. The course is structured in a streamlined and easy-to-follow format with informative text, interactive graphics, detailed demo videos, and knowledge checks. All videos contain closed captions.
Integrate Service Graph Connector for Microsoft SCCM
Learn how to configure the connector to import Microsoft SCCM data into the ServiceNow CMDB.
Articles & Blog Posts
2021-01-07, by GlideFast Consulting
What are Service Graph Connectors in ServiceNow?
IntegrationHub ETL is the framework in which Service Graph Connectors populate the CMDB with data. So, what are Service Graph Connectors?
2023-07-18 by @vaibhavbhatnaga
Service Graph Connector for Azure - Overview
SG-Azure is part of ServiceNow developed Service Graph Connectors. The connector is built to simplify the onboarding setup and ease the integration with Azure with the minimum invasive principal. This article describes the concepts and setup of the Service Graph Connector for Azure.
Videos & Podcasts
2020-11-18, by ServiceNow Community
Populate your CMDB with Service Graph Connectors or Discovery, why not both?
In short, because Service Graph is the nexus point for all data collected from every stage of the software development lifecycle and because it is all following the Common Service Data Model framework and guidance, customers will be able to use ServiceNow to answer questions that tie together people, process, technology and costs in a service-oriented view.
2021-11-02, by ServiceNow Community
Service Graph Connector, IH-ETL. Multisource walkthrough under 10 minutes
In this session, Navin will walk through our CMDB ingestion capabilities to show how to download a Service Graph connector, how to run it, show you how IH-ETL makes it easy to modify and manage the integration, and a also a quick tour through multi-sourcing.
2021-12-21, by ServiceNow HelpDesk
Service Graph Connector in Servicenow | SCCM | Jamf | SolarWinds | Vmware Workspace
This video help you understand integration between ServiceNow and SCCM/Jamf/SolarWinds/Vmware Workspace One UEM via Service Graph Connector.
2022-03-23, by ServiceNow Community
San Diego Release - ITOM / CMDB Service Graph Connector Updates
2023-01-23 by Oscar Lopez
ServiceNow - Service Graph connector for Microsoft Intune
Guided Setup for Service Graph connector for Microsoft Intune with steps to create Azure Application with permissions to pull Devices, Computers and Software into de CMDB.
