What is the best approach to import 4M CIs into Servicenow
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎01-04-2024 04:52 AM
We have a requirement to load about 4M records into a staging table(via mid server) and then transform data to 2 different ServiceNow tables. What is the best way to achieve this?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎01-04-2024 04:54 AM
Greetings!!
Try to break the data in chunks and with with some combinations.
If my response proves useful, please indicate its helpfulness by selecting " Accept as Solution" and " Helpful." This action benefits both the community and me.
Regards
Dr. Atul G. - Learn N Grow Together
ServiceNow Techno - Functional Trainer
LinkedIn: https://www.linkedin.com/in/dratulgrover
YouTube: https://www.youtube.com/@LearnNGrowTogetherwithAtulG
Topmate: https://topmate.io/atul_grover_lng [ Connect for 1-1 Session]
****************************************************************************************************************
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎01-04-2024 06:42 AM
The data has to be split into smaller, manageable chunks before loading. But it is suggested to first discuss with the configuration manager, CI class owners, service owners, application owners etc. to make sure that the target classes are correct. If all the 4M CIs are going into only 2 CI classes, there is a high possibility of many CIs getting populated in wrong CI classes (unless this is already fully validated and confirmed by relevant stakeholders). Exclude already inactive CIs from the data load as much as possible. Also if you do not have a plan to automate the data updates for most of these records in the future (via discovery or integrations), it is not recommended to load so much data as the data will become stale soon without any automation to update & maintain it (4M is a very huge number which would be impossible to maintain manually).