ServiceNow import data from multiple remote files (on MID server)

Go to solution
RahulY00040
Tera Contributor

‎12-02-2024 11:14 AM

Hello team,

 

We have a scenario in which we need to feed/import data from multiple files in ServiceNow staging table for transformation. Looks like current OTB configuration allows single remote file read to the data source.

 

Any option to load data from multiple remote files? Looking for least custom solution to avoid maintenance overhead.

 

Thanks in advance,

Rahul

Labels:
0 Helpfuls
  • 1,341 Views
1 ACCEPTED SOLUTION

Go to solution
DineshS
Tera Guru
In response to RahulY00040

‎12-03-2024 11:19 AM

Hi Rahul,

You may push the files from MID Server into ServiceNow using the attachment API(or other methods as mentioned in https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB0817437). Once it is in ServiceNow, you should be able to process them and load into target tables.

If you have IntegrationHub Pro(?), and if you are on a Windows MID server, you can run PowerShell commands from the Action in Flow Designer, to read, parse and load the file on to the table(s). In some cases, I have found this to be effective especially when we do not need all of the data from the files, but a subset. If you have the right license, the Powershell option will appear under Integrations when you add a step in the action in Flow Designer

View solution in original post

6 REPLIES 6

Go to solution
RahulY00040
Tera Contributor
In response to -O-

‎12-02-2024 03:31 PM

Thanks for your response.

 

Remote JSON files are going to reside on MID Server by design/architecture. Is FTP/SFTP needed in this case?

 

Please elaborate if using the "Custom (Load by Script)", can I read the data from remote files and populate the staging tables for transformation.

 

Thanks in advance,

Rahul

 

0 Helpfuls

Go to solution
-O-
Kilo Patron
Kilo Patron
In response to RahulY00040

‎12-03-2024 12:15 PM

If the files reside in a filesystem on the MID, as @DineshS pointed out, you need an external something to upload files to ServiceNow and trigger their load into the import set row table.

That external something (e.g. PowerShell script) could indeed be triggered from ServiceNow.

But it might be better to use a filesystem watcher on the MID server so as to upload and process a file as soon as it is created.

In this scenario Data Sources of type "Custom (Loaded by Script)" will not work.

These scripted Data Source can be useful for scenarios where the source is a SOAP, or REST endpoint.