Bulk import thousands of PDF and Word documents compressed in a zip file into a table

chrisreidr · ‎08-06-2024

Hello,

I am requiring a custom solution allowing me to import multiple zip files containing a large amount of PDF and Word documents to example_table. As each file is imported, a new record on example_table is created for said file where it is added as an attachment.

Once the record for the document is created and is attached as an attachment, data from the file name from each document (a series of numbers which will be parsed and mapped to the example_number field value on that record) and data from the file itself populates the fields found on the record below:

example_number, example_description, example_string_one, example_string_two

Initially I was thinking creating a data source and using system import sets but does not seem feasible given the sheer volume. Third party software integration may not be an option either. A custom solution seems to be required that will also need to be migrated between environments. My questions concerning the feasibility of this are:

Starting with the location of the zip files, would being stored locally or on a cloud storage like Google Drive be more feasible?

Are there any native OOB features I can use, such as Data Source/System Import Sets or Employee Bulk Management Imports or would everything have to be custom?

If it is custom then where should I start and what would be the first custom solution I should begin researching/building?

Any insight or direction is much appreciated.

Located below are the articles I have read that did not seem to have what I'm looking for:

Is it possible to mass/bulk import documents to the system?

https://www.servicenow.com/community/developer-forum/is-it-possible-to-mass-bulk-import-documents-to...

Knowledege Base - Part 1: Import bulk 'docx' and 'doc' files with images to ServiceNow as KB with Po...

https://community.servicenow.com/community?id=community_blog&sys_id=bbcde2e9dbd0dbc01dcaf3231f96193f

How to import 1000 files (.pdf, excel, word, etc)?

https://www.servicenow.com/community/knowledge-managers/how-to-import-1000-files-pdf-excel-word-etc/...

Is able to bulk import word doc files and create kb submissions

https://www.servicenow.com/community/developer-forum/is-able-to-bulk-import-word-doc-files-and-creat...

Bulk Upload Documents into ServiceNow HRSD