I need to provide solution where there are multiple data source outside the ServiceNow. PDF and text files are stored in Data Bricks/Data warehouse or it can be not standard locations. This is unstructured data. These documents has policy, EOS, EOL and SOX compliance information. Data need to be massaged . So we can validate CI against this data before insert into CMDB. Data size could be ~150 GB. What is the best solution for it.
Thanks in advance
