Data import and transform map and fix script issue

[Mani Chand Yenu]

Hi Community,

I have come across a weird issue. I am working on use case to import data from MySQL to ServiceNow using a JDBC data source. I have created 5 data sources (one for each table of MySQL). The next step is to map all the loaded data into one custom table. I have done that and using the data available in custom table I started creating reports. After creating 3 reports, for one of the report, I had an issue with the data present in table. I made a change in type of field from String to reference. And I deleted existing records available in custom table and clicked on reprocess related link below import sets. And tried to re-transform the data. But it got paused on Transform map UI. And then deleted the Import sets and tried to reload the data from data source. Then I got the error like this.

And I had created a fix script for the same use case. Once I clicked on run in background and opened progress checker. It shows error like this.

And I tried to delete existing data sources and transform maps and started created them from scratch. And tried by loading the data from data source and am still facing the same issue.

Is this any kind of performance issue or any transaction issue. If any one of you came across with this kind of issue. Could you please help me resolve this issue?

Thanks,
Mani

[Bhuvan]

@Mani Chand Yenu 

Check below knowledge article, it could be an issue with one of the nodes and restarting the node should fix it. Raise a ServiceNow Support case to resolve the issue

https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB0825508

https://www.servicenow.com/community/servicenow-ai-platform-forum/unable-to-obtain-worker-thread/td-...

Make sure transform map field map reflect the changes, if not try to remove and add the field again before transformation from import set tables to target table.

If this helped to answer your query, please mark it helpful & accept the solution. 

Thanks,

Bhuvan

[M Iftikhar]

Hi @Mani Chand Yenu, 

According to your error message "Unable to obtain worker thread", issue is not with your data source or transform map configuration but with the overall capacity of your instance to process background jobs. This error means that all available background worker threads on your instance are currently busy with other tasks so your new import or fix script cannot even begin to run.

To resolve this, you need to identify and terminate the long-running process. You can do this by navigating to System Diagnostics > Active Transactions (All Nodes). Look for any transactions related to your import set or fix script that have been running for an extended period and cancel them. On PDI, which has limited resources, it is also a good practice to import data in smaller batches to avoid overwhelming the system.

If my response helped, please mark it as the accepted solution and helpful so others can benefit as well.