Manually creating Robust Transform Engine definitions, records not being updated and no errors
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-25-2024 04:28 PM
So I have been trying to get this working for the past 3 days and am struggling. Maybe someone can assist.
I am currently importing data from an oracle data source using data sources (data streams are not an option at the time due to a platform bug when importing large numbers of records that causes the import to fail and no data is loaded into the import set table)
Now I would just use a transform map, but I was told to use RTE for the performance benefits it supposedly brings thanks to batch processing, however, I've tried just about everything I can think of to create the RTE definition and when I execute it against the data source, it will process all records, but it will have 0 inserts, updates, ignored, and skipped rows, and no error messages in the import logs
So, describing the nature of the transformer and the data I'm working with there are key parts
I have a table of records let's call "Roles" and these are handled by an Oracle JDBC datastream import with IntegrationHub import that automatically created the RTE definition. There is a key identifying field on these records that I will need in part 3 lets call it "external sysid"
I have a second table of records lets call it "Entitlements" and these are imported by an Oracle JDBC data source with a transform map. There is also an identifying field we can also call "external sysid" on this table of records as well
Then I have the third table, which is using an Oracle JDBC data source, and a Robust Transform Engine definition. The data being retrieved contains the its own identifying external sysid, as well as a relationship between a Role and Entitlement, using their external sysids.
In the RTE, I have set up a source RTE entity, and loaded the columns from the import set table
I have tried with and without a "Temp" RTE entity
Then I have a Target table RTE entity which has imported its columns, and the coalesce column is its own "external sysid" column.
There is a RTE entity mapping to map the source fields to the target fields (and I've also tried source > temp > target)
My target table is a m2m table, linking the entitlements to the roles through a reference to each table.
The RTE must therefore look up the record on the role table and entitlement table through its own "external sysid" column, then return the servicenow sysid to complete the reference.
However, no matter how many ways I've tried it, I always get 0 record inserts and updates, with no errors to investigate.
Following all the documentation here https://docs.servicenow.com/bundle/tokyo-platform-administration/page/administer/import-sets/task/cr...