K20 - LAB 2795 - Use integrationHub ETL to Import Data - Q&A

[glenn_pinto]

Welcome to LAB 2795 - Use integrationHub ETL to Import Data

This forum is used as the digital learning experience Q/A for the K20 - LAB 2795 - Use integrationHub ETL to Import Data. Please post your questions here and feel free to refer back to this article post knowledge.

NOTE: This article will not be monitored post K20.

[glenn_pinto]

Welcome! Please use this forum to post and review questions and answers.

[glenn_pinto]

fzf

[glenn_pinto]

test

[Alessio Onofri1]

having this error on the dev instance

[Aidan]

Great presentation for a very useful tool.  Unfortunately I'm having the same issue as the other poster on this thread.  I've installed IntegrationHub ETL on a new Orlando developer instance and receive the same error reported.  However, as well as that error the following are also provided which hint at an issue with cross-scope priveleges;

Access to api 'setValue(sys_robust_import_set_transformer.name)' from scope 'sn_int_studio' has been refused due to the api's cross-scope access policy
Access to api 'setValue(sys_robust_import_set_transformer.robust_transform_engine)' from scope 'sn_int_studio' has been refused due to the api's cross-scope access policy
Access to api 'setValue(sys_robust_import_set_transformer.source_table)' from scope 'sn_int_studio' has been refused due to the api's cross-scope access policy
Access to api 'setValue(sys_robust_import_set_transformer.batch_size)' from scope 'sn_int_studio' has been refused due to the api's cross-scope access policy
Create operation against 'sys_robust_import_set_transformer' from scope 'sn_int_studio' has been refused due to the table's cross-scope access policy

I received no errors when unstalling IH-ETL so cannot understand why this would be happening.

[LA_]

HI Guys.

I am about to do this lab exercise, when I encountered this instruction:

From your instance, navigate to Self-Service > Knowledge, and under the Support Files Knowledge Base, open the IntegrationHub ETL Support Files article and download the two attachments to be used for this lab.

View the contents of both files before proceeding to the next section:

• Import1.csv

• Import2.csv

I requested a developer Orlando/Paris instance and I cant seem to find the support files knowledge base.

Can you please advise where I can find it? Thanks!

[LA_]

Hello.

Coming from the CMDB Fundamentals path, this last delta course did not provide any instruction how to get the NowLearning instance (as per tech support, there exists a NowLearning instance) that is why I did not know where to go (unlike the CMDB health and configuring the CMDB lab exercises which provided a specific lab instance.) Hence I requested my own developer instance (and just added the IntegrationHub ETL plugin and loaded the import files). 

I have completed the lab exercises, but it doesn't have a way or integrate/cascade back to my CMDB Fundamentals path and make it complete/100%. Any ideas how to fix this?

thanks.

LA.

[rksnow]

Hello, I'm having a problem with ETL in my scoped Application in Servicenow. I have created Import Set Table, Data Source, Scheduled Import Job, and Provided this information in ETL. Created Identification, and Reconciliation rules. Have also set the Target table and mapped the fields in ETL. When I run the job, Data is importing to my Staging Table but not transforming to the Target table provided.

Error Message I'm getting is: "Transform map record not provided, transform stopped".

But, I did include the CI class in ETL. Also, When I run the "Test and Rollback Integration Results" from ETL, All I get is null values - I mean '0'.

Could you please let me know if I'm missing anything?

[Manisha12]

Same issue with me. I cannot find these files.

[Manisha12]

Thanks a lot. I read your this post after the previous one and then I realised the mistake I was doing. 

[rksnow]

I deleted the ETL and recreated a new ETL, this time it worked. 

[alex_s]

Hi, I too am having the same issue of how to get a NowLearning instance to complete the lab coming from the CMDB Fundamentals path. Does anyone have a fix? I cannot complete the course 100% at this stage.

thanks.

[LA_]

In each of the module/lesson, check all the videos and those requiring action/clicks and make sure they are finished/clicked. I left one video that did not finish (like 56 seconds remaining) and after completing it, it became 100%.

[alex_s]

yes.. i left 1 video with like 3 secs.. thanks LA..

[Ian Wilson]

Same issue, where is the article and where are the files?

[Ian Wilson]

I'm trying to do this lab exercise and the setup contains this:

From your instance, navigate to Self-Service > Knowledge, and under the Support Files Knowledge Base, open the IntegrationHub ETL Support Files article and download the two attachments to be used for this lab.

View the contents of both files before proceeding to the next section:

• Import1.csv

• Import2.csv

I requested a developer Orlando instance and I've installed the IntegrationHub ETL plugin but I can't seem to find the support files knowledge base.

Can you please tell me where I can find it? Thanks!

[Aidan]

I believe the files for the imports are in the instance assigned when doing the training.

https://nowlearning.service-now.com/lxp?id=overview&sys_id=a4c0965adbc81810785e2a59139619ad&type=course

[Ian Wilson]

Thanks for that, I came to the Lab via the CMDB Fundamentals Path which doesn't create an instance for you so I requested one which didn't have the article.

Once again, thanks.

[glenn_pinto]

There are two ways to get to this course. 

1. Via the Configuration Management Database Fundamentals Path from section 10.2.

2. Directly to the course Use IntegrationHub ETL to Import Data.

If you access the Use IntetegrationHub ETL to Import Data course directly (option 2), you will see an option to access an instance which is pre-configured and has access to these import files in the KB.

If you access this course from the CMDB Fundamentals path (option 1), you do not see the option to access an instance. This is an issue within NL that the NL team is looking into. 

If you enroll directly to the course (option 2), and use the instance provided with the course, it should be a seamless experience.

If you have your own instance and need the files, I have provided them here on a separate link. 

Import files link 

Hope this helps.

 

[Spevin]

Yeah, but this part doesn't use a simulator like the other ones did. I think people are actually trying to request a dev instance and are expecting to find the csv files present there after activating the integration. Should probably have someone from service now attempt their training and verify it is working as expected, or just post the csv links with the lab guide.

[Spevin]

What everyone is looking for was provided my Mr. Pinto buried in a thread below:

The Illusive csv files:

https://servicenow.sharepoint.com/:f:/s/CDevExternal/EmF9ThffHhdEutPDHGAOv14BdE8Ql0_-15_alIT-s74ywg?e=aqYs4N

Enjoy!

[glenn_pinto]

If you complete the ETL course on its own, it should display that way part of the CMDB Fundamentals path as the path just provides a pointer to that course. Open a case if you are not seeing that from the top right menu of Now Learning. Thanks

[glenn_pinto]

But this course does provide an instance which has the import files and the IH ETL already installed for you. Now Learning courses now have the option to provide simulators which have tasks associated with them or just an instance which is the same as a dev instance but the course creator can preconfigure the instance to make it easier on the student to complete the lab without them having he/she request an instance and install all the individual bits. 

[Olsztyniak]

How do I start the simulator in LAB2795? I do not see any links for the simulator?

[glenn_pinto]

You should see the option from the top of the form in the green section under the name of the course. 

In the purple box with instructions it describes it on step 4.

[jonathandrury]

in the lab instance, "integrationhub ETL" does not appear to be installed as of 11/17/20 (any more?). can anyone confirm they were able access this capability recently? 

"

Create ETL Transform

1. Navigate to Configuration > IntegrationHub ETL.

2. Click Create new.

"

[glenn_pinto]

Are you using the instance provided with the training or your own instance?

[glenn_pinto]

There are two ways to get to this course. 

1. Via the Configuration Management Database Fundamentals Path from section 10.2.

2. Directly to the course Use IntegrationHub ETL to Import Data.

If you access the Use IntetegrationHub ETL to Import Data course directly (option 2), you will see an option to access an instance which is pre-configured and has access to these import files in the KB and the IntegrationHub ETL store application is pre-installed.

If you access this course from the CMDB Fundamentals path (option 1), you will not see the option to access an instance. This is an issue within NL that the NL team is looking into. 

If you enroll directly to the course (option 2), and use the instance provided with the course, it should be a seamless experience.

If you obtain your own instance you will need to install the IntegrationHub ETL store application plus obtain the two import files that are provided below.

Import files link 

Hope this helps.

[Dustin19]

Just an fyi that I did option 2 yesterday and integrationhub ETL was not preinstalled. You have to install it from the servicenow store.

[Dustin19]

Also when I am on the "Etl transform Map assistant"  step three: map data to cmdb and add relationships -> select cmdb classes to map source data and I go to add a conditional class it will not allow me to select any attributes from the drop down menu when doing an else if . any idea why this is happening ?

[Cary Kuiper]

I'm encountering the same issue with attempting to create a Conditional Class.

I have tried 3 different browsers and have had the issue from both my own Developer instance and from a lab instance from the ETL course.

@glenn.pinto any suggestions?

This is the last piece I need for the CMDB Fundamentals Path.

[Ajay54]

Same case with me. I dont see IntegrationHub ETL.

Got instance using - Directly to the course Use IntegrationHub ETL to Import Data.

Can any one help ?

[Dustin19]

In your instance search 'plugins' from the application navigator. Then search the plugins for IntegrationHub ETL .

[Ajay54]

yes, from plugin, I was able to install. Thanks for the help!

[glenn_pinto]

It appears that the version for the IntegrationHub ETL used in the lab since K20 is no longer downloadable from the store from our provisioned instances. This was just updated so any new instances provisioned should have the application available. If you are running this lab from a personal instance you will need the following:

Plugin: Integration Studio API

Store Applications: IntegrationHub ETL & Integration Commons for CMDB

Note: the lab guide is based on an older version of these store applications, so installing the latest and greatest may provide slight differences in the steps listed and screen shots provided. 

[Jo_o Damasceno]

Thank you!

[Vaughn1]

Hi - I have successfully installed the plugin for both my personal instance and sys admin instance. I am still not seeing configuration > IntergrationHub ETL choice in my filter navigator

[Ajay54]

For me , it took some time to reflect. So not sure might be you have to wait little.

[Vaughn1]

Yes, confirmed. It took some time for the IntegrationHub to show up. Thanks. I'm good now.

[Maciek3]

I can't find/install IntegrationHub in the Plugins... Did you have to wait for it to show up as available to install or have to wait for some time are installation to have it on the apps list?

I can install it from my personal dev instance, but can't look it up, as above, on the instance from Use IntegrationHub ETL to Import Data course. Will NowLearning read the progress from personal dev instance? 

[glenn_pinto]

What instance are you using? Dev instance, employee instance, or instance provisioned with the NL course?

[Maciek3]

I can install it from my personal developer instance, but can't look it up on the instance from Use IntegrationHub ETL to Import Data course.

I've contacted NowLearning Support and got an answer that instance provided with Use IntegrationHub ETL to Import Data course seems to not connect with the store and they will look into this.

[glenn_pinto]

Ok good to know. The integration with the store does break on occasion. The instance provided with the course should provide access to the store app and the support files used to import. If you install the app on your own instance, you will still need the import files. Due to the recent change with sharepoint links expiring after 6mo, the link provided earlier in this thread, has expired in order to access the import files. Please use these links:

Import files:

https://servicenow.sharepoint.com/:f:/s/CDevExternal/EmF9ThffHhdEutPDHGAOv14BdE8Ql0_-15_alIT-s74ywg

Challenge Solution Videos:

https://servicenow.sharepoint.com/:f:/s/CDevExternal/EnWLvqswZCpOokOUk67OjjIBzUJRlFW-K5CpdmNwy2bymg

[Maciek3]

I received a new instance where IH ETL is available, but now I have a different issue. I can't save a new ETL Transform. As soon as I hit "Save" I get this error: 

 And later on, when I go to a different application, I see bunch of errors:

I've updated IH ETL plugin to the newest version, reinstalled it, re-logged into the instance and also installed Integration Commons for CMDB. Nothing helps. Any ideas?

Also, thanks for the Sharepoint URL's.

[satishkomali]

While trying to complete the "Create ETL Transform" step as per the steps mentioned in the lab guide, I am getting the below error:

Error inserting sys_robust_import_set_transformer record

[satishkomali]

And then this bunch of errors when I tried to navigate away from the previous page.

[satishkomali]

I registered for a PDI separately and activated the IntegrationHub plug-in and tried repeating the process to end up with the same error messages as my earlier screenshots.

[KYanakiev]

I am sorry if I misread or missed anything but where is the link for the instance on option two? I don't see it in the lab session abstract or task one (https://developer.servicenow.com/connect.do#!/event/knowledge2020/LAB2795/lab_LAB2795_section_1__introduction) 

EDIT: I got it now - the link you shared is actually different BUT the lab reference in the course is for the lab guide(link shared on the previous paragraph).


I don't see it in the CMDB fndmntls path section 10.2.4. either. Maybe I misread that I should keep the simulator from the earlier lab section 9.0 of the CMDB fundamental course.

I eventually added that in my dev instance but that is not properly explained/references in the instructions IMO AND the files are not imported.

PS: The import files link shared shows as expired.

[KYanakiev]

I am sorry this is almost a year later but do you remember if you also got the import1/2.csv's added ?

[glenn_pinto]

I posted this before. Hopefully it will assist.

There are two ways to get to this course. 

1. Via the Configuration Management Database Fundamentals Path from section 10.2.

2. Directly to the course Use IntegrationHub ETL to Import Data.

If you access the Use IntetegrationHub ETL to Import Data course directly (option 2), you will see an option to access an instance which is pre-configured and has access to these import files in the KB and the IntegrationHub ETL store application is pre-installed.

If you access this course from the CMDB Fundamentals path (option 1), you will not see the option to access an instance. This is an issue within NL that the NL team is looking into. 

If you enroll directly to the course (option 2), and use the instance provided with the course, it should be a seamless experience.

If you obtain your own instance you will need to install the IntegrationHub ETL store application plus obtain the two import files that are provided below.

Import files link 

Hope this helps.