Import 2 Million Records.

[NamrataJain]

Hi All,

I have a data in excel which has around 2 Million Records and I would like to import the data regularly.

I know I can have scheduled import, but I am worried that it will slow down my instance.

I do have thoughts on SOAP messages but I am not sure if the client can provide me the same or not.

Also I was wondering of having a JDBC connection but since the database is internal and Se

Can someone suggest me some other method?

Thanks in Advance.

Best Regards,

Namrata Jain

[Chuck Tomasi]

Hi Namrata,

If you can get the JDBC connection, I would recommend this above SOAP and Excel for performance, scalability, and automation. Because your database is internal, you will be required to use a MID server, but that's not a big issue.

Will there be a performance impact? Almost certainly, but you won't know how much until you do some testing. I do recommend reading the link below on best practices.

MID Server - ServiceNow Wiki

Importing Data Using Import Sets - ServiceNow Wiki

http://wiki.servicenow.com/index.php?title=Import_Set_Performance_Best_Practices

[NamrataJain]

Thanks Chuck... I will try to see if I can get JDBC Connection.

[NamrataJain]

Hi Chuck,

I have got a concern from the security team while doing this JDBC connection.

They feel that the data won't be safe and though it will be role based access to data, ULTIMATELY ServiceNow Personnel will have all access to data as they control their database and can easily get access to data.

Do you know if anyone faced such problem before and have some solution ?

Thank you

Best Regards,

Namrata Jain

[drjohnchun]

Hi Namrata - have you looked at Edge Encryption? It protects data even from ServiceNow personnel.

Hope this helps.

Please feel free to connect, follow, mark helpful / answer, like, endorse.

John Chun, PhD PMP