How do you use Data Sources with a Hive database?

bradwestvig
Giga Guru

We have a request to bring in data using a Hive (Hadoop) data for our customers.  We've been successfully able to import data using a java script and the jar file hive-jdbc-1.2.1-standalone.jar (This is loaded on the mid-server).  This method would require us to setup a non-standard way of connecting to a JDBC data source.  

My hope is to leverage the data sources in ServiceNow to store the connection information and leverage the import tables to bring in the data.  

Below is the error we get using the data source method with the jar files loaded to the server.  

MID Server reported error: java.sql.SQLException: Method not supported
at org.apache.hive.jdbc.HiveStatement.setQueryTimeout(HiveStatement.java:739)
at com.service_now.monitor.jdbc.JDBCRowSet.query(JDBCRowSet.java:63)
at com.service_now.mid.probe.JDBCProbe.doSelect(JDBCProbe.java:313)
at com.service_now.mid.probe.JDBCProbe.doQuery(JDBCProbe.java:199)
at com.service_now.mid.probe.JDBCProbe.probe(JDBCProbe.java:124)
at com.service_now.mid.probe.AProbe.process(AProbe.java:96)
at com.service_now.mid.queue_worker.AWorker.runWorker(AWorker.java:125)
at com.service_now.mid.queue_worker.AWorkerThread.run(AWorkerThread.java:20)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Any thoughts on how the JDBCprobe interacts with the jar file?

Do I need to activate the plugin JDBCProbe?  Or what exactly does this plugin add?

1 ACCEPTED SOLUTION

bradwestvig
Giga Guru

As a followup I didn't need to activate the JDBCProbe to get this to work.  I had to upload a newer version of the jar file, and it resolve this issue.  The existing jar source code was executing a method the data source was invoking with a call to one of the methods.  For some reason the Java didn't know how to handle it.

View solution in original post

4 REPLIES 4

Alberto Consonn
ServiceNow Employee
ServiceNow Employee

Hi,

yes, you have to activate the plugin JDBCProbe (refer to JDBCProbe).

I would strongly suggest to read the below article, it will clarify everthing you need to know about it:

USING THE SERVICENOW JDBCPROBE

If I have answered your question, please mark my response as correct so that others with the same question in the future can find it quickly and that it gets removed from the Unanswered list.

Thank you

Cheers
Alberto

 

Any update on this?

If I have answered your question, please mark my response as correct so that others with the same question in the future can find it quickly and that it gets removed from the Unanswered list.

Thank you

Cheers
Alberto

bradwestvig
Giga Guru

As a followup I didn't need to activate the JDBCProbe to get this to work.  I had to upload a newer version of the jar file, and it resolve this issue.  The existing jar source code was executing a method the data source was invoking with a call to one of the methods.  For some reason the Java didn't know how to handle it.

Hi Bradwestvig, I'm running in the same situation and I'm new to setting up the data source.  Would you please help with a bit more details?

1.  I only need to install hive jdbc jar on the mid server, is this correct?

2.  After istalling hive jdbc jar on mid server, do you still using the following info in the Data Source form:

  • Type = JDBC
  • Format = Oracle
  • Oracle Port = 10000
  • Do you need to have the Connection URL?

 

Thank You,
Oanh