Integration of ServiceNow with Kafka - Spokes implementation

[Wasif]

For one of our requirement, we would like to explore the option of pushing ServiceNow data to a kafka topic, from where an existing implementation will pick up the data and send it across to the customer.

We briefly read about the 2 spokes:

ServiceNow Kafka Consumer
Confluent Kafka REST Proxy spoke

But not getting clarity on the usage.
Has someone been able to implement a solution using this?

We are primarily looking as to how we can push our data to kafka topic.

[Wasif]

Not yet, we are looking at some other options as well- like leveraging our middleware to push the data to kafka.
Using the spoke requires additional license it seems and we are not ready to take that license yet.

[Wasif · Accepted solution]

Just to update the thread,

We were doing some discovery on different solutions. We installed the spoke on our POC environment (Confluent Kafka REST Proxy spoke), but on going deeper into it we realised this spoke is basically to interact with the Rest Proxy enabled on the kafka provider, ie if the Kafka provider does not have a Rest Proxy- this spoke may not have a use case coz even to configure this spoke we need to give a connection URL.

We already had an existing Kafka cluster on AWS, but seems AWS does not expose a REST on top of the MSK product out of the box (we could install a confluent Rest proxy plugin here and an API gateway- but additional resources- additional cost)

Currently, only the Confluent Cloud hosted Kafka exposes the Rest Proxy that can be called via the Rest API- our POC from Postman was able to push records to Confluent Cloud managed Kafka- but we did not wanted to procure new Kafkas.

Ultimately we are going ahead with our middleware (Tibco) who will expose an API to us and in turn they will talk to Kafka via the Java libraries

[hemanthsnowdeve]

Hi 

i am trying to achieve the confluent kafka to servicenow pub message i added confluent rest proxy in flow and given details and in Confluent cloud we created topics but when i try to test im getting token error, i have read in docs that we need to use kafka producer step plugin to do publish message, can you help me , do we need that plugin to publish message , or can we acheive this in any way , i am trying this for last one month, pls let me knwo if you can hlep me 

[G Sai Vamshi]

Anyone in this post are able to achieve the implementation? Which spoke was used? How to consume those events.