- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-05-2022 11:12 PM
For one of our requirement, we would like to explore the option of pushing ServiceNow data to a kafka topic, from where an existing implementation will pick up the data and send it across to the customer.
We briefly read about the 2 spokes:
ServiceNow Kafka Consumer
Confluent Kafka REST Proxy spoke
But not getting clarity on the usage.
Has someone been able to implement a solution using this?
We are primarily looking as to how we can push our data to kafka topic.
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-02-2022 08:32 PM
Just to update the thread,
We were doing some discovery on different solutions. We installed the spoke on our POC environment (Confluent Kafka REST Proxy spoke), but on going deeper into it we realised this spoke is basically to interact with the Rest Proxy enabled on the kafka provider, ie if the Kafka provider does not have a Rest Proxy- this spoke may not have a use case coz even to configure this spoke we need to give a connection URL.
We already had an existing Kafka cluster on AWS, but seems AWS does not expose a REST on top of the MSK product out of the box (we could install a confluent Rest proxy plugin here and an API gateway- but additional resources- additional cost)
Currently, only the Confluent Cloud hosted Kafka exposes the Rest Proxy that can be called via the Rest API- our POC from Postman was able to push records to Confluent Cloud managed Kafka- but we did not wanted to procure new Kafkas.
Ultimately we are going ahead with our middleware (Tibco) who will expose an API to us and in turn they will talk to Kafka via the Java libraries
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-06-2022 12:16 AM
Hi @Wasif ,
I understand your worry here, even i faced this challenge. With my experience to make ServiceNow Kafka Consumer work you will need to fulfill certain spoke dependencies, you must have these spokes before your could actually use ServiceNow Kafka Consumer :
Confluent Kafka REST Proxy spoke
ServiceNow IntegrationHub Runtime (com.glide.hub.integration.runtime)
ServiceNow IntegrationHub Action Step - RTE (com.glide.hub.action_step.rte)
Note: Some of these plugins are licensable features and require appropriate licenses, if used outside the spoke implementation.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-08-2022 08:04 PM - edited 10-08-2022 08:05 PM
Thanks @Community Alums for the response.
Could you help with detailed steps if you've already done the direct SN to Kafka implementation with the kafka spoke?
That would help a lot like sample code/ flow/ etc
Also wanted to know where were your Kafka clusters installed- AWS/ on prem etc
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-08-2022 10:34 PM
HI @Wasif ,
Nobody can give you step-by-step implementation solution here. We can give you the guidelines and best practices and then it's on you to work on the development . if you find any challenges or errors post in the community.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-11-2022 07:59 PM
were you able to work this out? even I have same scenario and trying to use the Confluent Kafka REST Proxy spoke
