Is there a way to read messages and push messages to an Apache kafka instance via midserver

[GeoThomas]

I have a ServiceNow instance and an Apache Kafka instance. I am able to test my connectivity to the Kafka host via midserver. Is there any way I can post messages to a topic in my Kafka instance and read messages from my Kafka instance via midserver without using the Hermes kafka.

I was looking into Kafka stream option, but dint quite undertsand that.

[KevinBellardine]

Kafka Stream is going to be your best bet, though there's also the Confluent Kafka Rest Proxy Spoke. Both of these are going require some configuration, and an understanding of Flow Designer and ETLs (Robust Transform Maps).

Here's a link to the Rest Proxy Spoke docs https://docs.servicenow.com/bundle/washingtondc-integrate-applications/page/administer/integrationhu...

If you have any specific questions I can try to answer them, but honestly this integration is a big topic.

[GeoThomas]

@KevinBellardine Thank you for the response, I am looking for an option where I should be able to use midserver to connect to my kafka instance. Does kafka Steam support that. Also do you have any example documentation regarding Kafka Stream connection via midserver

[KevinBellardine]

I've never seen a direct cloud--cloud connection with Kafka, every configuration I've seen uses the mid-server as a go between. At least for the Rest Proxy Spoke you select a mid-server on the Kafka Consumer table the app creates, where you configure your connections to different kafka environments and/or topics

Here's a link to stream connect https://docs.servicenow.com/bundle/washingtondc-integrate-applications/page/administer/integrationhu...

[GeoThomas]

@KevinBellardine , I was trying to follow: https://www.youtube.com/watch?v=hy-cf7_3GEk

I do not see the Topics option under Stream Connect in my service now instance:

Is there any place where I can find some step by step instruction for using stream connect other than the service now documentation?