Stream connect for Kafka- how to setup customer Kafka instance

[Wasif]

Read through about the Stream connect for Kafka that has been introduced in Utah and understood that as opposed to being tied with Confluent Cloud's Rest proxy for Kafka (and accessing the Kafka via Rest) as ServiceNow earlier was in a way a non-native application and connecting to Kafka via Rest was the only option...
and with the new architecture Kafka can be accessed via the Kafka native protocols and is not tied to Rest being used which is an approach for non-native Kafka clients.

We had a kafka requirement in the past, but could not go through coz a) the customer Kafka was not on Confluent cloud with direct Rest proxy enabled b) On AWS or Azure (where their Kafka was present) some additional things needed to be done for the Confluent platform installation for the Rest proxy to be enabled and the cloud team did not see much ROI for development for for just 1 use case for ServiceNow, as other projects/ apps were accessing their Kafka via native methods...

Well coming back to Stream connect,
Based on the architecture, I could not understand how to plug our Kafka environment to ServiceNow.
Some of our non-ServiceNow projects are using Kafka on Azure and some via AWS and we would also like to leverage it and integrate with other apps via Kafka, but not able to understand how to start...has anyone started with this or any POC underway?

Any direction or resource would be helpful.

Attaching screenshot of the new architecture took from the Utah release Creator Toolbox

[Danny Craigie]

I delivered a Kafka / Stream Connect POC for Accenture my previous company.
A good starting point is the Stream Connect Quick Start guide. 

https://docs.servicenow.com/bundle/xanadu-integrate-applications/page/administer/integrationhub/conc...

[G Sai Vamshi]

Hi @Wasif @amila @Danny Craigie 

any update on this Stream Connect POC? Are you able to install stream connect on PDI Instance?

[Wasif]

Hi @G Sai Vamshi,
We actually went a different direction ultimately and sufficed our Kafka needs using Boomi Integration platform, whose licence we were already having and integrated our ServiceNow instance with Boomi to fulfill the Kafka piece for our delivered requirement

[Danny Craigie]

Hi,
No experience of installing Stream Connect on PDI sorry. Although I expect you would need to request via support.
For POC we had Stream Connect installed on company dev and demo instances (event consumers with subscriptions). While I set up my laptop as the kafka producer and could simulate producing JSON payloads and topics via the CLI, and the subsequent consumer instance table updates.  

[G Sai Vamshi]

Hi Danny, Thanks for your response.

Could you please share me any links if you have anything related to setup and production of kafka events.