Using the Stream Connect Dashboard

  • Release version: Zurich
  • Updated July 31, 2025
  • 11 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Using the Stream Connect Dashboard

    The Stream Connect Dashboard in ServiceNow® offers a consolidated environment to manage and monitor your Stream Connect integrations. It enables you to oversee producers, consumers, topics, and replicators, while providing detailed insights into data usage and stream activity across your integrations. This dashboard is accessible via the Integration Hub and requires both Workflow Data Fabric and Stream Connect subscriptions.

    Show full answer Show less

    Key Features

    • Centralized Management: Handle multiple Stream Connect integrations from a single application.
    • Insightful Analytics: View detailed statistics including data consumed and produced, message counts, and data usage trends over customizable time ranges.
    • Topic Management: Add, edit, export, and view detailed information about Kafka topics, including consumer and producer activity, replication status, and data consumption metrics.
    • Consumer and Producer Controls: Manage consumers and producers with the ability to create new entities, view detailed statistics, monitor message rates, and track performance metrics such as consumer lag and undelivered messages.
    • Replication Oversight: Monitor and manage both message and topic replications, including status, error messages, and activity tracking.
    • Alert Monitoring: Track active alerts with severity levels, types, and affected entities; configure alert properties and view detailed alert logs for troubleshooting.

    Using the Dashboard Components

    • Overview Section: Provides two tabs—Stream Activity (shows active entities, alerts, and data flow charts) and Data Usage (displays monthly usage and per-topic consumption over the past 13 months).
    • Topics: Lists all topics with details and allows creation or editing. Includes detailed data insights such as messages consumed/produced and consumer lag with flexible time filters.
    • Consumers: Displays consumers by type (e.g., ETL, Flow Trigger, Script) with detailed statistics, logs, and partition group information. Supports creating new consumers, including integration with Workflow Studio for Flow Trigger consumers.
    • Producers: Lists all producers and provides detailed insights including message rates, bytes produced, and undelivered messages. The Manage button facilitates quick access to the originating entity or workflow.
    • Message and Topic Replications: Manage replications with lists showing status, errors, and activity. Supports editing, exporting, and creating new replications.
    • Alerts: View and manage active alerts, configure alert settings, and access detailed alert information and logs to maintain operational health.

    Practical Benefits for ServiceNow Customers

    By leveraging the Stream Connect Dashboard, customers can efficiently manage their data integration streams, gain real-time visibility into message flows and data consumption, and quickly identify and resolve issues through alert monitoring. The dashboard’s comprehensive views and management tools simplify integration oversight, enhance operational control, and support data-driven decision-making within your ServiceNow environment.

    View detailed statistics for your Stream Connect integrations. Manage producers and consumers, view data usage, and create or edit topics and replicators with the ServiceNow® Stream Connect dashboard.

    The Stream Connect Dashboard combines several capabilities into a single environment, so you can:
    • Manage multiple Stream Connect integrations through a single application.
    • Gain insights into how your integrations use and process data with detailed charts, lists, and statistics.
    • View total data usage, data usage per month, and data usage per topic, for the last 13 months.
    • Edit topics, producers, consumers, and replicators through a simplified interface.

    Request apps on the Store

    Visit the ServiceNow Store website to view all the available apps and for information about submitting requests to the store. For cumulative release notes information for all released apps, see the ServiceNow Store version history release notes.

    Workflow Data Fabric subscription

    This application requires a Workflow Data Fabric subscription and a Stream Connect subscription. For more information, see https://www.servicenow.com/now-platform/workflow-data-fabric.html.

    Stream Connect Dashboard organization

    To view the dashboard, navigate to All > Integration Hub > Stream Connect > Stream Connect Home.

    The dashboard has the following components.
    • Overview section, with data usage tab.
    • Topics
    • Consumers
    • Producers
    • Message Replications
    • Topic Replications
    • Alerts
    The following sections explain each component in greater detail.

    Overview section

    View detailed information about your Stream Connect integrations.

    The Overview section has two tabs: Stream activity and Data usage.
    • The Stream activity tab shows the activity on topics, consumers, producers, replicators, and alerts.
    • The Data usage tab shows Stream Connect usage over time.
    Figure 1. Stream Connect Dashboard Overview, Stream activity
    User interface for the Stream activity tab of the Stream Connect dashboard overview page.
    The Stream activity tab has these components.
    1. Active entities and alerts
    The Active entities section displays the number of topics, consumers, producers, and topic replicators created. The Active alerts section shows the total number of active alerts with each alert's number, type, affected entity, and date updated.
    2. Streamed data overview
    Displays the following charts.
    • Consumed data: The total amount of data consumed (in GB).
    • Messages processed: The total number of processed messages.
    • Produced data: The total number of data produced (in GB).
    • Messages produced: The total number of messages produced.
    • Consumers data usage trends: The amount of data (in MB) consumers used over the last seven days.
    • Producers data usage trends: The amount of data (in MB) producers used over the last seven days.

    You can view data for a single, selected topic, or for All Topics combined. You can also organize the data by time, viewing data for the Last 24 hours, Last 2 days, Last 7 days, or by setting a Custom range.

    Figure 2. Stream Connect Dashboard Overview, Data usage
    User interface for the Data usage tab of the Stream Connect dashboard overview page.
    The Data usage tab has these components.
    3. Month selector
    Select a start month and end month to view data usage over time. Data usage history is available for the last 12 complete months plus the current month.
    4. Data usage details
    Displays the following charts.
    • Total data usage in MB: The total data usage for the selected months.
    • Topics utilized: The total number of topics with data usage for the selected months.
    • Data usage: The data usage per month for the selected months.
    • Data usage by topic: The data usage per topic for the selected months.

    Topics

    View topics and add, edit, or export a topic.

    Figure 3. Stream Connect Dashboard Topics page
    User interface for the Stream Connect dashboard Topics page.
    The Topics page has the following components.
    5. Topics list
    Displays all topics and each topic's name, namespace, and the date it was created.
    6. Action buttons
    Contains several buttons that you can use to perform different tasks. Refresh the list of topics, edit the list columns or reset the column widths, and view or edit the list filters. There are also buttons to Edit a topic, Export a topic, and create a New topic.
    • To edit a topic, select the topic from the list, select the Edit button, then fill in the fields on the Edit Kafka Topic form.
    • To create a new topic, select New, then fill in the fields on the Create New Kafka Topic form.

    You can select a topic from the list to view detailed information for that topic.

    Figure 4. Individual topic page
    User interface for an individual topic page on the Stream Connect dashboard.
    Each individual topic page also has the following components.
    7. Topic information section
    Displays details about the topic, including its name, namespace, status, number of partitions, date created, domain, and app ID. There’s also an Edit button so you can edit the topic directly from this page.
    8. Consumers tab in the Data Insights section
    Displays the following charts.
    • Messages consumed (per minute): The total number of messages consumed by consumers in the selected topic.
    • Bytes consumed (per minute): The total number of bytes consumed.
    • Consumer lag (per minute): The consumer lag in this topic group, by consumer.
    All three charts can be filtered to display data for the Last 5 minutes, Last hour, or Last 24 hours. When the Last 24 hours is selected, the data is displayed in five minutes increments instead of every minute.

    The Consumers tab also has a Consumer list, which lists the consumers associated with the topic. Each consumer is listed with its number, state, error status, max concurrency, and consumer table. You can select the consumer number to view additional details for that consumer.

    9. Producers tab in the Data Insights section
    The Producers tab displays the following charts.
    • Messages Produced: The total number of messages produced. Updated hourly.
    • Bytes Produced in (bytes): The total number of bytes produced. Updated hourly.
    Both charts can be filtered to display data for the Last 2 days, Last 7 days, Today, Yesterday, or a Custom range.

    The Producers tab also has a Producer list, which lists the producers associated with the topic, and each producer's name, type, Id, table, and domain. You can select a producer to view additional details.

    10. Replications tab in the Data Insights section
    Displays the topic replications associated with the topic, and each replication's name, topic name, direction, status, whether it's active, and error message. You can select the replication name to view additional details for that topic replication.

    Consumers

    View and manage consumers.

    Figure 5. Stream Connect Dashboard Consumers page
    User interface for the Stream Connect dashboard Consumers page.
    The Consumers page has the following components.
    11. Consumer list
    Displays all consumers, organized by type. The possible types are:
    • ETL
    • Flow Trigger
    • Script
    • Transform Map
    Each consumer is listed with its name, number, state, associated topic, date updated, and who updated it.
    12. Create button
    To Create a new consumer, select this button, then select the type of consumer you want to create, then fill in the fields on the consumer's form. For form field descriptions, see the ETL consumer, Transform Map consumer, or Script consumer page.
    Note:
    If you're creating a Flow Trigger consumer, there isn't a form to fill out. Instead, the dashboard opens Workflow Studio so you can build your flow trigger there. For a detailed guide, see Create a flow with a Kafka Message trigger.

    You can select a consumer from the list to view detailed information for that consumer.

    Figure 6. Individual Consumer page
    User interface for an individual consumer page on the Stream Connect dashboard.
    Each individual consumer page has the following components.
    13. Consumer information section
    Displays details about the consumer, including its number, status, associated topic, Kafka auto position policy, max concurrency, partition group timeout, max batch size, partitions, and an error flag.
    14. Overview
    Displays the consumer's input and consumption rate, messages processed, queue depth, and any unprocessed messages. It also displays the following charts.
    • Messages processed (per minute): The total number of processed messages.
    • Message input to topic (per minute): The total number of messages input to the topic.
    • Consumer lag (per minute): The lag for the selected consumer.
    All three charts can be filtered to display data for the Last 5 minutes, Last hour, or Last 24 hours. When the Last 24 hours is selected, the data is displayed for every five minutes instead of every minute.
    15. Statistics tab
    Displays consumer statistics, including the date it was created, consumed bytes, consumed messages, produced messages, lag messages, end offset, interval, offset, and partition group.
    16. Logs tab
    Displays the created logs and each log's level, message, and source.
    17. Partition Groups tab
    Displays partition groups with each one's number, first and last partition, poll time, number produced per sec, queue depth, and input rate.
    For a detailed explanation of consumer data and statistics, including log, and partition group information, see Viewing Kafka subscriptions and statistics.

    Producers

    View, filter, and export producers.

    Figure 7. Stream Connect Dashboard Producers page
    User interface for the Stream Connect dashboard Producers page.
    The Producers page has the following components.
    18. Producer list
    Displays all producers and each producer's name, table, type, domain, and destination topic count.
    19. Action buttons
    Contains several buttons that you can use to refresh the list of producers, view or edit list filters, and Export a producer.

    You can select a producer from the list to view detailed information for that producer.

    Figure 8. Individual Producer page
    User interface for an individual producer page on the Stream Connect dashboard.
    Each individual consumer page has the following components.
    20. Producer information section
    Displays details about the producer, including its type, ID, table, and domain. There’s also a Manage button. The Manage button redirects to the corresponding entity that produced the messages. For example, entering Manage on a business rule producer opens the sys_script record. Entering Manage on a flow action opens that action in Workflow Studio. For background scripts, the Manage button is inactive because the script that was executed isn’t saved on the system anywhere.
    21. Insights
    Displays the following data.
    • Topics writing to: The total number of topics the producer is writing to.
    • Messages produced rate: The average number of messages produced per second.
    • Bytes produced rate: The average number of bytes produced per second.
    • Undelivered messages: The total number of undelivered messages for the producer.
    • Messages produced: Shows the number of messages produced over the last seven days.
    • Bytes Produced: Shows the number of bytes produced over the last seven days.
    This data is updated every hour. The Messages produced and Bytes produced charts can be filtered to display data for the Last 2 days, Last 24 hours, Last 7 days, or a Custom range.
    22. Statistics
    Displays producer statistics, including the date, number of produced messages and bytes, topic, and domain.
    For a detailed description of Producer data and statistics, see Viewing producer statistics.

    Message Replications

    View message replications, and add, edit, or export a message replication.

    Figure 9. Stream Connect Dashboard Message Replications page
    User interface for the Stream Connect dashboard Message Replications page.
    The Message Replications page has the following components.
    23. Message Replications list
    Displays all message replications and each replication's name, messaging service connection, status, error message (if any), and whether it's active.
    24. Action buttons
    Contains several buttons that you can use to perform different tasks. Refresh the list of message replications, edit the list columns or reset the column widths, and view or edit the list filters. There are also buttons to Edit a message replication, Export a message replication, and create a New message replication.
    • To edit a message replication, select the replication from the list, select the Edit button, then fill in the fields on the Edit Message Replication form.
    • To create a new message replication, select New, then fill in the fields on the Create New Message Replication form.

    You can select a message replication to view the replication's name, messaging service connection, status, error message (if any), and if it's active. You can also see any associated Kafka Topic Replications.

    Topic Replications

    View topic replications, and add, edit, or export a topic replication.

    Figure 10. Stream Connect Dashboard Topic Replications page
    User interface for the Stream Connect dashboard Topic Replications page.
    The Topic Replications page has the following components.
    25. Topic Replications list
    Displays all topic replications, and each replication's name, direction, replication, topic name, ServiceNow topic, status, error message (if any), whether it's active, and whether it's being tracked in the current update set.
    26. Action buttons
    Contains several buttons that you can use to refresh the list of topic replications, edit the list columns or reset the column widths, and view or edit the list filters. There are also buttons to Edit a topic replication, Export a topic replication, and create a New topic replication.
    • To edit a topic replication, select the replication from the list, select the Edit button, then fill in the fields on the Edit Topic Replication form.
    • To create a new topic replication, select New, then fill in the fields on the Create New Topic Replication form.

    You can select a topic replication to view its name, direction, replication, topic name, ServiceNow topic, status, error message (if any), if it's active, and if it's being tracked in the current update set. You can also see any associated Message Replication statistics.

    Alerts

    View active alerts and each alert's severity level, state, type, and affected entity.

    Figure 11. Stream Connect Dashboard Alerts page
    User interface for the Stream Connect dashboard Alerts page.
    The Alerts page has the following components.
    27. Active alerts section
    Displays the total number of active alerts and the active alerts in each severity level.
    28. Alert settings
    Opens the Alerting Properties page where you can specify alert properties and how alerts are managed.
    29. Alerts list

    Lists all alerts. By default, the Active filter is set to true. You can modify the Active filter to view inactive alerts. Each listing shows the alert's number, severity, active status, alert type, affected entity, and date updated.

    You can select an alert from the list to view detailed information for that alert.

    Figure 12. Individual Alert page
    User interface for an individual alert page on the Stream Connect dashboard.

    Each individual alert page has the following components.

    30. Alert information
    Shows alert details, including the alert ID, target ID, target table, domain, severity, and state.
    31. Alert logs
    Displays the alert's log information. Each entry shows when the log was created, its level, and the log message.