Monitoring topics in the Hermes Kafka cluster
Monitor message processing and view topics in the Hermes Kafka cluster that belong to you using the Hermes Messaging Service topic inspector.
Tracking messages in partitions
You can track messages in the Hermes Kafka cluster by viewing partition information.
- Determine whether your messages are reaching the Hermes Kafka cluster by checking whether the end offset value changes when you produce messages to a topic.
- Determine whether messages have expired by noting the beginning offset value, which increases as messages expire. If you send messages to a topic but the beginning offset is higher than you expect, some of the messages have already expired. Messages expire in the Hermes Kafka cluster after 36 hours.
Tracking consumer progress
You can track the progress of processing messages for each consumer by viewing consumer information.
- View the consumers for each partition in a topic, including the group ID and consumer ID for each consumer.
- Determine which message a consumer is processing by viewing the Current Offset column.
- Determine whether the consumer is delayed by checking the Lag column. The lag is the difference between the current offset and the end offset that indicates how many messages remain.
Inspecting message details
You can detect problems with consuming messages using the topic inspector. For example, if a message that you produced isn't consumed from the Hermes Kafka cluster, you can validate the payload and message key by inspecting the topic. You can also download the full payload and save it as a file on your local machine.
You can view messages as binary data in base-64 encoding instead of UTF8 strings by adding a system property. See Hermes Messaging Service properties.