Apache Kafka
You can install the Apache Kafka integration to enable Moogsoft Enterprise to collect event data from Kafka. After you have installed and configured the Kafka Integration, Kafka will push messages to the integration for the subscribed topics.
When you use the integrations UI, you can only configure the visible properties. If you want to implement a more complex Kafka LAM with custom settings, see Configure the Kafka LAM.
See the Kafka documentation for details on Kafka components.
Before you begin
The Kafka integration has been validated with Kafka v0.9, 1.1, and 1.2. Before you start to set up your Kafka integration, ensure you have met the following requirements:
You have the host and ports for all the Kafka brokers you want to connect to.
The ports for your Kafka brokers are open and accessible from Moogsoft Enterprise .
You know the name of the topics for the system to subscribe to.
You have the group ID of the consumer group.
Configure the Kafka integration
To configure the Kafka integration:
Navigate to the Integrations tab.
Click Kafka in the Monitoring section.
Follow the instructions to create an integration name and supply the connection information for Kafka.
See Configure the Kafka LAM for advanced configuration information.
Configure Kafka
You do not need to perform any integration-specific steps on your Kafka system. After you configure the integration, it polls Kafka at regular intervals to collect event data from the subscribed topics (every 60 seconds by default).