Moogsoft Docs

Apache Kafka

You can install the Apache Kafka integration to enable Moogsoft AIOps to collect event data from Kafka. After you have installed and configured the Kafka Integration, Kafka will push messages to the integration for the subscribed topics.

When you use the integrations UI, you can only configure the visible properties. If you want to implement a more complex Kafka LAM with custom settings, see Configure the Kafka LAM.

See the Kafka documentation for details on Kafka components.

Before You Begin

The Kafka integration has been validated with Kafka v0.9, 1.1, and 1.2. Before you start to set up your Kafka integration, ensure you have met the following requirements:

  • You have the host and ports for all the Kafka brokers you want to connect to.

  • The ports for your Kafka brokers are open and accessible from Moogsoft AIOps .

  • You know the name of the topics for the system to subscribe to.

  • You have the group ID of the consumer group.

Configure the Kafka Integration

To configure the Kafka integration:

  1. Navigate to the Integrations tab.

  2. Click Kafka in the Monitoring section.

  3. Follow the instructions to create an integration name and supply the connection information for Kafka.

See Configure the Kafka LAM for advanced configuration information.

Configure Kafka

You do not need to perform any integration-specific steps on your Kafka system. After you configure the integration, it polls Kafka at regular intervals to collect event data from the subscribed topics (every 60 seconds by default).