Kafka Endpoints

This integration is only compatible with Workflow Engine v1.2 and above. See Update the Workflow Engine for instructions.

You can use the Kafka Endpoints integration to configure multiple Kafka endpoints (known as brokers) for use with the Workflow Engine. After you set up an endpoint, you can use the exportViaKafka function to send it data.

Before You Begin

Before you start to set up your integration, ensure you know the following values for your endpoint:

  • Name: a unique name for the endpoint for use in Workflow Engine configuration

  • Servers: the list of brokers to connect to. A server configuration consists of the server name and port, which defaults to `9092`

  • Compression: the compression algorithm to use

  • SSL Configuration: if you are using SSL to connect to Kafka

  • SASL Configuration: if you are using SASL to connect to Kafka

See Kafka Endpoints Reference for more information.

Configure the Kafka Endpoints Integration

To configure the Kafka Endpoints integration:

Navigate to the Integrations tab.

  1. Navigate to the Integrations tab.

  2. Click Kafka Endpoints in the Reporting and Dashboards section.

  3. Provide a unique integration name. You can use the default name or customize the name according to your needs.

  4. Enter the connection details for each endpoint you want to configure.

Use an Endpoint in a Workflow

After you complete the configuration, you can refer to the endpoint by name in your workflows. See exportViaKafka for more information.