Kafka Endpoints
This integration is available as a feature of the Workflow Engine v1.2 download or later.
You can use the Kafka Endpoints integration to configure multiple Kafka endpoints (known as brokers) for use with the Workflow Engine. After you set up an endpoint, you can use the exportViaKafka function to send it data.
Before You Begin
Before you start to set up your integration, ensure you know the following values for your endpoint:
Name: a unique name for the endpoint for use in Workflow Engine configuration
Servers: the list of brokers to connect to. A server configuration consists of the server name and port, which defaults to `9092`
Compression: the compression algorithm to use
SSL Configuration: if you are using SSL to connect to Kafka
SASL Configuration: if you are using SASL to connect to Kafka
See Kafka Endpoints Reference for more information.
Configure the Kafka Endpoints Integration
To configure the Kafka Endpoints integration:
Navigate to the Integrations tab.
Navigate to the Integrations tab.
Click Kafka Endpoints in the Reporting and Dashboards section.
Provide a unique integration name. You can use the default name or customize the name according to your needs.
Enter the connection details for each endpoint you want to configure.
Use an Endpoint in a Workflow
After you complete the configuration, you can refer to the endpoint by name in your workflows. See exportViaKafka for more information.