How to configure Apache Kafka as a destination in Mage to publish JSON records to a Kafka topic using optional message keys.
bootstrap_server
.
If a Key Property
is defined in the Source Schema, Mage will use the corresponding field value as the Kafka message key—enabling partitioned message routing and supporting downstream systems that rely on message keys.
This is ideal for:
Key | Description | Default | Required |
---|---|---|---|
bootstrap_server | Comma-separated list of Kafka brokers with ports (e.g., kafka:9093 , broker1:9092,broker2:9092 ). | None | ✅ |
topic | Kafka topic to publish messages to. | None | ✅ |
api_version | (Optional) Kafka API version to use. If unspecified, Mage will auto-detect the server version. | None | ❌ |
Key Property
in your source schema.api_version
to match your Kafka broker version if needed.