Leveraging your Apache Kafka estate¶
Work In Progress
This page is part of the new function for version 6.0 of Egeria. We aim to release this version in March 2026, so watch this space - new content is on its way :)
Apache Kafka Connectors¶
- The Kafka Open Metadata Topic Connector implements a resource connector for a topic that exchanges Java Objects as JSON payloads across an Apache Kafka event bus. It is configured in the Egeria OMAG Servers through the Event Bus Configuration. This the connector that is used by default in the Egeria runtimes to exchange events (notifications between the OMAG Servers).
- The Kafka Monitor Topic integration connector automatically maintains the open metadata instances for the topics hosted on an Apache Kafka server .
- The Kafka Audit Topic integration connector validates that topics that are active in an Apache Kafka server are also catalogued in open metadata. Creates an audit log record for each topic that is not catalogued.
- The Sample Lineage Integration Connector is a sample connector to listen for lineage events (not in an open lineage format) and catalog the associated assets, processes, schema and lineage. |
Raise an issue or comment below