Skip to content
Stable

This component is complete and can be used. The interfaces will be supported until the function is removed from the project via the deprecation process. There will be ongoing extensions to this function, but it will be done to ensure backward compatibility as far as possible. If there is a need to break backward compatibility, this will be discussed and reviewed in the community, with a documented timeline.

Kafka Monitor Integration Connector

Connector details

The kafka monitor integration connector monitors an Apache Kafka server and creates a KafkaTopic asset for each topic that is known to the server. If the topic is removed from the Apache Kafka Server, its corresponding KafkaTopic asset is also removed.

Figure 1

Figure 1: Operation of the kafka monitor integration connector

Configuration

This connector uses the Topic Integrator OMIS running in the Integration Daemon.

This is its connection definition to use on the administration commands that configure the Topic Integrator OMIS.

Connection configuration

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
{
   "connection" : 
                { 
                    "class" : "Connection",
                    "qualifiedName" : "TopicMonitorConnection",
                    "connectorType" : 
                    {
                        "class" : "ConnectorType",
                        "connectorProviderClassName" : "org.odpi.openmetadata.adapters.connectors.integration.kafka.KafkaMonitorIntegrationProvider"
                    },
                    "endpoint" :
                    {
                        "class" : "Endpoint",
                        "address" : "{{serverURL}}"
                    }
                }
}
  • Replace {{serverURL]} with the network address of Kafka's bootstrap server (for example, localhost:9092).

Raise an issue or comment below