Skip to content
Stable

This component is complete and can be used. The interfaces will be supported until the function is removed from the project via the deprecation process. There will be ongoing extensions to this function, but it will be done to ensure backward compatibility as far as possible. If there is a need to break backward compatibility, this will be discussed and reviewed in the community, with a documented timeline.

Topic Integrator Open Metadata Integration Service (OMIS)

The Topic Integrator OMIS supports the exchange of topic-based assets and the open metadata ecosystem. Typically, these topics are managed by an event broker such as Apache Kafka.

It supports a type of integration connector that are able to create Topic assets along with descriptions of the structures of events that pass through the topic. Optionally, this metadata can be tied to an EventBroker.

Figure 1 shows the types of metadata that integrators connectors can create with this integration service.

Figure 1

Figure 1: Topic metadata supported by the Topic Integrator OMIS

The structure of an event is called an EventType. The details of this structure such as the data fields in the event are described using SchemaAttributes and SchemaTypes.

Figure 2 shows the open metadata types used to represent the metadata created through this service.

Figure 2

Figure 2: Topic open metadata types supported by the Topic Integrator OMIS

If an EventBroker is defined, any topic created is automatically linked to it using the ServerAssetUse relationship. When an event type is created for the topic, the service automatically inserts the AssetSchemaType relationship, EventTypeList entity and SchemaTypeOption relationship in between the topic and the event type.

Any schema attributes created through this interface will use the EventSchemaAttribute subtype to allow for find requests that only return schema information for events. The schema attributes also use the TypeEmbeddedAttribute classification method for defining the schema type.

This integration service is paired with the Data Manager Open Metadata Access Service (OMAS).

Raise an issue or comment below