Data Engine Open Metadata Access Service (OMAS)¶

The Data Engine OMAS provides APIs and events for data movement/processing engines to record the changes made to the data landscape.

It provides the ability to register the data engine itself along with the lineage details of the ETL transformations. Data Engine OMAS APIs offer support for creating the corresponding open metadata types for assets and jobs.

Using te Data Engine Java Client¶

The Data Engine OMAS client interface supports the creation, update and delete of metadata entities and relationships. More details about using the client and the implementations available can be found here

Using the Data Engine OMAS REST API¶

Below is the list of endpoints supported by Data Engine OMAS. Typically, the first action to take for an external tool is to register as an engine.

External Tool registration¶

External Tool lookup¶

Create Schema Type¶

Create Port Implementation with schema type¶

Create Process, with corresponding Port Implementations and Schema Types¶

Add data flows to processes¶

Delete Schema Type¶

Delete Port Implementation¶

Delete Process¶

Create Database¶

Create Database Schema¶

Create Relational Tables¶

Create Data Files¶

Delete Database¶

Delete Database Schema¶

Delete Relational Tables¶

Delete Data Files¶

Delete Connections¶

Delete Endpoint¶

Create Topic¶

Create EventType¶

Delete Topic¶

Delete EventType¶

Find an entity¶

Sample use case¶

Initial load use case illustrates the integration between Data Engine OMAS and IBM's DataStage ETL tool.

Raise an issue or comment below