Skip to content
Stable

This component is complete and can be used. The interfaces will be supported until the function is removed from the project via the deprecation process. There will be ongoing extensions to this function, but it will be done to ensure backward compatibility as far as possible. If there is a need to break backward compatibility, this will be discussed and reviewed in the community, with a documented timeline.

Data Engineer API

The Data Engineer API provides a persona-specific view for individuals responsible for designing, building, and maintaining data processing systems and pipelines. It enables the creation and maintenance of data pipelines, reference data, and tabular data sets. It is used in conjunction with the Asset Maker API.

Key Features

The Data Engineer API provides the following capabilities:

  • Data Pipelines: Support for defining and maintaining data pipelines, which are choreographed sequences of data processing steps that move and transform data.
  • Reference Data: Capabilities for managing reference data, such as controlled lists of values used for classification and data quality.
  • Tabular Data Sets: Tools for working with tabular data sets, including retrieving detailed reports that include data rows, column descriptions, and metadata.
  • Data Set Exploration: Retrieving details of tabular data sets anchored to assets, supporting data discovery and analysis.

Further information

Sample REST API requests can be found in:

Raise an issue or comment below