Skip to content

Area 6 Models - Discovery Surveys and Analysis

Area 6 provides structures for recording the results of automated metadata surveys as annotations to associated assets in the metadata repository.

Metadata surveys require different types of analysis. This analysis may run just once, say when the asset is created, on demand or based on an event or schedule.

A particular type of analysis is implemented in a survey action service. Within the survey action service are one to many analysis steps. Each step performs some sort of analysis that may result in an annotation for one or more assets.

The annotations from a particular run of a survey action service are grouped together into a survey report. The annotations may be reviewed and approved by a steward. The steward may convert the annotation to a harden metadata type, or they may flag the annotation as invalid. When the survey action service is rerun, the new annotations can be matched to the annotations from the previous run. The steward's actions will impact how the new annotations are processed.

UML Packages

Egeria's Survey Action Framework (SAF) supports the development and execution of survey action services. These services run in the Survey Action OMES hosted in an Engine Host. Survey action services use connectors from the Open Connector Framework (OCF) to connect to the data assets and access the known metadata about them.

A moment of transition

You may notice that some of the types in the UML models are coloured grey. These types are exclusively for the open discovery services which are now deprecated and replaced by the survey action services. The type descriptions remain in the models to help people migrate their open discovery services to the survey action framework.

The main differences are that the OpenDiscoveryAnalysisReport becomes the SurveyReport and the schema extraction process now uses SchemaElement entities rather than DataField entities.


Raise an issue or comment below