Area 6 Models - Discovery Surveys and Analysis¶
Area 6 provides structures for recording the results of automated discovery surveys of resources as annotations to associated assets in the metadata repository.
Discovery surveys require different types of analysis. This analysis may run just once, say when the asset is created, on demand or based on an event or schedule.
A particular type of analysis is implemented in a survey action service. Within the survey action service are one to many analysis steps. Each step performs some sort of analysis that may result in an annotation for one or more assets.
The annotations from a particular run of a survey action service are grouped together into a survey report. The annotations may be reviewed and approved by a steward. The steward may convert the annotation to a harden metadata type, or they may flag the annotation as invalid. When the survey action service is rerun, the new annotations can be matched to the annotations from the previous run. The steward's actions will impact how the new annotations are processed.
- 0603 Survey Report
- 0610 Annotation
- 0611 Annotation Reviews
- 0625 Data Class Discovery
- 0630 Semantic Discovery
- 0635 Classification Discovery
- 0640 Quality Scores
- 0650 Relationship Discovery
- 0660 Measurements
- 0690 Request for Action
Egeria's Survey Action Framework (SAF) supports the development and execution of survey action services. These services run in the Survey Action OMES hosted in an Engine Host. Survey action services use connectors from the Open Connector Framework (OCF) to connect to the data assets and access the known metadata about them.
A moment of transition¶
You may notice that some of the types in the UML models are coloured grey. These types are exclusively for the open discovery services which are now deprecated and replaced by the survey action services. The type descriptions remain in the models to help people migrate their open discovery services to the survey action framework.
The main differences are that the OpenDiscoveryAnalysisReport becomes the SurveyReport and the schema extraction process now uses SchemaElement entities rather than DataField entities.
- 0601 Open Discovery Engines and Services
- 0605 Discovery Analysis Report
- 0616 Data Field Discovery
- 0617 Data Field Analysis
Raise an issue or comment below