Skip to content

Data Profiling

Data Profiling

Initializing search

Home
Overview
Using
Learning
Community
Releases
Reference
Concepts
Practices

Egeria

Home
Overview
Overview
- The Challenge
- Our Solution
- Key Concepts
- Patterns
  Patterns
Using
Using
- Planning Guide
  Planning Guide
  - Planning Deployment
    Planning Deployment
    
    Planning Runtime
    
    User Interfaces
    User Interfaces
    
    Ecosystem UI
  - Preparing Metadata Ecosystem
    Preparing Metadata Ecosystem
    
    Metadata Valid Values
    
    Language Translations
    
    Onboarding Organization
    
    Governance Program
- Integration
  Integration
  - Integration Guide
  - Connector Catalog
    
    Connector Catalog
    
    Governance Actions
    Governance Actions
    
    Generic Element Watchdog
    
    Generic Folder Watchdog
    
    Move/Copy File Provisioning
    
    Origin Seeker Remediation
    
    Governance Daemon
    Governance Daemon
    
    Open Lineage Janus Connector
    
    Integration
    Integration
    
    File Connectors
    File Connectors
    
    Data Files Monitor
    
    Data Folder Monitor
    
    Topic Connectors
    Topic Connectors
    
    Kafka Topics Monitor Connector
    
    Kafka Topics Audit Connector
    
    API Connectors
    API Connectors
    
    Open API Monitor Connector
    
    Infrastructure Connectors
    Infrastructure Connectors
    
    Egeria Infrastructure Cataloguer Connector
    
    Lineage Connectors
    Lineage Connectors
    
    OpenLineage Event Receiver
    
    OpenLineage API Log Store
    
    OpenLineage File Log Store
    
    OpenLineage Cataloguer
    
    Governance Action OpenLineage Integrator
    
    Runtime
    Runtime
    
    Repository
    Repository
    
    Pluggable Repositories
    Pluggable Repositories
    
    XTDB
    
    XTDB
    
    Upgrading the XTDB Connector
    
    XTDB Connector Performance
    
    JanusGraph OMRS Repository Connector
    
    In-memory OMRS Repository Connector
    
    Read-only OMRS Repository Connector
    
    Repository Adapters
    Repository Adapters
    
    Apache Atlas OMRS Repository Connector
    
    IBM Information Governance Catalog (IGC) OMRS Repository Connector
    
    SAS Viya OMRS Repository Connector
    
    Audit Log Destination
    Audit Log Destination
    
    Console
    
    Event Topic
    
    Open Metadata Archive Store
    Open Metadata Archive Store
    
    JSON File
    
    Cohort Registry Store
    Cohort Registry Store
    
    JSON File
    
    Digital Resource
    Digital Resource
    
    Open Metadata Topic
    Open Metadata Topic
    
    Kafka Open Metadata Topic Connector
    
    In Memory Open Metadata Topic Connector
  - Developer Guide
    
    Developer Guide
    
    Building Archives
    Building Archives
    
    Content Packs
    
    Governance Engine Packs
    
    Open Metadata Types
    
    Building Utilities
    
    Building Connectors
    Building Connectors
    
    Integration Connectors
    
    Open Discovery Services
    
    Governance Action Services
    
    Repository Governance Services
    
    Repository Connectors
    
    Runtime Connectors
    Runtime Connectors
    
    Audit Log Destination
    
    Cohort Registry Store
    
    Configuration Document Store
    
    Open Metadata Archive Store
    
    Platform Metadata Security Connector
    
    Server Metadata Security Connector
    
    Open Metadata Topic
    
    Resource Connectors
    Resource Connectors
    
    New types of connectors
    
    Open Metadata Topic
    
    Javadoc
    
    Defining new open metadata types
- Administration
  Administration
  - Configure OMAG Server Platform
  - Configure OMAG Servers
    
    Configure OMAG Servers
    
    Metadata Access Point
    
    Metadata Access Store
    
    Repository Proxy
    
    Conformance Test Server
    
    View Server
    
    Integration Daemon
    
    Engine Host
    
    Data Engine Proxy
    
    Open Lineage Server
    
    Presentation Server
  - Migration
- Operations
  Operations
  - Operate OMAG Server Platform
  - Egeria in Kubernetes
    
    Egeria in Kubernetes
    
    Introduction to Kubernetes
    
    Installing Kubernetes
    
    Useful Kubernetes commands
    
    Introduction to Helm
    
    Charts
    Charts
    
    Egeria Chart overview
    
    Base Egeria Chart
    
    Coco Pharmaceuticals Lab
    
    CTS Chart
    
    PTS Chart
    
    Container Images
    
    Custom Deployment
    
    Egeria Operator
- Diagnostic Guide
  Diagnostic Guide
- User Interfaces
  User Interfaces
  - Egeria Ecosystem UI
    
    Egeria Ecosystem UI
    
    Type Explorer (TEX)
    
    Repository Explorer (REX)
    
    Dynamic Operations (Dino)
    
    Glossary author
    
    Server author
- Features
  Features
Learning
Learning
- Webinars
- Dojo (Jan 2022)
  Dojo (Jan 2022)
  - Running Egeria Day
    Running Egeria Day
    
    Introduction to 'Running Egeria' day
    
    Egeria introduction
    
    Setup of the environment
    
    Simple Install of Egeria
    
    User Interfaces
    User Interfaces
    
    Introduction to the Egeria UIs
    
    Ecosystem UI
    Ecosystem UI
    
    Using the Egeria Ecosystem UI
    
    Configuring and Operating a Server
    
    Coco Pharmaceuticals Lab
    
    Summary of 'Running Egeria' day
  - Developer Day
  - Metadata Governance Day
  - Egeria Contributor Day
  - Egeria in Production Day
- Open Metadata Labs
- Tutorials
  Tutorials
- Scenarios
  Scenarios
  - Data Manager Integration
  - File Lineage
- Old Dojo (deprecated)
  Old Dojo (deprecated)
  - Day 1
    Day 1
    
    Egeria Introduction
    
    Egeria Project Introduction
    
    Running Egeria
    Running Egeria
    
    Overview
    
    Platform Setup and Configuration
    Platform Setup and Configuration
    
    Overview
    
    Prerequisites
    
    Configuring the Platform
    
    Confiiguring a Server
    
    Running Metadata Access Servers
    Running Metadata Access Servers
    
    Overview
    
    Starting Server
    
    Calling Server API
    
    Working with Archives
    
    Second Server
    
    Running Metadata Ecosystems
    Running Metadata Ecosystems
    
    Overview
    
    Running User Interfaces
    
    Running Governance Servers
    
    Running Kubernetes and Labs
    
    Participating in the Community
  - Day 2
    Day 2
    
    Open Source Philosophy
    
    Tools for Contributors
    
    Contributing to Egeria
    
    Type of Contribution
    
    Becoming a Contributor
  - Day 3
    Day 3
    
    Becoming an Advocate
    
    Becoming a Maintainer
    
    Egeria Architecture
    
    Egeria Social
Community
Community
- Community Guide
- Integration Guide
- Contributing
  Contributing
  - Project Operations
  - Code
    Code
    
    Coding Guidelines
    
    Way of Working
    Way of Working
    
    Overview
    
    Working with Releases
    
    Working with Releases
    
    Egeria Core Release process
    
    Egeria EcoSystem (React UI) Release process
    
    Egeria Charts Release process
    
    Egeria Release Notes Release process
    
    XTDB Connector Release Process
    
    Specific Guidance
    Specific Guidance
    
    Programming Languages
    
    Tools
    Tools
    
    Development Tools
    
    Documentation Tools
    
    Runtime Tools
    
    Testing Tools
    
    Developing Connectors
    Developing Connectors
    
    Develop a Connector
    
    Develop Repository Connector
    
    Developing Access Services
  - Document
    Document
    
    Documentation Guide
    
    Formatting Standards
    
    Style Guide
    
    Markdown
Releases
Releases
- Overview
- Release Notes
  Release Notes
  - Latest Release
  - Next Release
  - v3.12
  - v3.11
  - v3.10
  - v3.9
  - v3.8
  - v3.7
  - v3.6
  - v3.5
  - v3.4
  - v3.3
  - v3.2
  - v3.1
  - v3.0
  - Older Releases
    Older Releases
    
    v2.x
    v2.x
    
    2.11
    
    2.1
    
    2.9
    
    2.8
    
    2.7
    
    2.6
    
    2.5
    
    2.4
    
    2.3
    
    2.2
    
    2.1
    
    2.0
    
    v1.x
    v1.x
    
    1.8
    
    1.7
    
    1.6
    
    1.5
    
    1.4
    
    1.3
    
    1.2
    
    1.1
    
    1.0
- Roadmap
- Content Status
Reference
Reference
- Open Metadata Types
  Open Metadata Types
- Standards
- Services
  Services
  - Fixed Services
    Fixed Services
    
    Administration Services
    
    Repository Services (OMRS)
    
    Repository Services (OMRS)
    
    Cohorts
    
    Metadata Repositories
    
    Cohort Events
    
    First Failure Data Capture (FFDC)
    
    Multi-tenant Services
    
    Generic Handlers
    
    Metadata Security Services
    
    Platform Operation Services
    
    Connected Asset Services
    
    Metadata Store Services
    
    Integration Daemon Services
    
    Engine Host Services
    
    Data Engine Proxy Services
    
    Open Lineage Services (OLS)
  - Registered Services
    Registered Services
    
    Access Services (OMAS)
    
    Access Services (OMAS)
    
    Analytics Modeling OMAS
    
    Asset Catalog OMAS
    
    Asset Consumer OMAS
    
    Asset Lineage OMAS
    
    Asset Manager OMAS
    
    Asset Owner OMAS
    
    Community Profile OMAS
    
    Data Engine OMAS
    
    Data Manager OMAS
    
    Data Privacy OMAS
    
    Data Science OMAS
    
    Design Model OMAS
    
    DevOps OMAS
    
    Digital Architecture OMAS
    
    Digital Service OMAS
    
    Discovery Engine OMAS
    
    Glossary View OMAS
    
    Governance Engine OMAS
    
    Governance Program OMAS
    
    IT Infrastructure OMAS
    
    Project Management OMAS
    
    Security Manager OMAS
    
    Security Officer OMAS
    
    Software Developer OMAS
    
    Stewardship Action OMAS
    
    Subject Area OMAS
    
    Engine Services (OMES)
    
    Engine Services (OMES)
    
    Asset Analysis
    
    Governance Action
    
    Repository Governance
    
    Integration Services (OMIS)
    
    Integration Services (OMIS)
    
    Analytics Integrator
    
    API Integrator
    
    Catalog Integrator
    
    Database Integrator
    
    Display Integrator
    
    Files Integrator
    
    Infrastructure Integrator
    
    Organization Integrator
    
    Security Integrator
    
    Stewardship Integrator
    
    Topic Integrator
    
    View Services (OMVS)
    
    View Services (OMVS)
    
    Dino View
    
    Rex View
    
    Tex View
    
    Server Author View
    
    Glossary Author View
- Frameworks
  Frameworks
- Conformance Test Suite
  Conformance Test Suite
  - CTS Overview
  - Platform Profiles
    Platform Profiles
    
    Platform Origin
  - Repository Profiles
    Repository Profiles
    
    Metadata Sharing
    
    Reference Copies
    
    Metadata Maintenance
    
    Effectivity Dating
    
    Dynamic Types
    
    Graph Queries
    
    Historical Search
    
    Entity Proxies
    
    Soft-delete and Restore
    
    Undo an Update
    
    Reidentify Instance
    
    Retype Instance
    
    Rehome Instance
    
    Entity Search
    
    Relationship Search
    
    Entity Advanced Search
    
    Relationship Advanced Search
  - Performance Profiles
    Performance Profiles
    
    Entity Creation
    
    Entity Search
    
    Relationship Creation
    
    Relationship Search
    
    Entity Classification
    
    Classification Search
    
    Entity Update
    
    Relationship Update
    
    Classification Update
    
    Entity Undo
    
    Relationship Undo
    
    Entity Retrieval
    
    Entity History Retrieval
    
    Relationship Retrieval
    
    Relationship History Retrieval
    
    Entity History Search
    
    Relationship History Search
    
    Graph Queries (Performance)
    
    Graph History Queries
    
    Entity Re-home
    
    Relationship Re-home
    
    Entity Declassify
    
    Entity Re-type
    
    Relationship Re-type
    
    Entity Re-identify
    
    Relationship Re-identify
    
    Relationship Delete
    
    Entity Delete
    
    Entity Restore
    
    Relationship Restore
    
    Relationship Purge
    
    Entity Purge
    
    Environment
Concepts
Concepts
Practices
Practices
- Governance Basics
- Governance Maturity Model
- Governance Roles
- Digital Services
- Common Data Definitions
  Common Data Definitions
- Coco Pharmaceuticals
  Coco Pharmaceuticals
  - Personas
    Personas
    
    Overview
    
    Angela Cummings
    
    Bob Nitter
    
    Callie Quartile
    
    Des Signa
    
    Erin Overview
    
    Faith Broker
    
    Florence Paynter
    
    Gary Geeke
    
    George Pie
    
    Grant Able
    
    harry Hopeful
    
    Ivor Padlock
    
    Jules Keeper
    
    Julie Stitched
    
    Lemmie Stage
    
    Nancy Noah
    
    Peter Profile
    
    Polly Tasker
    
    Reggie Mint
    
    Robbie Records
    
    Sally Counter
    
    Signey Seeker
    
    Stew Faster
    
    Tanya Tidie
    
    Tessa Tube
    
    Tom Tally
  - Roles vs Personas
  - Scenarios
    Scenarios
    
    Introduction
    
    Authoritative Sources
    
    Cataloguing Infrastructure
    
    Coommon Data Definitions
    
    Continuous Analytics
    
    Data Enabled Employees
    
    Data Strategy
    
    Glossaries
    
    Governance Program
    
    Governance Team
    
    Information Supply Chains
    
    Multi-Faceted Governance
    
    New Systems Archiecture
    
    New Digital Service
    
    Receiving Patient Data
    
    Subject Areas
    
    Sustainability
    
    Suspicious Activity

0620 Data Profiling¶

Profiling analysis looks at the data values in the resource and summarizes their characteristics.

UML

Previous Data Field Analysis

Next Data Class Discovery

License: CC BY 4.0, © 2018-2022 contributors to the Egeria project.

Made with Material for MkDocs