Run the Exasol Connector Externally

Use YAML to ingest metadata from Exasol databases including tables, indexes, and analytical structures.

In this section, we provide guides and references to use the Exasol connector. Configure and schedule Exasol metadata and profiler workflows from the OpenMetadata UI:

• Requirements
• Metadata Ingestion
• Lineage

Requirements

Python Requirements

We have support for Python versions 3.9-3.11

To run the Exasol ingestion, you will need to install:

pip3 install "openmetadata-ingestion[Exasol]"

Database Privilege Requirements

To ingest basic metadata, an Exasol user must have the following privileges:

• USAGE privilege on Schema
• SELECT privilege on Tables

To use the lineage workflow, OpenMetadata fetches query logs by querying EXA_STATISTICS.EXA_DBA_AUDIT_SQL and joining EXA_STATISTICS.EXA_DBA_AUDIT_SESSIONS. To access these system tables, an Exasol user must have the SELECT ANY DICTIONARY system privilege, and auditing must be enabled on the database. For more information about Exasol auditing, see Auditing.

Metadata Ingestion

1. Define the YAML Config

2. Run with the CLI

First, we will need to save the YAML file. Afterward, and with all requirements installed, we can run:

metadata ingest -c <path-to-yaml>

Note that from connector to connector, this recipe will always be the same. By updating the YAML configuration, you will be able to extract metadata from different sources.