Requirements
User must haveglue:GetDatabases and glue:GetTables permissions to ingest the basic metadata.
Python Requirements
To run the Glue ingestion, you will need to install:Metadata Ingestion
All connectors are defined as JSON Schemas. Here you can find the structure to create a connection to Glue. In order to create and run a Metadata Ingestion workflow, we will follow the steps to create a YAML configuration able to connect to the source, process the Entities if needed, and reach the OpenMetadata server. The workflow is modeled around the following JSON Schema1. Define the YAML Config
2. Run with the CLI
First, we will need to save the YAML file. Afterward, and with all requirements installed, we can run:dbt Integration
dbt Integration
Learn more about how to ingest dbt models