Senior Data Engineer: Lakehouse, Graph DB & Governance

Airo Digital Labs, LLC; Northern (KY); On-site; USD 110,000 - 160,000; Full time

Job summary

Airo Digital Labs, LLC seeks a senior Data Engineer to own ingestion pipelines and the governance of a large Atlas Data Lake. You will model and maintain the Graph Database that underpins the Ontology in partnership with the AI Engineer, and ensure clean, governed data for FedEx, customers and third parties.

You will build streaming and batch pipelines, implement data quality frameworks, and facilitate data access via Postgres, SQL and Redis while setting data-quality SLAs and mentoring junior

Qualifications

• 7+ years in data engineering with lakehouse and streaming pipelines.
• Ownership of data governance / lineage in a regulated or large-scale data environment.
• Experience with Databricks, SQL, Python and Spark in production.

Responsibilities

• Design and build ingestion and transformation pipelines over the Atlas Data Lake and Databricks.
• Model and maintain the Graph Database supporting the Ontology Graph.
• Implement data governance including lineage, cataloguing, quality, and PII handling.
• Build streaming and batch pipelines (Azure Event Hub, Spark) and serve data to services via Postgres / SQL / Redis.
• Set data-quality SLAs and monitoring; mentor the Junior Data Engineer.

Skills

Databricks

SQL

Python

Spark

Graph DB

Data Governance

Postgres

Redis

Streaming

Tools

Unity Catalog

Purview

Collibra

Job description

Airo Digital Labs, LLC seeks a senior Data Engineer to own ingestion pipelines and the governance of a large Atlas Data Lake. You will model and maintain the Graph Database that underpins the Ontology in partnership with the AI Engineer, and ensure clean, governed data for FedEx, customers and third parties.

You will build streaming and batch pipelines, implement data quality frameworks, and facilitate data access via Postgres, SQL and Redis while setting data-quality SLAs and mentoring junior