Senior Data Engineer

Airo Digital Labs, LLC; Northern (KY); Hybrid; USD 110,000 - 160,000; Full time

Job summary

Airo Digital Labs, LLC seeks a senior Data Engineer to own ingestion pipelines and the governance of a large Atlas Data Lake. You will model and maintain the Graph Database that underpins the Ontology in partnership with the AI Engineer, and ensure clean, governed data for FedEx, customers and third parties.

You will build streaming and batch pipelines, implement data quality frameworks, and facilitate data access via Postgres, SQL and Redis while setting data-quality SLAs and mentoring junior

Qualifications

• 7+ years in data engineering with lakehouse and streaming pipelines.
• Ownership of data governance / lineage in a regulated or large-scale data environment.
• Experience with Databricks, SQL, Python and Spark in production.

Responsibilities

• Design and build ingestion and transformation pipelines over the Atlas Data Lake and Databricks.
• Model and maintain the Graph Database supporting the Ontology Graph.
• Implement data governance including lineage, cataloguing, quality, and PII handling.
• Build streaming and batch pipelines (Azure Event Hub, Spark) and serve data to services via Postgres / SQL / Redis.
• Set data-quality SLAs and monitoring; mentor the Junior Data Engineer.

Skills

Databricks

SQL

Python

Spark

Graph DB

Data Governance

Postgres

Redis

Streaming

Tools

Unity Catalog

Purview

Collibra

Job description

The owner of the POD’s data backbone - the Atlas Data Lake, the Graph Database that underpins the Ontology, and the governance that keeps FedEx, customer and third-party data trustworthy. You make sure the intelligence layer is fed with clean, governed, well-modelled data.

Key Responsibilities

• Design and build ingestion and transformation pipelines over the Atlas Data Lake and Databricks for FedEx, customer and third-party data.
• Model and maintain the Graph Database supporting the Ontology Graph in partnership with the AI Engineer.
• Implement data governance - lineage, cataloguing, quality, access control and PII handling - aligned to central platform standards.
• Build streaming and batch pipelines (Azure Event Hub, Spark) and serve data to services via Postgres / SQL / Redis.
• Set data-quality SLAs and monitoring; mentor the Junior Data Engineer.

Must-have Skills & Technologies

• Lakehouse engineering on Databricks and a data lake (Atlas Data Lake or Delta Lake / equivalent).
• Strong SQL and Python; Spark (batch and structured streaming).
• Graph databases (Neo4j, Cosmos DB Gremlin or similar) and graph data modelling.
• Data governance and lineage tooling (e.g. Unity Catalog, Purview, Collibra) and data quality frameworks.
• Postgres, Redis, and event streaming (Azure Event Hub / Kafka).

Prior Experience

• 7+ years in data engineering, including lakehouse and streaming pipelines in production.
• Demonstrable ownership of data governance / lineage in a regulated or large-scale data environment.

Nice to Have

• Feature engineering for ML/AI workloads; serving data to LLM/RAG systems.