AI Data Engineer — Build AI-Ready Data Pipelines

HHMI; United States; Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Hybrid work schedule

Job summary

HHMI is seeking an AI Data Engineer to build and operate the data pipelines powering institutional AI applications. Based at our Chevy Chase HQ with a hybrid schedule, you will own end-to-end dataflow—from landing-zone ingestion through medallion-architecture transformations to AI-ready data products.

You will collaborate with the Principal Knowledge & Data Architect and AI Developers to ensure data quality, governance, and scalable delivery for product teams across HHMI.

Qualifications

• Hands-on production data engineering with pipelines owned end-to-end.
• Depth in Delta Lake medallion architecture and Databricks platforms.
• Fluent in Python and SQL for scalable ETL and analytics.

Responsibilities

• Build AI-facing data pipelines from landing zone to AI-ready content.
• Implement medallion architecture with Delta Lake tables and schedules.
• Own the workflow-orchestration framework (Databricks Workflows, Delta Live Tables).
• Apply governance patterns via Unity Catalog, access control, and audits.
• Develop retrieval-supporting infra: embeddings, vector stores, reindexing.
• Partner with Operations Capabilities on data contracts and SLAs.
• Design data quality checks, monitoring, drift detection, alerts.
• Support AI Developer velocity with data provisioning for use cases.
• Contribute to reusable reference patterns and templates.

Skills

Databricks

Delta Lake

PySpark

SQL

Python

Data pipelines

Tools

Databricks Workflows

Delta Live Tables

Unity Catalog

Job description

HHMI is seeking an AI Data Engineer to build and operate the data pipelines powering institutional AI applications. Based at our Chevy Chase HQ with a hybrid schedule, you will own end-to-end dataflow—from landing-zone ingestion through medallion-architecture transformations to AI-ready data products.

You will collaborate with the Principal Knowledge & Data Architect and AI Developers to ensure data quality, governance, and scalable delivery for product teams across HHMI.