Senior CE Data Engineer — Databricks Platform & PHI

Eli Lilly; Indianapolis (IN); On-site; USD 63,000 - 150,000; Full time

Benefits offered by this job

401(k)

Pension

Vacation

Medical benefits

Flexible benefits

Life insurance

Job summary

Eli Lilly in Indianapolis, IN is building governed, auditable data capabilities for CE pharmacy operations on the Databricks platform. You’ll design production pipelines that enforce PHI isolation, data contracts as code, and identity crosswalk rules to enable trusted CE data products.

This onsite role emphasizes security, lineage, and data quality, using Unity Catalog, Delta Lake, and Databricks Workflows to deliver scalable pipelines with performance and cost balance.

Qualifications

• Bachelor’s degree in a relevant field or equivalent experience.
• Strong experience building production data pipelines and data products.
• Advanced SQL and Python with Databricks / Unity Catalog fluency.
• Authorized to work in the United States on a full-time basis.

Responsibilities

• Design and build scalable Databricks pipelines across bronze → gold data layers within the CE trust boundary.
• Implement PHI classification and identity crosswalk logic using diverse systems.
• Deliver ODCS data contracts enforcing schema, quality, freshness/SLA, and lineage in pipeline logic.
• Build and maintain CI/CD pipelines using GitHub Actions and Git-based promotion.
• Enable governed data consumption paths for CE data products and agents.

Skills

Advanced SQL

Python programming

Data pipeline development

Databricks / Unity Catalog

RBAC/ABAC concepts

Education

Bachelor’s degree in CS/Engineering/IT

Tools

Databricks

Unity Catalog

Delta Lake

Databricks Workflows

GitHub Actions

Python

SQL

OPA/Rego

Job description

Eli Lilly in Indianapolis, IN is building governed, auditable data capabilities for CE pharmacy operations on the Databricks platform. You’ll design production pipelines that enforce PHI isolation, data contracts as code, and identity crosswalk rules to enable trusted CE data products.

This onsite role emphasizes security, lineage, and data quality, using Unity Catalog, Delta Lake, and Databricks Workflows to deliver scalable pipelines with performance and cost balance.