RWD Data Engineering Lead - Cloud & AI

Eli Lilly and Company

Indiana

On-site

USD 137,000 - 200,000

Full time

46 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

401(k) plan
Pension
Vacation benefits

Job summary

Eli Lilly and Company, headquartered in Indianapolis, IN, seeks an Associate Director for RWD Data Engineering to lead cloud-native data pipelines and AI-enabled tools on the Databricks Lakehouse. You will enable HEOR, SDIA, and clinical teams with validated data products built from claims and EHR data, ensuring quality and reproducibility at scale.

The role reports to the Senior Director – Real World Data Engineering & Architecture within HEOR Central and requires collaboration with multiple

Qualifications

  • Hands-on data engineering in healthcare/RWD
  • Experience with Databricks and Delta Lake
  • Proficiency in Python, SQL, and Spark
  • Familiarity with AI coding assistants and frontier AI models
  • Genuine collaboration with cross-functional teams

Responsibilities

  • Design, develop, and deploy cloud-native data pipelines on Databricks.
  • Write, test, and document Python/SQL/R code with AI assistance.
  • Deliver data products through full development lifecycle in a Lakehouse.
  • Build ETL/ELT pipelines for large-scale claims and EHR data.
  • Maintain data assets within lakehouse using Delta Lake & Unity Catalog.
  • Create reusable transformation logic for healthcare datasets.
  • Optimize SQL and distributed workloads for performance and cost.
  • Translate requirements into reproducible data extraction logic.
  • Implement data quality and validation frameworks across products.
  • Apply CI/CD standards and version control in daily work.
  • Develop interactive analytic apps (Dash, Shiny, Streamlit).
  • Explore frontier AI models and Databricks Model Serving for data workflows.

Skills

Python
SQL optimization
AI coding assistants
Spark

Education

Bachelor’s degree in CS/Math/Engineering

Tools

Databricks
Delta Lake
Git
CI/CD

Job description

Eli Lilly and Company, headquartered in Indianapolis, IN, seeks an Associate Director for RWD Data Engineering to lead cloud-native data pipelines and AI-enabled tools on the Databricks Lakehouse. You will enable HEOR, SDIA, and clinical teams with validated data products built from claims and EHR data, ensuring quality and reproducibility at scale.

The role reports to the Senior Director – Real World Data Engineering & Architecture within HEOR Central and requires collaboration with multiple

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Associate Director, Real-World Data Engineering
Associate Director, Real-World Data Engineering

Eli Lilly and Company • Indianapolis (IN)

On-site
USD 137,000 - 200,000
Remote-Eligible Senior Director, Real-World Data Science
Remote-Eligible Senior Director, Real-World Data Science

Lilly • Indianapolis (IN)

Hybrid
USD 171,000 - 299,000
Director of Real-World Data & HEOR Strategy
Director of Real-World Data & HEOR Strategy

Eli Lilly and Company • United States

Remote
USD 171,000 - 299,000
401(k) plan
Pension
Vacation benefits
+2
Director, Real-World Data & HEOR Strategy
Director, Real-World Data & HEOR Strategy

Information Technology Senior Management Forum • Indianapolis (IN)

Hybrid
USD 171,000 - 299,000
Company bonus
401(k) plan
Medical, dental, vision
+1
RWD Strategy Director & AI Innovation Leader
RWD Strategy Director & AI Innovation Leader

Bristol Myers Squibb • United States

Remote
USD 198,000 - 240,000
RWD Strategy Lead — AI-Powered Data Solutions
RWD Strategy Lead — AI-Powered Data Solutions

Bristol-Myers Squibb Company • United States

Remote
USD 139,000 - 169,000
Director, Real World Evidence & Healthcare Analytics Remote
Director, Real World Evidence & Healthcare Analytics Remote

Eli Lilly • United States

Remote
USD 171,000 - 330,000
Bonus eligibility
Remote Senior Real-World Data & Healthcare Analytics Lead
Remote Senior Real-World Data & Healthcare Analytics Lead

Eli Lilly and Company • United States

Remote
USD 171,000 - 330,000
Director/Principal, Real-world Data and Healthcare Analytics Lead
Director/Principal, Real-world Data and Healthcare Analytics Lead

Eli Lilly • United States

Remote
USD 171,000 - 330,000
Bonus eligibility
RWD Strategy Lead: AI-Driven Data Products
RWD Strategy Lead: AI-Driven Data Products

Bristol Myers Squibb • Minneapolis (MN)

On-site
USD 139,000 - 169,000