Senior Leader, Real-World Data Engineering & Pipelines

Eli Lilly and Company

Indianapolis (IN)

On-site

USD 156,000 - 228,800

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

401(k)
Pension
Well-being benefits

Job summary

Eli Lilly and Company is seeking a Senior RWD Data Engineer to design and operate cloud-native data pipelines that transform real-world data into analysis-ready assets for HEOR, SDIA, and clinical teams.

You will own end-to-end data product lifecycles, optimize Spark-based workloads, and implement lakehouse architectures using Databricks and cloud storage. Collaboration with multi-functional teams and governance controls are essential.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, Statistics, Information Technology, Bioinformatics, or a technical field.
  • Minimum of 3 years of hands-on data engineering experience with healthcare or life sciences RWD.
  • 3+ years applying Python, SQL, and cloud ETL/ELT pipelines to real-world healthcare data at scale.

Responsibilities

  • Lead design and implementation of cloud-native data products and high-throughput data pipelines for RWD assets.
  • Own end-to-end lifecycle of RWD data products from requirements to production deployment.
  • Optimize SQL and distributed processing workloads (Spark) across large datasets.
  • Develop lakehouse architectures using Databricks and cloud object storage to ensure audit-ready data.
  • Write and maintain transformation logic with healthcare coding standards (ICD, NDC, SNOMED, LOINC).
  • Collaborate with data scientists and HEOR teams to document standards and templates.
  • Contribute to CI/CD, code reviews, and testing standards for reproducible pipeline deploys.
  • Ensure data quality, lineage, and governance across the data asset lifecycle.

Skills

SQL optimization
Python (pandas, PySpark)
Distributed computing
Cloud data engineering
Delta Lake/Apache Iceberg
ETL/ELT tooling
DevOps and CI/CD
Data modeling (star/snowflake, OMOP)
Healthcare data standards
RWD/EDW concepts

Education

Bachelor’s degree in CS/Engineering/Statistics/Tech field

Tools

Databricks
Airflow
AWS/GCP/Azure
Git/Docker

Job description

Eli Lilly and Company is seeking a Senior RWD Data Engineer to design and operate cloud-native data pipelines that transform real-world data into analysis-ready assets for HEOR, SDIA, and clinical teams.

You will own end-to-end data product lifecycles, optimize Spark-based workloads, and implement lakehouse architectures using Databricks and cloud storage. Collaboration with multi-functional teams and governance controls are essential.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Director, Real-World Data Architect — Cloud Pipelines
Senior Director, Real-World Data Architect — Cloud Pipelines

Eli Lilly and Company • Indianapolis (IN)

On-site
USD 169,000 - 249,000
Bonus program
Comprehensive benefits
Relocation assistance
Head of Real-World Data Operations & Strategy
Head of Real-World Data Operations & Strategy

Eli Lilly and Company • Indiana (PA)

On-site
USD 169,000 - 249,000
Senior Director, Real-World Data Operations & Strategy
Senior Director, Real-World Data Operations & Strategy

BioSpace • Indianapolis (IN)

On-site
USD 170,000 - 249,000
401(k) plan
Pension
Health benefits
RWD Operations Executive — AI-Ready Data at Scale
RWD Operations Executive — AI-Ready Data at Scale

Eli Lilly and Company • Indianapolis (IN)

On-site
USD 169,000 - 249,000
Relocation assistance
Company bonus eligibility
Comprehensive benefits
Senior Director, Real-World Data Operations & Strategy
Senior Director, Real-World Data Operations & Strategy

Initial Therapeutics, Inc. • Indianapolis (IN)

On-site
USD 169,000 - 249,000
Relocation assistance
Remote work possible
Cloud-Native RWD Data Platform Architect
Cloud-Native RWD Data Platform Architect

Initial Therapeutics, Inc. • Indianapolis (IN)

On-site
USD 169,000 - 249,000
401(k) with match
Pension plan
Medical, dental, vision coverage
+1
Head of Real-World Data Operations
Head of Real-World Data Operations

United States Digital Space LLC • United States

Remote
USD 169,000 - 249,000
Relocation assistance
Company bonus
Comprehensive benefits
Senior Lead, Real-World Data Strategy & AI
Senior Lead, Real-World Data Strategy & AI

Bristol Myers Squibb • Lawrence Township (NJ)

On-site
USD 139,000 - 169,000
Health Coverage
Wellbeing Support
Paid Time Off
Data Engineer – Cloud Data Lakehouse for Pharma & GxP
Data Engineer – Cloud Data Lakehouse for Pharma & GxP

Eli Lilly and Company • Lebanon (IN)

On-site
USD 90,000 - 130,000
Remote Senior Data Engineer — Scalable Data Pipelines
Remote Senior Data Engineer — Scalable Data Pipelines

540 • Arlington (VA)

On-site
USD 150,000 - 190,000
Flexible PTO
Federal holidays off
Health, dental and vision insurance
+5