RWD Data Engineering Director — Cloud Architect

BioSpace; Indianapolis (IN); On-site; USD 169,500 - 248,600; Full time

Job summary

Lilly is seeking a Director of RWD Data Engineering to lead end-to-end engineering for real-world data infrastructure. The role focuses on scalable, cloud-native pipelines and data products enabling HEOR and related teams to generate evidence efficiently.

Responsibilities include designing lakehouse architectures, managing ETL/ELT processes, and driving standardization across data asset lifecycles, with cross-functional collaboration across HEOR, SDIA, Statisticians, Medical, and Clinical teams.

Qualifications

• Bachelor’s degree in a technical field is required.
• Minimum 5 years of hands-on data engineering experience.
• Experience with healthcare data and RWD preferred.

Responsibilities

• Lead design and implementation of cloud-native data products and pipelines.
• Own end-to-end lifecycle of RWD data products from requirements to deployment.
• Optimize Spark-based workloads for very large datasets.
• Collaborate with data scientists and analytics leaders to standardize data engineering practices.
• Develop KPIs to measure system performance and impact.

Skills

SQL optimization

Python (PySpark)

Databricks

Cloud data engineering

ETL/ELT pipelines

Education

Bachelor’s degree in Computer Science, Engineering, Statistics, Information Technology, Bioinformatics or Technical Field

Tools

Databricks

AWS

Azure

SQL

ETL/ELT tooling

Job description

Lilly is seeking a Director of RWD Data Engineering to lead end-to-end engineering for real-world data infrastructure. The role focuses on scalable, cloud-native pipelines and data products enabling HEOR and related teams to generate evidence efficiently.

Responsibilities include designing lakehouse architectures, managing ETL/ELT processes, and driving standardization across data asset lifecycles, with cross-functional collaboration across HEOR, SDIA, Statisticians, Medical, and Clinical teams.