Pharma Data Engineer - Master Data Pipelines & Governance

Eli Lilly and Company

United States

On-site

USD 66,000 - 189,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Company bonus
401(k) and pension
Vacation benefits
Medical, dental, vision
Flexible benefits
Well-being benefits

Job summary

Lilly is seeking a Data Engineer for the LillyDirect Pharmacy Covered Entity Master Data team. You will design, build, and maintain scalable data pipelines and data models to support scientific and business initiatives, ensuring data availability, quality, and integrity.

You will work with the Technical Lead, DevOps, architects, and analysts to implement Delta Lake-based lakehouse architectures on AWS, develop ETL/ELT workflows, and govern sensitive data while driving cost efficiency and

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, MIS, or equivalent work experience.
  • Overall 5+ years of experience in data engineering using SQL, Python, PySpark, and cloud platforms (AWS, Azure, or GCP).
  • 2+ years in Agile environments with hands-on GitHub and CI/CD pipelines for code deployment.
  • Hands-on experience with Databricks, Delta Lake, and performance optimization.
  • 1+ years of experience with orchestration tools like Airflow or Databricks Workflows.

Responsibilities

  • Design, build, and maintain scalable data pipelines for batch and near-real-time processing in Python and PySpark on Databricks and AWS.
  • Develop and optimize data models, ETL/ELT workflows, and data integration across systems using Delta Lake and lakehouse patterns.
  • Support data integrations with Reltio and Transcend, including loads, extracts, and reconciliation.
  • Build data quality, lineage, and reconciliation checks for accurate, auditable data.
  • Implement data governance, security, and quality standards across data assets including PII/PHI and consent data.
  • Collaborate with Tech Lead, product owners, architects, analysts, and business stakeholders to deliver solutions.
  • Own pipelines and work streams from design through production, contributing to architectural decisions.
  • Promote best practices in coding, code review, automated testing, and CI/CD pipelines.
  • Monitor and improve performance, reliability, and cost of data pipelines; support incidents and root-cause analysis.
  • Automate manual processes and identify opportunities to optimize data workflows.

Skills

SQL
Python
PySpark
Cloud platforms
Agile
GitHub
CI/CD
Databricks

Education

Bachelor's degree in CS/IT/MIS or equivalent

Tools

Delta Lake
Reltio
Transcend
Airflow
Terraform
Unity Catalog
Databricks Workflows

Job description

Lilly is seeking a Data Engineer for the LillyDirect Pharmacy Covered Entity Master Data team. You will design, build, and maintain scalable data pipelines and data models to support scientific and business initiatives, ensuring data availability, quality, and integrity.

You will work with the Technical Lead, DevOps, architects, and analysts to implement Delta Lake-based lakehouse architectures on AWS, develop ETL/ELT workflows, and govern sensitive data while driving cost efficiency and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Master Data Engineer – Pharma & Consent Platforms
Senior Master Data Engineer – Pharma & Consent Platforms

BioSpace • Indianapolis (IN)

On-site
USD 129,000 - 231,000
Pharmacy Master Data Tech Lead — Platform & Consent
Pharmacy Master Data Tech Lead — Platform & Consent

Eli Lilly and Company • Indianapolis (IN)

On-site
USD 129,000 - 231,000
Senior Consumer Data Architect: Master Data & Privacy
Senior Consumer Data Architect: Master Data & Privacy

Eli Lilly and Company • Indianapolis (IN)

On-site
USD 129,000 - 231,000
401(k) plan
Healthcare benefits
Vacation & leave
LillyDirect Pharmacy Master Data Technical Lead
LillyDirect Pharmacy Master Data Technical Lead

Eli Lilly and Company • Indianapolis (IN)

On-site
USD 129,000 - 231,000
LillyDirect Pharmacy Data Engineer
LillyDirect Pharmacy Data Engineer

Eli Lilly and Company • United States

On-site
USD 66,000 - 189,000
Company bonus
401(k) and pension
Vacation benefits
+3
Pharmacy Master Data Platform Lead (Reltio, Transcend, AWS)
Pharmacy Master Data Platform Lead (Reltio, Transcend, AWS)

Eli Lilly and Company • United States

On-site
USD 129,000 - 231,000
Company bonus
401(k) plan
Healthcare benefits
+1
GMP Data Engineer: Lakehouse & AI Pipelines
GMP Data Engineer: Lakehouse & AI Pipelines

Eli Lilly • Indianapolis (IN)

On-site
USD 129,000 - 231,000
401(k) participation
Pension
Vacation benefits
+4
Lead Data Lakehouse Engineer - Pipelines & Governance
Lead Data Lakehouse Engineer - Pipelines & Governance

Doctronic • San Francisco (CA)

On-site
USD 200,000 - 275,000
Equity
Parental leave: 12 weeks paid
Competitive cash compensation
LillyDirect Pharmacy Master Data Technical Lead
LillyDirect Pharmacy Master Data Technical Lead

BioSpace • Indianapolis (IN)

On-site
USD 129,000 - 231,000
LillyDirect Pharmacy Master Data Technical Lead
LillyDirect Pharmacy Master Data Technical Lead

Eli Lilly and Company • United States

On-site
USD 129,000 - 231,000
Company bonus
401(k) plan
Healthcare benefits
+1