AI Data Engineer for Drug Discovery - Hybrid

Eli Lilly and Company; Indianapolis (IN); Hybrid; CAD 220,000 - 322,000; Full time

Job summary

Eli Lilly and Company in Silicon Valley is seeking a Data Engineer to build data platforms powering AI-driven drug discovery. You will develop scalable pipelines to ingest, transform, and deliver chemical, biological, and experimental data for machine learning and scientific workflows.

You will collaborate with AI scientists and lab researchers, ensure data accuracy and traceability, and design robust pipelines with Parquet, Zarr, and Arrow formats. Three days onsite, two days remote weekly.

Qualifications

• Bachelor’s degree in Computer Science, Data Science, Engineering, Mathematics, or related technical field.
• 5+ years of data engineering experience building and operating production data systems.

Responsibilities

• Build and maintain data platforms powering AI-driven research and discovery.
• Develop scalable pipelines ingesting and delivering chemical, biological, and experimental data.
• Collaborate with AI scientists, engineers, and lab researchers to ensure data quality.
• Design and optimize data pipelines for analytics and machine learning workloads.
• Ensure traceability, versioning, and reproducibility of datasets.

Skills

Python

SQL

Data Modeling

Distributed processing

Airflow

Dagster

Cloud platforms

CI/CD

Git

collaboration with scientists

Education

Bachelor’s degree in Computer Science, Data Science, Engineering, Mathematics, or related technical field

Tools

Postgres

Spark

Parquet

Zarr

Arrow

RDD

Job description

Eli Lilly and Company in Silicon Valley is seeking a Data Engineer to build data platforms powering AI-driven drug discovery. You will develop scalable pipelines to ingest, transform, and deliver chemical, biological, and experimental data for machine learning and scientific workflows.

You will collaborate with AI scientists and lab researchers, ensure data accuracy and traceability, and design robust pipelines with Parquet, Zarr, and Arrow formats. Three days onsite, two days remote weekly.