Biopharma AI Data Engineer — Scalable Pipelines

AbbVie; Worcester (MA); On-site; USD 120,000 - 180,000; Full time

Job summary

AbbVie is seeking an experienced Data Engineer within the PDST organization to design, build, and operate production-grade data pipelines for AI/ML across CMC and manufacturing systems. You will harmonize data from MES, LIMS, QMS, ERP, and instrument sources, enabling reliable, governed data assets for data scientists and process engineers.

You will collaborate with scientists and engineers to ensure data models accurately reflect domain realities, implement data quality and governance, and

Qualifications

• Bachelor's degree or Master's in a technical field with hands-on data pipeline experience.
• Experience designing and building enterprise-grade data pipelines in multi-source environments.
• Proficiency in Python for data engineering tasks and SQL across databases.
• Experience with cloud data platforms and modern data stack components.

Responsibilities

• Design scalable data ingestion pipelines connecting multi-source systems (MES, historians, LIMS, QMS, ERP).
• Build connectors and integration layers handling heterogeneous data formats and latency.
• Develop harmonized data models and ontologies across sites and systems.
• Implement data quality controls, lineage, and governance in production pipelines.
• Deliver governed data products for AI/ML, including feature stores and curated datasets.
• Contribute to cloud-based data platform design and CI/CD for data systems.
• Engage with scientists and engineers to translate model data needs into infrastructure.

Skills

Python for data engineering

SQL

Cloud data platforms (AWS/Azure/GCP)

dbt

Spark

Airflow

Databricks

Snowflake

API development

Education

Bachelor's Degree in Computer Science, Data Engineering, Information Systems, Software Engineering, Bioinformatics, or closely related technical field

Master's Degree in related field

Tools

Informatica

Talend

Apache NiFi

AWS Glue

Azure Data Factory

Job description

AbbVie is seeking an experienced Data Engineer within the PDST organization to design, build, and operate production-grade data pipelines for AI/ML across CMC and manufacturing systems. You will harmonize data from MES, LIMS, QMS, ERP, and instrument sources, enabling reliable, governed data assets for data scientists and process engineers.

You will collaborate with scientists and engineers to ensure data models accurately reflect domain realities, implement data quality and governance, and