AI-Driven Principal Data Engineer — Pharma Data Platforms

Allergan; North Chicago (IL); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Paid time off

Medical/dental/vision insurance

401(k) with company match

Job summary

AbbVie in North Chicago, IL is seeking a Principal Data Engineer embedded in PDST to design, build, and operate enterprise-grade data pipelines powering AI/ML across CMC and manufacturing.

You will integrate MES, LIMS, QMS, ERP, and instrument data to transform it into governed, semantic data assets used by data scientists and process engineers to accelerate development and regulatory submissions.

Qualifications

• Bachelor’s degree in a technical field with 6+ years of experience, or advanced degree with more experience.
• Hands-on experience designing and building enterprise-grade data pipelines in multi-source environments.
• Expert-level Python for data engineering, including automation and validation.
• Strong SQL skills with ANSI and platform-specific dialects.
• Cloud data platforms (AWS/Azure/GCP) and modern data-tools (dbt, Spark, Airflow).
• Experience with ETL/ELT tools and data governance, lineage, and metadata practices.

Responsibilities

• Design and operate scalable data ingestion pipelines across MES, LIMS, QMS, ERP, and instruments.
• Develop harmonized data models and semantic mappings for enterprise data standards.
• Implement data quality controls, observability, and data lineage documentation.
• Deliver governed data products for AI/ML use, including feature stores and datasets.
• Collaborate with data scientists, process engineers, and manufacturing teams to meet model data needs.
• Contribute to cloud platform design, CI/CD, and infrastructure-as-code practices.

Skills

Python

SQL

Airflow

Databricks

ETL

MDM

Education

Bachelor's in CS/CE/related field

MS in STEM

PhD (optional)

Tools

Informatica

dbt

Spark

OSISoft PI

Power BI/Visualization

Job description

AbbVie in North Chicago, IL is seeking a Principal Data Engineer embedded in PDST to design, build, and operate enterprise-grade data pipelines powering AI/ML across CMC and manufacturing.

You will integrate MES, LIMS, QMS, ERP, and instrument data to transform it into governed, semantic data assets used by data scientists and process engineers to accelerate development and regulatory submissions.