Senior Data Engineer – Databricks Platform

PCI Pharma Services; Rockford (IL); On-site; USD 140,000 - 180,000; Full time

Job summary

PCI Pharma Services in Rockford, IL seeks a Senior Data Engineer to own the design, development, and operation of our enterprise data platform built on Databricks and AWS. You will deliver scalable data pipelines, robust ETL/ELT workflows, and secure data models to power analytics and AI/ML initiatives.

The role requires deep expertise in Delta Lake, 3NF/star schemas, data governance, and CI/CD. You will collaborate with Data Platform Lead, Product, QA, and external partners to ensure

Qualifications

• Extensive experience designing and operating enterprise data platforms on Databricks and AWS.
• Strong knowledge of Delta Lake architecture, ETL/ELT, and cloud environments.
• Ability to translate business needs into scalable technical solutions aligned with enterprise standards.
• Willingness for occasional overtime for critical releases or production needs.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks (Spark / Delta Lake).
• Build ETL/ELT workflows leveraging PySpark and Databricks SQL.
• Implement and support medallion architecture (Bronze, Silver, Gold).
• Design and maintain efficient data models, including 3NF, star schema, and canonical models.
• Support and maintain Data Catalog and Data Governance for data quality and compliance.
• Build and maintain CI/CD pipelines for reliable deployment across environments.
• Collaborate with external partners for development activities and ongoing production support.
• Provide operational support for AWS-hosted infrastructure (Glue, S3, Lambda).
• Partner with Testing & QA for UAT and validation, review test cases, triage defects, ensure readiness.

Skills

Databricks

PySpark

Data Modeling

CI/CD

Data Governance

AWS

Collaboration

Tools

Databricks

S3

Glue

Lambda

Job description

PCI Pharma Services in Rockford, IL seeks a Senior Data Engineer to own the design, development, and operation of our enterprise data platform built on Databricks and AWS. You will deliver scalable data pipelines, robust ETL/ELT workflows, and secure data models to power analytics and AI/ML initiatives.

The role requires deep expertise in Delta Lake, 3NF/star schemas, data governance, and CI/CD. You will collaborate with Data Platform Lead, Product, QA, and external partners to ensure