Digital Platforms, Senior Data Engineer

PCI Pharma Services

Rockford (IL)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

PCI Pharma Services is seeking a Senior Data Engineer to own the design, development, and operation of a Databricks-based data platform on AWS. The role focuses on scalable pipelines, secure data models, and robust analytics capabilities to support AI/ML use cases.

You will work with the Data Platform Lead, Product, PM, QA, Customer Success, and external partners to deliver reliable, high-performance data solutions across the organization.

Qualifications

  • Senior IC responsible for design, development, optimization, and ops of the enterprise data platform on Databricks and AWS.
  • Expertise in Delta Lake, data modeling, ETL/ELT frameworks, and cloud environments.
  • Collaborates with Data Platform Lead, Product, Project Management, Testing, Customer Success, and external partners.
  • Focus on scalability, security, reliability, and incident resolution.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks (Spark / Delta Lake).
  • Build robust ETL/ELT workflows leveraging PySpark and Databricks SQL.
  • Implement and support medallion architecture (Bronze, Silver, Gold).
  • Design and maintain efficient data models (3NF, star schema).
  • Support Data Catalog and Data Governance for data quality and compliance.
  • Build and maintain CI/CD pipelines for reliable deployments.
  • Collaborate with external partners for development and production support.

Skills

Databricks
PySpark
Delta Lake
Data modeling
ETL/ELT
AWS
CI/CD
Data governance
Spark
Collaboration

Tools

Databricks SQL
AWS Glue
S3
Lambda

Job description

Life changing therapies. Global impact. Bridge to thousands of biopharma companies and their patients.

We are PCI.

Our investment is in People who make an impact, drive progress and create a better tomorrow. Our strategy includes building teams across our global network to pioneer and shape the future of PCI.

Summary:
The Senior Data Engineer (Databricks Platform) is a senior individual contributor responsible for the hands-on design, development, optimization, and operational support of the enterprise data platform built on Databricks and AWS technologies. This role ensures scalable, secure, and high-performance data pipelines, models, and integrations that power analytics, reporting, and advanced AI/ML use cases across the organization.

The role brings deep expertise in distributed data processing, Delta Lake architecture, data modeling, ETL/ELT frameworks, and cloud environments (AWS). This role focuses on execution excellence, platform reliability, and technical problem resolution, while collaborating closely with Data Platform Lead, Product, Project Management, Testing, Customer Success, and external development partners.

Responsibilities:
Data Platform Engineering
  • Design, develop, and maintain scalable data pipelines using Databricks (Spark / Delta Lake).
  • Build robust ETL/ELT workflows leveraging PySpark and Databricks SQL.
  • Implement and support medallion architecture (Bronze, Silver, Gold layers).
  • Design and maintain efficient data models, including 3NF, star schema, and canonical models, as appropriate.
  • Support and maintain Data Catalog and Data Governance frameworks to ensure data quality and compliance.
  • Build and maintain CI/CD pipelines to enable reliable deployment across environments.
  • Collaborate with external partners for development activities and ongoing production support.
Cloud & AWS Environment Support
  • Demonstrate hands-on experience with AWS Glue, S3, and Lambda.
  • Provide operational support for AWS-hosted infrastructure, including application services, data services, and system integrations.
  • Monitor cloud environments for availability, performance, security, and cost efficiency; escape risks and issues to the Technical Lead when required.
  • Support deployment activities and ensure environment readiness in collaboration with DevOps and technical stakeholders.
  • Contribute to cloud operational best practices focused on scalability, resilience, security, and incident response.
Testing Support
  • Partner with Testing and QA teams to support User Acceptance Testing (UAT) and validation activities by:
  • Reviewing test cases for technical accuracy and risk coverage
  • Triaging defects identified during testing cycles
  • Ensuring test environment readiness and stability
  • Provide technical input during release readiness discussions and risk evaluations.
Cross-Functional Collaboration
  • Collaborate closely with Product Managers, Project Managers, QA, DevOps, and external development partners to ensure successful solution delivery and ongoing platform stability.
  • Translate business and operational requirements into scalable technical solutions aligned with approved architecture and enterprise standards.
  • Support secure and reliable integration with internal enterprise systems and data sources.
Compliance & Operational Expectations
  • Ensure adherence to all applicable PCI, cGMP, GCP, and regulatory policies.
  • Participate in occasional overtime and/or weekend work as required to support critical releases or production needs.
  • Maintain consistent attendance and reliable availability as essential functions of the role.
  • Perform additional duties as assigned by the Data Platform Technical Lead or management.

Join us and be part of building the bridge between life changing therapies and patients.

Equal Employment Opportunity (EEO) Statement:
PCI Pharma Services is an Equal Opportunity/Affirmative Action Employer. We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.

At PCI, Equity and Inclusion are at the core of our company’s purpose: Together, delivering life-changing therapies. We are committed to cultivating an inclusive workplace by holding ourselves accountable to the highest standards of understanding, fairness, respect, and equal opportunity - at every level. We envision a PCI community where everyone can belong and grow, and we strive to bring this vision to reality by continuously and intentionally assessing our people practices, policies and programs, marketing approach, and workplace culture.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Digital Platforms, Testing Coordinator
Digital Platforms, Testing Coordinator

PCI Pharma Services • Philadelphia

On-site
USD 65,000 - 90,000
Manager, Global Quality Tech Ops-Digital Transformation & Innovation
Manager, Global Quality Tech Ops-Digital Transformation & Innovation

PCI Pharma Services • Philadelphia

On-site
USD 110,000 - 165,000
Sr. Software Support Specialis
Sr. Software Support Specialis

PCI Pharma Services • Philadelphia

Hybrid
USD 90,000 - 120,000
Director, Integrated Talent Management
Director, Integrated Talent Management

PCI Pharma Services • Rockford (IL)

Remote
USD 140,000 - 190,000
Global Data Analyst, OpEx
Global Data Analyst, OpEx

PCI Pharma Services • Rockford (IL)

On-site
USD 76,000 - 86,000
Paid time off
Health insurance (including dental and
Vision coverage
+2
Principal Engineer, Global Technical Operations, Engineering & Innovation
Principal Engineer, Global Technical Operations, Engineering & Innovation

PCI Pharma Services • Bedford (NH)

On-site
USD 140,000 - 200,000
Sr. Software Support Specialis
Sr. Software Support Specialis

PCI Pharma Services • Rockford (IL)

On-site
USD 90,000 - 130,000
Manager, Continuous Improvement, Global OpEx
Manager, Continuous Improvement, Global OpEx

PCI Pharma Services • Rockford (IL)

On-site
USD 100,000 - 150,000
Digital Platforms, Testing Coordinator
Digital Platforms, Testing Coordinator

PCI PHW Packaging Coordinators Inc. • Illinois

On-site
USD 60,000 - 90,000
Director, Integrated Talent Management
Director, Integrated Talent Management

PCI PHW Packaging Coordinators Inc. • United States

Remote
USD 180,000 - 250,000