Senior Data Engineer - Databricks & AWS Platform

PCI TRGR Penn Pharmaceutical Services Ltd; Philadelphia (Philadelphia County); On-site; USD 120,000 - 180,000; Full time

Job summary

PCI Pharma Services seeks a Senior Data Engineer specializing in the Databricks platform to design, build, and support scalable data pipelines on AWS. You will own data models, governance, and CI/CD practices to ensure reliable analytics and AI/ML readiness across teams.

You will collaborate with the Data Platform Lead, Product, Project Management, Testing, Customer Success, and external partners to deliver resilient data solutions and maintain compliance with regulatory standards.

Qualifications

• Hands-on design, development and operation of an enterprise data platform on Databricks and AWS.
• Experience with Delta Lake, data modeling (3NF, star schemas) and scalable data pipelines.
• Ability to collaborate with cross-functional teams including Product, Project Management, Testing and DevOps.

Responsibilities

• Data Platform Engineering: design, develop, and maintain scalable data pipelines using Databricks (Spark / Delta Lake).
• Build robust ETL/ELT workflows leveraging PySpark and Databricks SQL.
• Implement and support medallion architecture (Bronze, Silver, Gold layers).
• Design and maintain efficient data models, including 3NF, star schema, and canonical models, as appropriate.
• Support and maintain Data Catalog and Data Governance frameworks to ensure data quality and compliance.
• Build and maintain CI/CD pipelines to enable reliable deployment across environments.
• Collaborate with external partners for development activities and ongoing production support.

Skills

Databricks

PySpark

AWS

Data Modeling

CI/CD

Tools

Delta Lake

Spark

Job description

PCI Pharma Services seeks a Senior Data Engineer specializing in the Databricks platform to design, build, and support scalable data pipelines on AWS. You will own data models, governance, and CI/CD practices to ensure reliable analytics and AI/ML readiness across teams.

You will collaborate with the Data Platform Lead, Product, Project Management, Testing, Customer Success, and external partners to deliver resilient data solutions and maintain compliance with regulatory standards.