Senior Data Engineer - Databricks on AWS Platform

PCI Pharma Services; Philadelphia (Philadelphia County); On-site; USD 120,000 - 180,000; Full time

Job summary

PCI Pharma Services is seeking a Senior Data Engineer to design, develop, and optimize enterprise data pipelines built on Databricks and AWS. You will drive scalable data processing, improve data models, and support analytics, reporting, and AI/ML initiatives across the organization.

The role requires hands-on experience with Databricks, PySpark, Delta Lake, and cloud-based data platforms. You will collaborate with cross-functional teams to ensure platform reliability, governance, and secure

Qualifications

• Experience with Databricks and AWS in a data engineering role.
• Strong knowledge of ETL/ELT processes and data modeling.
• Familiarity with 3NF, star schema, and canonical data models.

Responsibilities

• Design, build, and optimize scalable data pipelines on Databricks.
• Implement medallion architecture (Bronze-Silver-Gold) and data models.
• Collaborate with Product, QA, and DevOps teams for production support.
• Ensure data quality, governance, and cost efficiency in AWS.
• Provide operational support and CI/CD for deployments.

Skills

Databricks

PySpark

Delta Lake

Data modeling

CI/CD

AWS

Tools

Jenkins

Git

Job description

PCI Pharma Services is seeking a Senior Data Engineer to design, develop, and optimize enterprise data pipelines built on Databricks and AWS. You will drive scalable data processing, improve data models, and support analytics, reporting, and AI/ML initiatives across the organization.

The role requires hands-on experience with Databricks, PySpark, Delta Lake, and cloud-based data platforms. You will collaborate with cross-functional teams to ensure platform reliability, governance, and secure