Lead Data Platform Engineer — Databricks & Data Lakehouse

PVH (Tommy Hilfiger/Calvin Klein); United States; On-site; USD 140,000 - 210,000; Full time

Job summary

CodaMetrix is seeking a Principal Data Engineer to lead its Databricks-based data platform, driving scalable streaming and batch pipelines for 30+ healthcare customers. You will own architecture, governance, and cost optimization while enabling ML Engineering, Analytics, and Product teams.

Ideal candidates bring 8+ years in data engineering, deep Databricks experience, and strong Python/SQL skills. The role requires leadership, architecture reviews, and cross-team collaboration to raise data

Qualifications

• 8+ years of data engineering with progressive responsibility.
• 5+ years hands-on with Databricks platform (Unity Catalog, Delta Lake, Structured Streaming).
• Expert in PySpark and Python; working knowledge of Scala.
• Extensive Terraform IaC experience across multi-environment deployments.
• Experience with Apache Kafka / AWS MSK and CI/CD pipelines (Jenkins, GitHub Actions).
• Strong SQL skills and understanding of lakehouse patterns; HIPAA/SOC 2 awareness.

Responsibilities

• Own the technical strategy and roadmap for the data platform and its integration with ML/Analytics.
• Design, build, and maintain scalable streaming and batch data pipelines on Databricks.
• Manage infrastructure with Terraform; implement CI/CD using Jenkins and GitHub Actions.
• Enforce data governance, security, and cost optimization across environments.
• Mentor engineers and collaborate with cross-functional teams to drive platform standards.

Skills

PySpark

Python

Scala

Terraform

Apache Kafka / AWS MSK

Jenkins

GitHub Actions

SQL

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks platform

Unity Catalog

Delta Lake

Structured Streaming

Spark SQL

Terraform for IaC

Jenkins CI/CD

GitHub Actions

AWS (S3, IAM)

Job description

CodaMetrix is seeking a Principal Data Engineer to lead its Databricks-based data platform, driving scalable streaming and batch pipelines for 30+ healthcare customers. You will own architecture, governance, and cost optimization while enabling ML Engineering, Analytics, and Product teams.

Ideal candidates bring 8+ years in data engineering, deep Databricks experience, and strong Python/SQL skills. The role requires leadership, architecture reviews, and cross-team collaboration to raise data