Senior Data Platform Engineer - Azure Databricks & DevOps

CVS Health; Elm (PA); A distancia; USD 102.000 - 204.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical, dental, and vision coverage

Paid time off & retirement savings

Descripción de la vacante

CVS Health seeks a Senior Data Platform Engineer to build and run an Azure Databricks data platform that ingests, validates, and protects data for business domain teams. You will treat the platform like a software product, with domain onboarding, shared Python frameworks, tests, and CI/CD reviews.

You should bring 6+ years in software/data engineering, strong Python and Terraform skills, and experience with Delta Lake, Unity Catalog, and Databricks.

Formación

• 3+ years in software, platform, DevOps/SRE, or data engineering.
• 2+ years building or operating cloud data platforms or production data systems.
• Strong Python, packaging, modular and testable code with pytest; GitHub Actions CI/CD.
• Terraform experience managing Azure and Databricks resources.
• Production Spark/PySpark, SQL, data modeling and data quality validation.

Responsabilidades

• Build and maintain platform libraries and config-driven frameworks for domain teams.
• Own CI/CD pipelines and release process across environments.
• Monitor production platform, triage incidents, and drive runbooks.
• Maintain Unity Catalog and data governance in healthcare context.
• Partner with domain teams to onboard data sources and deliver self-service features.

Conocimientos

Python programming

Git-based code review

CI/CD pipelines

Spark/PySpark

SQL

Communication

Educación

Bachelor's degree or equivalent

Herramientas

GitHub Actions

Terraform

Azure Databricks

Delta Lake

Unity Catalog

ADLS Gen2

Key Vault

Descripción del empleo

CVS Health seeks a Senior Data Platform Engineer to build and run an Azure Databricks data platform that ingests, validates, and protects data for business domain teams. You will treat the platform like a software product, with domain onboarding, shared Python frameworks, tests, and CI/CD reviews.

You should bring 6+ years in software/data engineering, strong Python and Terraform skills, and experience with Delta Lake, Unity Catalog, and Databricks.