Senior Data Platform Engineer - Azure Databricks & CI/CD

CVS Health; Atlanta (GA); Presencial; USD 102.000 - 204.000; Jornada completa

Descripción de la vacante

CVS Health is looking for a Senior Data Platform Engineer to build, run, and evolve our Azure Databricks data platform that ingests, validates, and protects data for the business domain data engineering teams.

You will partner with domain teams to onboard data sources, develop shared Python libraries, and own CI/CD pipelines (GitHub Actions) and Terraform for Azure/Databricks infrastructure, while enforcing security through Unity Catalog and Delta Lake.

Formación

• 3+ years of progressive experience in software, platform, DevOps/SRE, or data engineering.
• 2+ years building or operating cloud data platforms or production data systems.
• Strong Python skills for packaging, modular and testable code, and pytest.
• Experience building CI/CD pipelines (GitHub Actions preferred) for multi-environment deployments.
• Hands-on Terraform experience with Azure and Databricks resources.
• Production experience with Spark/PySpark and SQL.
• Experience with Delta Lake, Unity Catalog, Delta Live Tables, and ADLS Gen2.
• Experience supporting production systems in a DevOps/SRE or platform role.

Responsabilidades

• Platform Development: Build and maintain shared Python libraries and configuration-driven frameworks for onboarding pipelines.
• CI/CD & Infrastructure as Code: Own GitHub Actions pipelines and release processes for Databricks Asset Bundles and Terraform coverage.
• Operations & Reliability: Support production platform, improve observability, triage incidents, and develop runbooks and automation.
• Security & Governance: Maintain platform and data controls with Unity Catalog and data protection in healthcare.
• Domain Enablement: Partner with domain teams to onboard data sources and create self-service features.

Conocimientos

Python

CI/CD

Git-based code review

Clear communication

Educación

Bachelor's degree or equivalent

Herramientas

GitHub Actions

Terraform

Azure Databricks

Delta Lake

Unity Catalog

Descripción del empleo

CVS Health is looking for a Senior Data Platform Engineer to build, run, and evolve our Azure Databricks data platform that ingests, validates, and protects data for the business domain data engineering teams.

You will partner with domain teams to onboard data sources, develop shared Python libraries, and own CI/CD pipelines (GitHub Actions) and Terraform for Azure/Databricks infrastructure, while enforcing security through Unity Catalog and Delta Lake.