Senior Data Platform Engineer - Azure Databricks & DevOps

CVS Health; Illinois; Hybrid; USD 102,000 - 204,000; Full time

Job summary

CVS Health is seeking a Senior Data Platform Engineer to build and operate an Azure Databricks data platform that ingests, validates, and protects data for business domains. The role emphasizes software engineering, DevOps discipline, and production operations.

You will own CI/CD pipelines with GitHub Actions, apply Terraform for infra, and partner with domain teams to onboard data sources. This is a full-time, remote-friendly role in the US with competitive benefits.

Qualifications

• 3+ years progressive in software, platform, DevOps/SRE, or data engineering, including: 2+ years building or operating cloud data platforms or production data systems.
• Software Engineering & CI/CD: Strong Python skills (packaging, modular and testable code, pytest), Git-based code review, and proven experience building CI/CD pipelines for multi-environment deployments.
• Infrastructure as Code: Hands-on Terraform experience managing Azure and Databricks resources.
• Data Engineering: Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, data quality validation.
• Databricks & Azure: Experience with Delta Lake, Unity Catalog, Jobs, and Delta Live Tables; knowledge of ADLS Gen2, Entra ID, Key Vault, and cloud networking.
• Operations: Experience supporting production systems in a DevOps/SRE/platform role: monitoring, incident response, on-call, root cause analysis, runbooks, disaster recovery.
• Communication: Clear communication and documentation for remote teams.

Responsibilities

• Platform Development: Build and maintain the shared Python libraries and configuration-driven frameworks for onboarding and running pipelines.
• CI/CD & Infrastructure as Code: Own GitHub Actions pipelines and release process; extend Terraform coverage of Azure and Databricks infrastructure.
• Operations, Reliability & Recovery: Support production platform, improve observability, triage incidents, conduct root cause analysis, and create runbooks.
• Security & Governance: Maintain platform and data controls with Unity Catalog and support data protection in healthcare environment.
• Domain Enablement: Partner with domain teams to onboard data sources and convert recurring needs into self-service features.

Skills

Python

DevOps

Communication

Education

Bachelor's degree or equivalent practical experience

Tools

Azure Databricks

Terraform

Unity Catalog

Delta Lake

GitHub Actions

Job description

CVS Health is seeking a Senior Data Platform Engineer to build and operate an Azure Databricks data platform that ingests, validates, and protects data for business domains. The role emphasizes software engineering, DevOps discipline, and production operations.

You will own CI/CD pipelines with GitHub Actions, apply Terraform for infra, and partner with domain teams to onboard data sources. This is a full-time, remote-friendly role in the US with competitive benefits.