Senior Data Platform Engineer - Azure Databricks & DevOps

CVS Health; Springfield (IL); Remote; USD 102,000 - 204,000; Full time

Job summary

CVS Health is seeking a Senior Data Platform Engineer to build and run an Azure Databricks-based data platform that ingests, validates, and protects data for data engineering teams. The role emphasizes software engineering, DevOps discipline, and hands-on production experience.

Remote work within the US is considered. You will own CI/CD pipelines, IaC with Terraform, and platform reliability while collaborating with domain teams to enable self-service data capabilities.

Qualifications

• 3+ years progressive in software, platform, DevOps/SRE, or data engineering.
• 2+ years building or operating cloud data platforms or production data systems.
• Strong Python skills (packaging, modular and testable code, pytest), Git-based code review, and CI/CD pipelines (GitHub Actions preferred).
• Terraform experience managing Azure and Databricks resources.
• Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, and data quality validation.

Responsibilities

• Platform Development: Build and maintain shared Python libraries and configuration-driven frameworks for onboarding and running pipelines.
• CI/CD & Infrastructure as Code: Own GitHub Actions pipelines and release processes; extend Terraform coverage of Azure and Databricks infrastructure.
• Operations, Reliability & Recovery: Support production platform, improve observability, triage incidents, conduct root cause analysis, and create runbooks and automation.
• Security & Governance: Maintain Unity Catalog and support data protection and governance in healthcare environment.
• Domain Enablement: Partner with domain teams to onboard data sources and develop self-service features.

Skills

Python programming

CI/CD pipelines

Spark/PySpark

SQL

Terraform

Azure Databricks

Git/GitHub Actions

DevOps/SRE

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Unity Catalog

Azure

GitHub Actions

ADLS Gen2

Job description

CVS Health is seeking a Senior Data Platform Engineer to build and run an Azure Databricks-based data platform that ingests, validates, and protects data for data engineering teams. The role emphasizes software engineering, DevOps discipline, and hands-on production experience.

Remote work within the US is considered. You will own CI/CD pipelines, IaC with Terraform, and platform reliability while collaborating with domain teams to enable self-service data capabilities.