Senior Data Platform Engineer (Databricks, Python)

8350 Oak Street Health MSO LLC; Illinois; Hybrid; USD 102,000 - 204,000; Full time

Job summary

CVS Health is seeking a Senior Data Platform Engineer to build and operate an Azure Databricks data platform that ingests, validates, and protects data for business domains. The role emphasizes software engineering, DevOps discipline, and production operations.

You will own CI/CD pipelines with GitHub Actions, apply Terraform for infra, and partner with domain teams to onboard data sources. This is a full-time, remote-friendly role in the US with competitive benefits.

Qualifications

• 3+ years progressive in software, platform, DevOps/SRE, or data engineering, including: 2+ years building or operating cloud data platforms or production data systems.
• Software Engineering & CI/CD: Strong Python skills (packaging, modular and testable code, pytest), Git-based code review, and proven experience building CI/CD pipelines for multi-environment deployments.
• Infrastructure as Code: Hands-on Terraform experience managing Azure and Databricks resources.
• Data Engineering: Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, data quality validation.
• Databricks & Azure: Experience with Delta Lake, Unity Catalog, Jobs, and Delta Live Tables; knowledge of ADLS Gen2, Entra ID, Key Vault, and cloud networking.
• Operations: Experience supporting production systems in a DevOps/SRE/platform role: monitoring, incident response, on-call, root cause analysis, runbooks, disaster recovery.
• Communication: Clear communication and documentation for remote teams.

Responsibilities

• Platform Development: Build and maintain the shared Python libraries and configuration-driven frameworks for onboarding and running pipelines.
• CI/CD & Infrastructure as Code: Own GitHub Actions pipelines and release process; extend Terraform coverage of Azure and Databricks infrastructure.
• Operations, Reliability & Recovery: Support production platform, improve observability, triage incidents, conduct root cause analysis, and create runbooks.
• Security & Governance: Maintain platform and data controls with Unity Catalog and support data protection in healthcare environment.
• Domain Enablement: Partner with domain teams to onboard data sources and convert recurring needs into self-service features.

Skills

Python

DevOps

Communication

Education

Bachelor's degree or equivalent practical experience

Tools

Azure Databricks

Terraform

Unity Catalog

Delta Lake

GitHub Actions

Job description

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.

Position Summary

We are looking for a Senior Data Platform Engineer to help build, run, and evolve our Azure Databricks data platform, which ingests, validates, and protects data for the business domain data engineering teams. We run the platform like a software product: domain teams onboard through configuration, shared Python frameworks handle ingestion, data quality, monitoring, and data protection, and every change ships through code review, automated testing, and CI/CD. This is not a pure data pipeline role. We want an engineer with software engineering and DevOps discipline and enough data engineering experience to understand what our users need. As the team shifts toward operations, experience running production systems is highly valued.

We will consider remote in the US for this role.

Responsibilities

• Platform Development: Build and maintain the shared Python libraries and configuration‑driven frameworks that let domain teams onboard and run their pipelines with minimal platform help.
• CI/CD & Infrastructure as Code: Own the GitHub Actions pipelines and release process that promote Databricks Asset Bundles from sandbox to production, and extend Terraform coverage of our Azure and Databricks infrastructure.
• Operations, Reliability & Recovery: Support the production platform, build enhanced observability, triage incidents, lead root cause analysis, and turn lessons learned into runbooks, automation, and permanent fixes. Track performance, reliability and delivery metrics from a data and platform perspective.
• Security & Governance: Maintain necessary platform and data controls with Unity Catalog, and support sensitive data protection and governance in a regulated healthcare environment.
• Domain Enablement: Partner with domain teams to onboard data sources, resolve escalated issues, and turn recurring needs into self‑service features.

Required Experience

• 3+ years progressive in software, platform, DevOps/SRE, or data engineering, including: 2+ years building or operating cloud data platforms or production data systems.
• Software Engineering & CI/CD: Strong Python skills (packaging, modular and testable code, pytest), Git‑based code review, and proven experience building CI/CD pipelines (GitHub Actions preferred) for multi‑environment deployments.
• Infrastructure as Code: Hands‑on Terraform experience managing Azure and Databricks resources.
• Data Engineering: Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, medallion data modeling, and data quality validation.
• Databricks & Azure: Practical experience with Delta Lake, Unity Catalog, Jobs, and Delta Live Tables / Lakeflow (Asset Bundles and system tables a plus), and working knowledge of ADLS Gen2, Entra ID, Key Vault, and cloud networking.
• Operations: Experience supporting production systems in a DevOps, SRE, or platform role: monitoring and alerting, incident response, on‑call, root cause analysis, runbooks, and disaster recovery planning.
• Communication: Clear communication and documentation, and the ability to work well on a remote team with technical and business stakeholders.

Preferred Qualifications

6+ years progressive in software, platform, DevOps/SRE, or data engineering, Disciplined use of AI to accelerate development and analysis, with the same engineering rigor and ownership of AI‑assisted work as any other work shipped Familiarity with healthcare payer data (X12 834/837, HL7) and HIPAA; HITRUST experience a plus Databricks or Azure certifications Education Bachelor's degree or equivalent practical experience.

Education

Bachelor's degree or equivalent practical experience.

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is: $101,970.00 - $203,940.00 This pay range represents the base hourly rate or base annual full‑time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families. This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility. Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 11/29/2026.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.

Our Work Experience is the combination of everything that's unique about us: our culture, our core values, our company meetings, our commitment to sustainability, our recognition programs, but most importantly, it's our people. Our employees are self-disciplined, hard working, curious, trustworthy, humble, and truthful. They make choices according to what is best for the team, they live for opportunities to collaborate and make a difference, and they make us the #1 Top Workplace in the area.