Staff Data Engineer (Azure Databricks Platform)

CVS Health; Alton (IL); On-site; USD 130,000 - 261,000; Full time

Job summary

CVS Health is seeking a Staff Data Engineer to lead the Azure Databricks platform, shaping architecture and ensuring reliability, security, and scalable data solutions.

You will collaborate with data engineers, drive platform modernization, and mentor a small team while aligning with healthcare data governance and cost optimization.

Qualifications

• 8+ years in hands-on cloud data platforms, distributed systems, and data engineering.
• Deep Azure Databricks expertise including administration, cluster management, and Unity Catalog.
• Strong Azure knowledge: ADLS, AAD, and networking.
• Proficient in Terraform, Python, Spark, SQL, and Shell scripting.
• Experience with IaC and CI/CD pipelines for platform and data deployments.
• Understanding of distributed computing and large-scale data systems.
• Excellent communication and ability to influence stakeholders.

Responsibilities

• Oversee platform operational health with monitoring, logging, and alerting.
• Define roadmap for Azure Databricks platform and feature adoption.
• Manage data security and Unity Catalog governance and compliance.
• Optimize performance and cloud spend of Databricks workloads.
• Maintain IaC and CI/CD for provisioning and deployment.
• Mentor data engineers and promote best practices.
• Collaborate with security, networking, and other infra teams.
• Lead and direct two platform engineers.

Skills

Azure Databricks

Terraform

Python

Spark/PySpark

SQL

Shell scripting

Distributed systems

Communication

Education

Bachelor's or Master’s in CS/Engineering

Databricks Certified Data Engineer Professional

Databricks Certified Platform Administrator

Microsoft Certified: Azure Solutions Architect Expert

Tools

Delta Lake

Unity Catalog

Databricks Workflows

GitHub CI/CD

ADLS

AAD

Terraform (IaC)

Job description

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.

Position Summary

Staff Data Engineer-Azure Databricks Platform

We’re looking for a highly skilled Platform Staff Engineer to lead the development and maintenance of our Databricks platform, supporting our healthcare delivery initiatives. You will be a hands‑on leader, responsible for the architecture, implementation, and operational excellence of our data platform. You will be responsible for ensuring the platform's reliability, performance, and security, while also driving its strategic evolution to meet future business needs. This position requires a blend of deep technical expertise, a proactive mindset, and a commitment to operational excellence. This role sits at the intersection of platform engineering, cloud engineering, data governance, and developer enablement, requiring a blend of deep technical expertise, strategic thinking, and a passion for building scalable, reliable, and secure systems. You will be a trusted partner for our data engineers ensuring they have the tools and best practices to drive business value.

Responsibilities

• Operational Excellence: Oversee the operational health of the platform. Maintain and enhance monitoring, logging, and alerting solutions to proactively identify and resolve issues. Lead incident response and perform root cause analysis for platform-wide problems.
• Platform Architecture & Strategy: Maintain and enhance the core components of our Azure Databricks environment. Define the strategic roadmap for the platform, including the adoption of new features, services, and best practices (e.g., Delta Lake, Unity Catalog, Databricks Workflows. Github CI/CD).
• Security & Governance: Manage the enforcement and enhancement of data security and governance policies. Manage the Unity Catalog to ensure fine‑grained access control, data lineage, and compliance with internal and external regulations.
• Performance & Cost Optimization: Implement strategies for cost management and performance tuning at a platform level. Provide guidance and tooling to optimize Databricks clusters and workloads to maximize efficiency and minimize cloud spend.
• Tooling & Automation: Maintain and enhance automated solutions for provisioning, scaling, and managing Databricks workspaces and resources using Infrastructure as Code (Terraform) and CI/CD pipelines (GitHub).
• Developer Enablement: Serve as a subject matter expert and mentor to other data engineers and Azure databricks platform engineers. Develop and advocate for best practices, create reusable patterns and libraries, and provide expert‑level technical support and training to data teams.
• Cross-Functional Collaboration: Partner with data engineering and business teams to understand their needs and maintain and enhance a platform that empowers them. Work with security, networking, and other infrastructure teams to ensure a cohesive and secure environment.
• Leading the Platform Engineers: Overseeing and directing the efforts of 2 platform engineers.

Required Skills

• Experience: 8+ years of experience in a hands‑on engineering role with a focus on cloud data platforms, distributed systems, and data engineering.
• Azure Databricks Expertise: Deep, hands‑on experience with the Azure Databricks platform, including its administration, cluster management, job orchestration, and key features like Delta Lake and Unity Catalog.
• Cloud Proficiency: Expert‑level knowledge of the Azure ecosystem, including Azure Data Lake Storage (ADLS), Azure Active Directory (AAD), and networking components.
• Programming & Scripting: Strong proficiency in Terraform, Python, Apache Spark/PySpark, SQL, and Shell scripting.
• Infrastructure as Code & CI/CD: Proven experience with Infrastructure as Code tools (e.g., Terraform) and building automated CI/CD pipelines for platform and data application deployments.
• Distributed Systems: A strong understanding of distributed computing principles and the architecture of large‑scale data systems.
• Problem- Solving: Exceptional analytical and problem‑solving skills with a track record of diagnosing and resolving complex, platform‑level issues.
• Communication: Excellent communication, documentation, and presentation skills, with the ability to influence technical and business stakeholders.

Preferred Skills

• Experience with other data technologies (e.g., Azure Synapse, Kafka, Snowflake).
• Familiarity with healthcare data and healthcare insurance feeds is a significant plus.

Education

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert, Databricks Certified Data Engineer Professional, and Databricks Certified Platform Administrator.

Pay Range

The typical pay range for this role is:

$130,295.00 - $260,590.00

This pay range represents the base hourly rate or base annual full‑time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short‑term incentive program in addition to the base pay range listed above. This position also includes an award target in the company’s equity award program.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

• This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families.
• The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.
• Additional details about available benefits are provided during the application process and on Benefits Moments .

We anticipate the application window for this opening will close on: 11/13/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.