Staff Data Engineer (Azure Databricks Platform)

CVS Health; New York (NY); Presencial; USD 130.000 - 261.000; Jornada completa

Descripción de la vacante

CVS Health is seeking a Staff Data Engineer to lead the Azure Databricks platform, including administration, job orchestration, security, and governance. You will drive architecture decisions and mentor two platform engineers.

You will optimize costs, implement IaC with Terraform, collaborate with data and security teams, and shape a scalable data platform across the enterprise.

Formación

• Experience with cloud data platforms, distributed systems, and data engineering.
• Hands-on Azure Databricks administration, cluster management, and job orchestration.
• Strong Terraform and CI/CD experience for platform deployments.
• Proven ability to lead platform engineering and mentor teams.

Responsabilidades

• Oversee operational health of the Azure Databricks platform and incident responses.
• Define the platform roadmap and adopt new features and best practices.
• Manage Unity Catalog for data governance and access control.
• Optimize cost and performance of Databricks workloads.
• Maintain IaC (Terraform) and CI/CD pipelines for deployments.
• Mentor data engineers and develop reusable patterns and libraries.
• Collaborate with data, security, and infrastructure teams.
• Lead and direct two platform engineers.

Conocimientos

Azure Databricks

Python

SQL

Apache Spark / PySpark

Shell scripting

Terraform

CI/CD pipelines

Distributed systems

Problem-solving

Communication

Educación

Bachelor's or Master's degree in CS/Engineering

Azure Solutions Architect Expert

Databricks Certified Data Engineer Professional

Databricks Certified Platform Administrator

Herramientas

Databricks Workflows

Unity Catalog

Delta Lake

GitHub

Azure Data Lake Storage

Descripción del empleo

Position SummaryStaff Data Engineer-Azure Databricks Platform

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.

Responsibilities

• Operational Excellence: Oversee the operational health of the platform. Maintain andenhance monitoring, logging, and alerting solutions to proactively identify and resolveissues. Lead incident response and perform root cause analysis for platform-wideproblems.
• Platform Architecture & Strategy: Maintain and enhance the core components of ourAzure Databricks environment. Define the strategic roadmap for the platform, includingthe adoption of new features, services, and best practices (e.g., Delta Lake, UnityCatalog, Databricks Workflows. Github CI/CD).
• Security & Governance: Manage the enforcement and enhancement of data securityand governance policies. Manage the Unity Catalog to ensure fine-grained accesscontrol, data lineage, and compliance with internal and external regulations.
• Performance & Cost Optimization: Implement strategies for cost management andperformance tuning at a platform level. Provide guidance and tooling to optimizeDatabricks clusters and workloads to maximize efficiency and minimize cloud spend.
• Tooling & Automation: Maintain and enhance automated solutions for provisioning,scaling, and managing Databricks workspaces and resources using Infrastructure asCode (Terraform) and CI/CD pipelines (GitHub).
• Developer Enablement: Serve as a subject matter expert and mentor to other dataengineers and Azure databricks platform engineers. Develop and advocate for bestpractices, create reusable patterns and libraries, and provide expert-level technicalsupport and training to data teams.
• Cross-Functional Collaboration: Partner with data engineering and business teams tounderstand their needs and maintain and enhance a platform that empowers them. Workwith security, networking, and other infrastructure teams to ensure a cohesive andsecure environment.
• Leading the Platform Engineers: Overseeing and directing the efforts of 2 platformengineers.

Required Skills

• Experience: 8+ years of experience in a hands-on engineering role with a focus oncloud data platforms, distributed systems, and data engineering.
• Azure Databricks Expertise: Deep, hands-on experience with the Azure Databricksplatform, including its administration, cluster management, job orchestration, and keyfeatures like Delta Lake and Unity Catalog.
• Cloud Proficiency: Expert-level knowledge of the Azure ecosystem, including AzureData Lake Storage (ADLS), Azure Active Directory (AAD), and networking components.
• Programming & Scripting: Strong proficiency in Terraform, Python, ApacheSpark/PySpark, SQL, and Shell scripting.
• Infrastructure as Code & CI/CD: Proven experience with Infrastructure as Code tools(e.g., Terraform) and building automated CI/CD pipelines for platform and dataapplication deployments.
• Distributed Systems: A strong understanding of distributed computing principles andthe architecture of large-scale data systems.
• Problem-Solving: Exceptional analytical and problem-solving skills with a track recordof diagnosing and resolving complex, platform-level issues.
• Communication: Excellent communication, documentation, and presentation skills, withthe ability to influence technical and business stakeholders.

Preferred Skills

• Experience with other data technologies (e.g., Azure Synapse, Kafka, Snowflake).
• Familiarity with healthcare data and healthcare insurance feeds is a significant plus.

Education

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert,Databricks Certified Data Engineer Professional, and Databricks Certified PlatformAdministrator

Pay Range

The typical pay range for this role is:$130,295.00 - $260,590.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. This position also includes an award target in the company’s equity award program.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great peopleWe take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families. This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility. Additional details about available benefits are provided during the application process and on

We anticipate the application window for this opening will close on: 11/13/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.