Azure Databricks Platform Lead — Equity & Impact

CVS Health; United States; Remote; USD 130,000 - 261,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Paid time off

Retirement savings

Wellness programs

Equity award program

Job summary

CVS Health is seeking a Staff Data Engineer to lead our Azure Databricks platform. You will own architecture, deployment, and operation of the data platform, driving performance, security, and cost-efficiency while enabling data engineers across the organization.

You will mentor platform engineers, implement Delta Lake/U​​Unity Catalog, and partner with security, networking, and business teams to deliver scalable data solutions that support healthcare initiatives.

Qualifications

• 8+ years in cloud data platforms, distributed systems, and data engineering.
• Deep hands-on Azure Databricks administration, clustering, and job orchestration.
• Strong Terraform, Python, Spark/PySpark, SQL, and Shell scripting skills.

Responsibilities

• Oversee operational health of the Databricks platform and incident response.
• Define platform architecture and roadmaps, adopting Delta Lake and Unity Catalog.
• Enforce data security and governance policies across Unity Catalog and data products.
• Optimize performance and cloud spend for Databricks workloads.
• Lead tooling/automation for provisioning, scaling, and CI/CD pipelines.
• Mentor data engineers and promote best practices across teams.
• Collaborate with security, networking, and infrastructure teams.

Skills

Azure Databricks

Terraform

Python

SQL

Spark

CI/CD

Security

Education

Bachelor's or Master's in CS/Engineering

Tools

Delta Lake

Unity Catalog

GitHub CI/CD

Databricks Admin

Job description

CVS Health is seeking a Staff Data Engineer to lead our Azure Databricks platform. You will own architecture, deployment, and operation of the data platform, driving performance, security, and cost-efficiency while enabling data engineers across the organization.

You will mentor platform engineers, implement Delta Lake/U​​Unity Catalog, and partner with security, networking, and business teams to deliver scalable data solutions that support healthcare initiatives.