Senior Data Platform Architect: Multi-Cloud Databricks

CVS Health; Washington (District of Columbia); Hybrid; USD 144,000 - 288,000; Full time

Job summary

CVS Health is seeking a Principal Engineer, Data Platforms to lead the architecture and evolution of a cloud‑native data platform handling hundreds of terabytes daily across Azure, AWS, and GCP. You will own the Databricks strategy, drive IaC/Policy‑as‑Code, and guide governance, security, and reliability efforts enterprise‑wide.

The role focuses on unifying observability, security, and telemetry platforms, enabling AI/ML workloads while delivering scalable, cost‑efficient data platform services

Qualifications

• 10+ years of experience architecting, building, and operating enterprise‑scale cloud data platforms.
• 8+ years of experience designing and administering Databricks platforms, including Unity Catalog and governance.
• 8+ years of experience implementing Infrastructure‑as‑Code and CI/CD pipelines using Terraform, GitHub Actions, or similar tools.
• 7+ years designing high‑scale streaming and telemetry ingestion architectures (Kafka, Kinesis, etc.).
• 5+ years leading enterprise platform strategy and multi‑cloud initiatives across Azure, AWS, and GCP.

Responsibilities

• Define and own architecture and multi‑year roadmap for the Unified Ingestion Platform and Federated Data Lake.
• Scale ingestion to 250+ TB per day across logs, metrics, traces, and security events.
• Govern Databricks architecture including multi‑cloud account structures and Unity Catalog.
• Lead IaC, Policy‑as‑Code, and automated provisioning with CI/CD pipelines.
• Set security, governance, observability, and operational excellence standards.

Skills

Enterprise data platforms

Databricks architecture

IaC & CI/CD automation

Streaming ingestion architectures

Multi-cloud strategy (Azure, AWS, GCP)

Education

Bachelor's degree

Tools

Databricks

Terraform

GitHub Actions

Unity Catalog

OpenTelemetry (OTEL)

Job description

CVS Health is seeking a Principal Engineer, Data Platforms to lead the architecture and evolution of a cloud‑native data platform handling hundreds of terabytes daily across Azure, AWS, and GCP. You will own the Databricks strategy, drive IaC/Policy‑as‑Code, and guide governance, security, and reliability efforts enterprise‑wide.

The role focuses on unifying observability, security, and telemetry platforms, enabling AI/ML workloads while delivering scalable, cost‑efficient data platform services