Remote Senior Data Platform Engineer (Azure Databricks)

CVS Health; Phoenix (AZ); Remoto; USD 102.000 - 204.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical, dental, and vision coverage

Retirement savings options

Paid time off

Wellness programs

Descrizione del lavoro

CVS Health is seeking a Senior Data Platform Engineer to build, run, and evolve our Azure Databricks data platform that ingests, validates, and protects data for business domain teams. The team treats the platform like a software product with configuration onboarding, Python frameworks, testing, and CI/CD.

This role emphasizes software engineering discipline and production operations, with remote US options and strong emphasis on reliability, security, and governance in a regulated healthcare

Competenze

• ~2+ years building or operating cloud data platforms or production data systems.
• ~ Software Engineering & CI/CD: Strong Python skills (packaging, modular and testable code, pytest), Git-based code review, and proven experience building CI/CD pipelines for multi-environment deployments.
• ~ Infrastructure as Code: Hands-on Terraform experience managing Azure and Databricks resources.
• ~ Data Engineering: Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, medallion data modeling, and data quality validation.
• ~ Databricks & Azure: Practical experience with Delta Lake, Unity Catalog, Jobs, and Delta Live Tables, and knowledge of ADLS Gen2, Entra ID, Key Vault, and cloud networking.
• ~ Operations: Experience supporting production systems in a DevOps, SRE, or platform role: monitoring and alerting, incident response, on-call, root cause analysis, runbooks, and disaster recovery planning.
• ~ Clear communication and documentation, and ability to work well on a remote team with technical and business stakeholders.

Mansioni

• Build and operate cloud data platform components and pipelines.
• Own CI/CD pipelines and release process for multi-environment deployments.
• Provide production support, observability, incident triage, and runbooks creation.
• Maintain platform security and governance with Unity Catalog and cloud-native controls.
• Collaborate with domain teams to onboard data sources and deliver self-service features.

Conoscenze

Cloud data platforms

Python & CI/CD

Terraform

Spark/PySpark

Delta Lake

ADLS Gen2

Entra ID

Key Vault

DevOps / SRE

Strumenti

GitHub Actions

Terraform

Databricks

Azure

Delta Live Tables

Descrizione del lavoro

CVS Health is seeking a Senior Data Platform Engineer to build, run, and evolve our Azure Databricks data platform that ingests, validates, and protects data for business domain teams. The team treats the platform like a software product with configuration onboarding, Python frameworks, testing, and CI/CD.

This role emphasizes software engineering discipline and production operations, with remote US options and strong emphasis on reliability, security, and governance in a regulated healthcare