Remote Senior Data Platform Engineer - Azure & Databricks

CVS Health; Austin (TX); Remoto; USD 102.000 - 204.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical, dental, vision coverage

Paid time off

Retirement savings options

Wellness programs

Descrizione del lavoro

CVS Health is seeking a Senior Data Platform Engineer to build, run, and evolve an Azure Databricks data platform for multiple business teams. The role emphasizes software engineering, DevOps discipline, and production system expertise.

You will work on onboarding pipelines, CI/CD, and data governance in a regulated healthcare environment. The position offers remote flexibility within the US and a comprehensive benefits package including medical, dental, vision, PTO, and retirement options.

Competenze

• 2+ years building or operating cloud data platforms or production data systems.
• Strong Python skills (packaging, modular and testable code, pytest).
• Experience building CI/CD pipelines (GitHub Actions preferred) for multi-environment deployments.
• Hands-on Terraform experience managing Azure and Databricks resources.
• Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, data quality validation.
• Practical experience with Delta Lake, Unity Catalog, Jobs, and Delta Live Tables / Lakeflow; knowledge of ADLS Gen2, Entra ID, Key Vault, and cloud networking.
• Experience supporting production systems in a DevOps/SRE/platform role: monitoring, on-call, incident response, runbooks, disaster recovery.
• Excellent written and verbal communication; comfortable working with remote teams.

Mansioni

• Platform Development: maintain shared Python libraries and config-driven frameworks for onboarding pipelines.
• CI/CD & Infrastructure as Code: own GitHub Actions pipelines and release process; extend Terraform coverage of Azure & Databricks.
• Operations, Reliability & Recovery: support production platform, improve observability, triage incidents, root cause analysis, create runbooks.
• Security & Governance: maintain platform and data controls with Unity Catalog; protect sensitive data in healthcare.
• Domain Enablement: collaborate with domain teams to onboard data sources and build self-service features.

Conoscenze

Python

GitHub Actions

CI/CD

Spark/PySpark

SQL

Delta Lake

Unity Catalog

Delta Live Tables

ADLS Gen2

Entra ID

Key Vault

Cloud Networking

Monitoring & Incident Response

Communication

Strumenti

Terraform

Delta Lake

Unity Catalog

Delta Live Tables

ADLS Gen2

Entra ID

Key Vault

Descrizione del lavoro

CVS Health is seeking a Senior Data Platform Engineer to build, run, and evolve an Azure Databricks data platform for multiple business teams. The role emphasizes software engineering, DevOps discipline, and production system expertise.

You will work on onboarding pipelines, CI/CD, and data governance in a regulated healthcare environment. The position offers remote flexibility within the US and a comprehensive benefits package including medical, dental, vision, PTO, and retirement options.