Senior Data Platform Engineer - Azure Databricks & DataOps

CVS Health; Oregon; Ibrido; USD 102.000 - 204.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical insurance

Dental and vision coverage

Paid time off

Retirement savings options

Wellness programs

Descrizione del lavoro

CVS Health is seeking a Senior Data Platform Engineer to build and evolve an Azure Databricks data platform supporting data engineering teams. You will own CI/CD pipelines, Terraform automation, and platform governance in a regulated healthcare setting.

You will work closely with domain teams to onboard data sources, ensure data quality, and deliver self-service capabilities while maintaining robust observability and security controls.

Competenze

• 3+ years progressive in software, platform, DevOps/SRE, or data engineering.
• 2+ years building or operating cloud data platforms or production data systems.
• Strong Python skills, packaging, modular code, pytest, and Git-based review.
• Experience with Terraform and cloud data platform tooling such as Databricks.

Mansioni

• Platform Development: Build and maintain shared Python libraries and configuration-driven frameworks for onboarding and running pipelines.
• CI/CD & Infrastructure as Code: Own GitHub Actions pipelines and release processes; extend Terraform coverage of Azure and Databricks infrastructure.
• Operations, Reliability & Recovery: Support production platform; improve observability; triage incidents; runbooks and automation; monitor performance and delivery metrics.
• Security & Governance: Maintain platform and data controls with Unity Catalog; support data protection and governance in healthcare environment.
• Domain Enablement: Partner with domain teams to onboard data sources and turn recurring needs into self-service features.

Conoscenze

Python

CI/CD

Spark

PySpark

SQL

DevOps/SRE

Communication

Formazione

Bachelor's degree or equivalent practical experience

Strumenti

Terraform

GitHub Actions

Delta Lake

Unity Catalog

ADLS Gen2

Entra ID

Key Vault

Azure

Descrizione del lavoro

CVS Health is seeking a Senior Data Platform Engineer to build and evolve an Azure Databricks data platform supporting data engineering teams. You will own CI/CD pipelines, Terraform automation, and platform governance in a regulated healthcare setting.

You will work closely with domain teams to onboard data sources, ensure data quality, and deliver self-service capabilities while maintaining robust observability and security controls.