Senior Data Engineer, Observability Platform

CVS Health Corporation; Washington (District of Columbia); Hybrid; USD 93,000 - 222,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision coverage

Paid time off

Job summary

CVS Health is seeking a Senior Data Engineer, Observability Engineering to design, build, and operate Databricks-based data pipelines powering enterprise observability, security analytics, and operational intelligence.

You will transform high-volume telemetry data and collaborate with Security, Infrastructure, and Platform teams to ensure governance, reliability, and cost-efficient data platform operations.

Qualifications

• 5+ years of experience building enterprise data solutions using Python, Spark, PySpark, SQL.
• 5+ years designing and operating large-scale data pipelines and bronze/silver/gold lakehouse architectures across multiple data sources.
• 4+ years working with Databricks in production environments, including Delta Lake and Unity Catalog.
• 3+ years developing high-volume batch and streaming data solutions with data quality controls and reliability.
• 2+ years collaborating with engineering teams, participating in code reviews, and communicating technical solutions to diverse stakeholders.

Responsibilities

• Design, build, deploy, and support scalable Databricks-based data pipelines and lakehouse solutions ingesting observability, infrastructure, and security data.
• Develop and optimize PySpark workloads and Structured Streaming jobs for high performance and reliability.
• Partner with Security, Infrastructure, Observability, and Platform Engineering to onboard data sources and enforce governance standards.
• Contribute to engineering standards, CI/CD practices, monitoring strategies, and platform optimization.
• Promote best practices for Databricks, Delta Lake, Unity Catalog, data governance, and access management.

Skills

Python

PySpark

SQL

Databricks

Structured Streaming

Data lakehouse

Unity Catalog

CI/CD

Education

Bachelor's degree

Tools

Databricks

GitHub Actions

Azure DevOps

Job description

CVS Health is seeking a Senior Data Engineer, Observability Engineering to design, build, and operate Databricks-based data pipelines powering enterprise observability, security analytics, and operational intelligence.

You will transform high-volume telemetry data and collaborate with Security, Infrastructure, and Platform teams to ensure governance, reliability, and cost-efficient data platform operations.