Senior Observability Data Engineer - Databricks

CVS Health Corporation; United States; Remote; USD 118,000 - 237,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Paid time off

Retirement savings options

Wellness programs

Job summary

CVS Health Corporation is seeking a Staff Data Engineer, Observability Engineering to design and operate scalable Databricks-based data pipelines powering enterprise observability, security analytics, and operational intelligence. You will own data ingestion, transformation, governance and delivery of high-volume telemetry data across multiple sources.

The role emphasizes engineering excellence, reliability, performance optimization, and collaboration with Security, Infrastructure,

Qualifications

• 7+ years of experience building and supporting enterprise data engineering solutions.
• 6+ years designing, developing, and operating large-scale data pipelines across multiple sources.
• 5+ years working with Databricks in production, including Delta Lake and Unity Catalog.
• 4+ years developing high-volume batch and streaming data solutions with quality controls.
• 2+ years collaborating with engineering teams and communicating to stakeholders.

Responsibilities

• Design, build, deploy, and support scalable Databricks-based data pipelines and lakehouse solutions that ingest, transform, and curate observability, infrastructure, and security data from multiple enterprise sources.
• Develop and optimize PySpark workloads, Structured Streaming jobs, and bronze/silver/gold data architectures with reliability and data quality.
• Partner with Security, Infrastructure, Observability, and Platform Engineering to onboard sources and establish governance standards.
• Contribute to engineering standards, code reviews, CI/CD practices, monitoring, and platform optimization.
• Promote best practices for Databricks, Delta Lake, Unity Catalog, data governance, and cost-efficient operations.

Skills

Python

Spark

PySpark

SQL

Data pipelines

Education

Bachelor’s degree

Tools

Databricks

Delta Lake

Unity Catalog

Databricks Asset Bundles

GitHub Actions

Job description

CVS Health Corporation is seeking a Staff Data Engineer, Observability Engineering to design and operate scalable Databricks-based data pipelines powering enterprise observability, security analytics, and operational intelligence. You will own data ingestion, transformation, governance and delivery of high-volume telemetry data across multiple sources.

The role emphasizes engineering excellence, reliability, performance optimization, and collaboration with Security, Infrastructure,