Senior Data Engineer - Observability Lakehouse & Databricks

CVS Health Corporation; Virginia (MN); Hybrid; USD 93,000 - 222,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Retirement savings options

Paid time off

Job summary

CVS Health is seeking a Senior Data Engineer, Observability Engineering to help design, build, and operate scalable Databricks-based data pipelines and lakehouse solutions powering enterprise observability and security analytics.

You will collaborate with Observability, Security, and Platform Engineering teams, own data quality, governance, and performance optimizations, and mentor junior engineers as part of a high-impact data platform.

Qualifications

• 5+ years building enterprise data pipelines and data engineering solutions.
• 5+ years creating and operating large-scale data pipelines and lakehouse architectures.
• 4+ years using Databricks in production, including Delta Lake and Unity Catalog.
• 3+ years delivering high-volume batch and streaming data solutions with data quality controls.
• 2+ years collaborating with engineering teams and communicating technical solutions.

Responsibilities

• Design, build, deploy, and support scalable Databricks-based data pipelines and lakehouse solutions that ingest, transform, and curate observability, infrastructure, and security data from multiple enterprise sources.
• Develop and optimize PySpark workloads, Structured Streaming jobs, and bronze/silver/gold data architectures while ensuring high performance, reliability, scalability, data quality, and operational excellence.
• Partner with Security, Infrastructure, Observability, and Platform Engineering teams to onboard new data sources, establish governance standards, improve metadata management, and deliver trusted enterprise data products.
• Contribute to engineering standards, code reviews, CI/CD practices, monitoring strategies, and platform optimization efforts while proactively identifying and addressing technical debt, process gaps, and operational risks.
• Support the ongoing evolution of the enterprise observability lakehouse by promoting best practices for Databricks, Delta Lake, Unity Catalog, data governance, security controls, access management, and cost-efficient data platform operations.

Skills

Python

Spark / PySpark

SQL

Data pipelines

Structured Streaming

CI/CD

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Unity Catalog

Databricks Asset Bundles

Job description

CVS Health is seeking a Senior Data Engineer, Observability Engineering to help design, build, and operate scalable Databricks-based data pipelines and lakehouse solutions powering enterprise observability and security analytics.

You will collaborate with Observability, Security, and Platform Engineering teams, own data quality, governance, and performance optimizations, and mentor junior engineers as part of a high-impact data platform.