Senior Databricks Data Engineer Observability Lakehouse

CVS Health Corporation; Illinois; Hybrid; USD 93,000 - 222,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Paid time off

Retirement savings

Job summary

CVS Health is seeking a highly skilled Senior Data Engineer, Observability Engineering to join the Enterprise Observability Platform and advance the next generation of observability, infrastructure, and security data capabilities. You will design, build, and operate scalable data pipelines that ingest telemetry, infrastructure, and security data across the organization.

The role focuses on Databricks-based solutions, data governance, and high-performance processing, collaborating with Security,

Qualifications

• 5+ years building enterprise data engineering solutions with Python, Spark, PySpark, SQL.
• 5+ years designing large-scale data pipelines and lakehouse architectures.
• 4+ years with Databricks in production, Delta Lake, Unity Catalog, and optimization.
• 3+ years building high-volume batch/streaming data solutions with quality controls.
• 2+ years collaborating with engineering teams and governance practices.

Responsibilities

• Design, build, deploy, and support Databricks-based data pipelines and lakehouse solutions.
• Develop and optimize PySpark workloads and bronze/silver/gold architectures.
• Onboard new data sources, establish governance, and improve metadata management.
• Contribute to CI/CD, monitoring, code reviews, and platform optimization.
• Promote best practices for data governance, security controls, and cost-efficiency.

Skills

Python

Spark

PySpark

SQL

Databricks

Delta Lake

Unity Catalog

Data Pipelines

Data Quality

CI/CD

Cloud Security

Observability

Education

BachelorS degree

Job description

CVS Health is seeking a highly skilled Senior Data Engineer, Observability Engineering to join the Enterprise Observability Platform and advance the next generation of observability, infrastructure, and security data capabilities. You will design, build, and operate scalable data pipelines that ingest telemetry, infrastructure, and security data across the organization.

The role focuses on Databricks-based solutions, data governance, and high-performance processing, collaborating with Security,