Senior Data Engineer, Observability Lakehouse (Databricks)

9025 CVS Shared Services Resources LLC; Town of Texas (WI); Hybrid; USD 118,000 - 237,000; Full time

Job summary

CVS Health is seeking a highly skilled Staff Data Engineer, Observability Engineering to join the Enterprise Observability Platform and help advance observability, infrastructure, and security data capabilities across the organization.

The role focuses on designing, building, and operating scalable Databricks-based data pipelines and lakehouse solutions, with emphasis on data quality, governance, and performance.

Qualifications

• 7+ years building and supporting enterprise data engineering solutions using Python, Spark, PySpark, SQL, and distributed data processing technologies.
• 6+ years designing, developing, and operating large-scale data pipelines across multiple data sources.
• 5+ years working with Databricks in production environments, including Delta Lake, Unity Catalog, and platform operations.
• 4+ years developing high-volume batch and streaming data solutions with data quality controls and reliability.
• 2+ years collaborating with engineering teams, code reviews, and communicating technical solutions.

Responsibilities

• Design, build, deploy, and support scalable Databricks-based data pipelines and lakehouse solutions ingesting data from multiple sources.
• Develop and optimize PySpark workloads, Structured Streaming, and bronze/silver/gold architectures for performance and data quality.
• Partner with Security, Infrastructure, Observability, and Platform Engineering to onboard data sources and establish governance standards.
• Contribute to engineering standards, CI/CD practices, monitoring strategies, and addressing technical debt and risks.
• Promote best practices for Databricks, Delta Lake, Unity Catalog, and cost-efficient data platform operations.

Skills

Python

Spark

PySpark

SQL

Data pipelines

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Unity Catalog

Job description

CVS Health is seeking a highly skilled Staff Data Engineer, Observability Engineering to join the Enterprise Observability Platform and help advance observability, infrastructure, and security data capabilities across the organization.

The role focuses on designing, building, and operating scalable Databricks-based data pipelines and lakehouse solutions, with emphasis on data quality, governance, and performance.