Senior Data Engineer, Observability & Databricks

CVS Health Corporation; Austin (TX); On-site; USD 118,000 - 237,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

paid time off

Retirement options

Job summary

CVS Health is seeking a Staff Data Engineer, Observability Engineering to advance scalable data pipelines and observability data capabilities across the enterprise.

You will design and operate Databricks-based solutions ingesting telemetry, infrastructure, and security data, while driving performance, governance, and reliability. This senior role emphasizes engineering excellence and practical data platform delivery.

Qualifications

• 7+ years building and supporting enterprise data engineering solutions using Python, Spark, PySpark, SQL, and distributed data processing technologies.
• 6+ years designing, developing, and operating large-scale data pipelines across multiple data sources.
• 5+ years with Databricks in production environments, including Delta Lake, Unity Catalog, and platform operations.
• 4+ years developing high-volume batch and streaming data solutions with data quality controls.

Responsibilities

• Design, build, deploy, and support scalable Databricks-based data pipelines and lakehouse solutions ingesting observability, infrastructure, and security data.
• Develop and optimize PySpark workloads, Structured Streaming, and bronze/silver/gold architectures for performance and reliability.
• Partner with Security, Infrastructure, Observability, and Platform Engineering to onboard data sources and govern enterprise data products.
• Contribute to engineering standards, code reviews, CI/CD, monitoring, and platform optimization while addressing technical debt and risks.
• Promote best practices for Databricks, Delta Lake, Unity Catalog, and cost-efficient data platform operations.

Skills

Python

Spark

PySpark

SQL

Distributed processing

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Unity Catalog

Databricks Asset Bundles

GitHub Actions

Azure DevOps

Job description

CVS Health is seeking a Staff Data Engineer, Observability Engineering to advance scalable data pipelines and observability data capabilities across the enterprise.

You will design and operate Databricks-based solutions ingesting telemetry, infrastructure, and security data, while driving performance, governance, and reliability. This senior role emphasizes engineering excellence and practical data platform delivery.