Senior Data Engineer, Observability Platform (Databricks)

Koitecc Solutions; Connecticut; On-site; USD 93,000 - 222,000; Full time

Job summary

CVS Health is seeking a Senior Data Engineer, Observability Engineering to design, build, and operate scalable Databricks-based data pipelines powering enterprise observability and security analytics.

The role combines hands-on engineering with ownership of reliability, performance, and data platform best practices, working across Security, Infrastructure, Observability, and Platform teams.

Qualifications

• 5+ years building and supporting enterprise data engineering solutions using Python, Spark, PySpark, SQL.
• 5+ years designing, developing, and operating large-scale data pipelines across multiple sources.
• 4+ years working with Databricks in production, including Delta Lake and Unity Catalog.
• 3+ years developing high-volume batch and streaming data solutions with quality controls.
• 2+ years collaborating with engineering teams and communicating with stakeholders.

Responsibilities

• Design, build, deploy, and support Databricks-based data pipelines and lakehouse solutions.
• Develop and optimize PySpark workloads, Structured Streaming, and data architectures.
• Onboard new data sources, establish governance, and deliver trusted data products.
• Contribute to standards, code reviews, CI/CD, monitoring, and platform optimization.
• Promote best practices for Databricks, Unity Catalog, and data governance within the lakehouse.

Skills

Python

Spark / PySpark

SQL

Data pipelines

Data engineering

Education

Bachelor's degree or equivalent

Tools

Databricks

Delta Lake

Unity Catalog

Databricks Asset Bundles

GitHub Actions

Job description

CVS Health is seeking a Senior Data Engineer, Observability Engineering to design, build, and operate scalable Databricks-based data pipelines powering enterprise observability and security analytics.

The role combines hands-on engineering with ownership of reliability, performance, and data platform best practices, working across Security, Infrastructure, Observability, and Platform teams.