Senior Data Engineer, Observability & Databricks Lakehouse

Koitecc Solutions; Maryland; Hybrid; USD 93,000 - 222,000; Full time

Job summary

CVS Health is seeking a Senior Data Engineer, Observability Engineering to design and operate scalable Databricks-based data pipelines powering enterprise observability and security analytics. You will transform high-volume telemetry and infrastructure data into trusted data products with a strong emphasis on governance and performance.

You will collaborate across Security, Infra, Observability, and Platform teams to onboard data sources, optimize pipelines, and uphold engineering excellence.

Qualifications

• 5+ years building enterprise data pipelines in Python/Spark.
• Experience designing/operating large-scale data pipelines across multiple sources.
• Strong Databricks experience including Delta Lake and Unity Catalog.

Responsibilities

• Design, build, deploy, and support Databricks-based data pipelines and lakehouse solutions.
• Develop PySpark workloads and structured streaming for observability data.
• Collaborate with Security, Infra, Observability, and Platform teams to onboard data sources.
• Contribute to standards, code reviews, CI/CD, monitoring, and platform optimization.
• Promote data governance, access controls, and cost-efficient operations.

Skills

Python

Spark / PySpark

SQL

Distributed data processing

Databricks

Data engineering

Education

Bachelor's degree in Computer Science / related field

Tools

Delta Lake

Unity Catalog

GitHub Actions

Azure DevOps

Job description

CVS Health is seeking a Senior Data Engineer, Observability Engineering to design and operate scalable Databricks-based data pipelines powering enterprise observability and security analytics. You will transform high-volume telemetry and infrastructure data into trusted data products with a strong emphasis on governance and performance.

You will collaborate across Security, Infra, Observability, and Platform teams to onboard data sources, optimize pipelines, and uphold engineering excellence.