Senior Observability Platform Engineer

CVS Health; California (MO); Hybrid; USD 83,000 - 222,000; Full time

Job summary

CVS Health Enterprise Technology is expanding its Observability Platform (EOP), delivering standardized instrumentation and telemetry across on‑prem, hybrid, and multi‑cloud environments. You will design, build, and operate high‑throughput observability services using Go, Python, and Java, guiding OpenTelemetry adoption and improving developer experience across the enterprise.

You will collaborate with SRE, Cloud Engineering, CI/CD, and security teams to shape platform strategy, implement SLOs,

Qualifications

• 5+ years of experience in Software Engineering.
• 3+ years with observability practices including SLIs/SLOs/SLAs, alerting, and incident management.
• 3+ years building production‑grade backend services in Go and/or Java.
• 3+ years implementing and operating OpenTelemetry, including OTLP, semantic conventions, and instrumentation patterns.
• 3+ years with cloud‑native and containerized platforms (Docker, Kubernetes, Argo CD).
• 3+ years working with public cloud platforms (AWS, GCP, or Azure).
• 2+ years designing and scaling distributed, high‑volume data pipelines.
• 2+ years of experience with Infrastructure as Code tools such as Terraform or CloudFormation.
• 2+ years of experience with Helmcharts, Kustomize etc
• 2+ years working with Grafana OSS or comparable observability backends (e.g., Grafana, Loki, Tempo, Mimir)
• 2+ years with relational databases (PostgreSQL, MySQL)

Responsibilities

• Develop custom software to drive the observability platform using technologies such as Java Spring Boot, Python, Go-lang etc
• Design, build, and operate core observability platform services using Go, Python, Java (Spring Boot)
• Support and lead enterprise-wide adoption of OpenTelemetry, including client libraries, semantic conventions, instrumentation patterns, and Collector/agent strategy
• Design, architect and scale high‑throughput, fault‑tolerant telemetry pipelines (logs, metrics, traces) with a focus on performance, reliability, and cost efficiency
• Develop self‑service observability capabilities that simplify onboarding, troubleshooting, and adoption for application teams
• Implement end‑to‑end monitoring of the observability platform itself, defining SLOs, health checks, and alerting
• Collaborate with SRE, Platform, and Cloud teams to establish reliability standards, error budgets, and incident response practices
• Participate in on‑call rotations and lead incident mitigation, root‑cause analysis, and post‑incident reviews
• Automate operational workflows and eliminate manual toil through tooling, CI/CD enhancements, and platform automation
• Ensure secure telemetry pipelines through mTLS, secrets management, and zero‑trust design patterns
• Produce and maintain high‑quality technical documentation, standards, and best practices
• Engage with internal engineering teams to gather requirements, influence roadmap prioritization, and deliver platform improvements
• Provide technical leadership through mentorship, design reviews, architectural guidance, and cross‑team collaboration with principal engineers and engineering leadership

Skills

Observability concepts

Go

Python

Java

OpenTelemetry

Docker

Kubernetes

AWS

GCP

Azure

Relational databases

Education

Bachelor's degree

Tools

Terraform

CloudFormation

Helmcharts

Kustomize

Grafana

Loki

Tempo

Mimir

PostgreSQL

MySQL

Job description

CVS Health Enterprise Technology is expanding its Observability Platform (EOP), delivering standardized instrumentation and telemetry across on‑prem, hybrid, and multi‑cloud environments. You will design, build, and operate high‑throughput observability services using Go, Python, and Java, guiding OpenTelemetry adoption and improving developer experience across the enterprise.

You will collaborate with SRE, Cloud Engineering, CI/CD, and security teams to shape platform strategy, implement SLOs,