Senior Observability Platform Engineer – Scale & Telemetry

CVS Health; Town of Vermont (WI); Hybrid; USD 83,000 - 222,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Paid time off

Retirement savings options

Wellness programs

Job summary

CVS Health Enterprise Technology is seeking a Senior Observability Platform Engineer to design, build, and operate large-scale observability services that process logs, metrics, and traces daily.

You will develop back-end services using Go, Python, and Java (Spring Boot), lead OpenTelemetry-based instrumentation, and collaborate with SRE, Cloud, CI/CD, and Infrastructure teams to improve reliability, performance, and cost efficiency across CVS Health environments.

Qualifications

• 5+ years of software engineering experience.
• 3+ years with observability practices (SLIs/SLOs/SLAs) and incident management.
• 3+ years building production backend services in Go and/or Java.
• 3+ years implementing OpenTelemetry and instrumentation patterns.
• 3+ years with cloud-native platforms (Docker, Kubernetes, Argo CD).
• 3+ years with public cloud platforms (AWS, GCP, or Azure).
• 2+ years designing distributed, high-volume data pipelines.
• 2+ years with Infrastructure as Code tools such as Terraform or CloudFormation.
• 2+ years with Helmcharts, Kustomize etc
• 2+ years working with Grafana OSS or comparable observability backends (Grafana, Loki, Tempo, Mimir).
• 2+ years with relational databases (PostgreSQL, MySQL).

Responsibilities

• Develop custom software to drive the observability platform using Java Spring Boot, Python, Go
• Design, build, and operate core observability platform services using Go, Python, Java (Spring Boot)
• Support and lead enterprise-wide adoption of OpenTelemetry, including client libraries, semantic conventions, instrumentation patterns, and Collector/agent strategy
• Design, architect and scale high‑throughput, fault‑tolerant telemetry pipelines (logs, metrics, traces) with a focus on performance, reliability, and cost efficiency
• Develop self‑service observability capabilities that simplify onboarding, troubleshooting, and adoption for application teams
• Implement end‑to‑end monitoring of the observability platform itself, defining SLOs, health checks, and alerting
• Collaborate with SRE, Platform, and Cloud teams to establish reliability standards, error budgets, and incident response practices
• Participate in on‑call rotations and lead incident mitigation, root‑cause analysis, and post‑incident reviews
• Automate operational workflows and eliminate manual toil through tooling, CI/CD enhancements, and platform automation
• Ensure secure telemetry pipelines through mTLS, secrets management, and zero‑trust design patterns
• Produce and maintain high‑quality technical documentation, standards, and best practices
• Engage with internal engineering teams to gather requirements, influence roadmap prioritization, and deliver platform improvements
• Provide technical leadership through mentorship, design reviews, architectural guidance, and cross‑team collaboration with principal engineers and engineering leadership

Skills

Software engineering

Observability practices

Go programming

Java development

Cloud-native platforms

OpenTelemetry

SRE collaboration

Education

Bachelor's degree in computer science or related

Tools

Java Spring Boot

Python

Go

Kubernetes

Docker

Argo CD

Terraform

Grafana

Job description

CVS Health Enterprise Technology is seeking a Senior Observability Platform Engineer to design, build, and operate large-scale observability services that process logs, metrics, and traces daily.

You will develop back-end services using Go, Python, and Java (Spring Boot), lead OpenTelemetry-based instrumentation, and collaborate with SRE, Cloud, CI/CD, and Infrastructure teams to improve reliability, performance, and cost efficiency across CVS Health environments.