Senior Observability Platform Engineer — Scale & Telemetry

Idaho Society of Professional Engineers; Idaho; Hybrid; USD 120,000 - 210,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Paid time off

Retirement savings options

Wellness programs

Job summary

CVS Health Enterprise Technology is seeking a Senior Observability Platform Engineer to design, build, and operate large-scale observability services that process billions of logs, metrics, and traces daily. You will develop high-performance backend services using Go, Python, and Java, and lead the adoption of OpenTelemetry-based instrumentation and standards across the enterprise.

In this role you will partner with SRE, Cloud Engineering, CI/CD, Infrastructure, Digital Security, and application

Qualifications

• 5+ years of software engineering experience.
• 3+ years of observability practices, including SLIs/SLOs/SLAs, alerting and incident management.
• 3+ years building production-grade backend services in Go and/or Java.
• 3+ years implementing and operating OpenTelemetry.
• 3+ years with cloud-native and containerized platforms (Docker, Kubernetes, Argo CD).
• 3+ years with public cloud platforms (AWS, GCP, or Azure).
• 2+ years designing and scaling distributed, high-volume data pipelines.
• 2+ years with Infrastructure as Code tools like Terraform or CloudFormation.
• 2+ years with Helm/charts, Kustomize, etc.
• 2+ years working with Grafana OSS or comparable backends (Grafana, Loki, Tempo, Mimir).
• 2+ years with relational databases (PostgreSQL, MySQL).

Responsibilities

• Develop custom observability platform software using Java Spring Boot, Python, Go, and related technologies.
• Design, build, and operate core observability platform services.
• Lead OpenTelemetry adoption across the enterprise, including libraries, conventions, instrumentation patterns, and Collector/agent strategy.
• Scale high-throughput telemetry pipelines with emphasis on performance, reliability, and cost efficiency.
• Develop self-service observability capabilities to simplify onboarding and troubleshooting for app teams.
• Implement end-to-end monitoring of the observability platform, defining SLOs, health checks and alerting.
• Collaborate with SRE, Platform, and Cloud teams to establish reliability standards and incident response practices.
• Participate in on-call rotations and lead incident mitigation and post-incident reviews.
• Automate operational workflows and reduce toil via CI/CD enhancements and platform automation.
• Ensure secure telemetry pipelines with mTLS, secrets management, and zero-trust patterns.
• Produce and maintain high-quality technical documentation, standards, and best practices.
• Engage with internal teams to gather requirements, influence roadmaps, and deliver platform improvements.
• Provide technical leadership through mentorship and architectural guidance across teams.

Skills

Software Engineering

Observability

Go / Java backend

OpenTelemetry

Cloud platforms

Data pipelines

Terraform / CloudFormation

Kubernetes / Helm

Grafana

PostgreSQL / MySQL

Education

Bachelor's degree

Tools

Docker

Kubernetes

Argo CD

Terraform

CloudFormation

Helm

Kustomize

Grafana

PostgreSQL

MySQL

Job description

CVS Health Enterprise Technology is seeking a Senior Observability Platform Engineer to design, build, and operate large-scale observability services that process billions of logs, metrics, and traces daily. You will develop high-performance backend services using Go, Python, and Java, and lead the adoption of OpenTelemetry-based instrumentation and standards across the enterprise.

In this role you will partner with SRE, Cloud Engineering, CI/CD, Infrastructure, Digital Security, and application