Senior Observability Platform Engineer — Scale & Lead

Koitecc Solutions; Virginia (MN); On-site; USD 107,000 - 284,000; Full time

Job summary

CVS Health Enterprise Technology is seeking a Lead Cloud Engineer to shape the Observability Platform, handling billions of logs, metrics, and traces across public clouds and datacenters. You’ll collaborate with SRE and application teams to drive reliability and adoption of OpenTelemetry.

You’ll mentor engineers, design scalable pipelines, and own end-to-end monitoring, security, and performance improvements in a Fortune 6 environment.

Qualifications

• 7+ years of Software Engineering experience.
• 5+ years with observability practices (SLIs/SLOs/SLAs, alerting, incident management).
• 5+ years building production-grade backend services in Go and/or Java.
• 5+ years implementing and operating OpenTelemetry (OTLP, conventions, instrumentation).
• 5+ years with cloud-native/container platforms (Docker, Kubernetes, Argo CD).
• 5+ years with public cloud platforms (AWS, GCP, or Azure).
• 3+ years designing and scaling distributed, high-volume data pipelines.
• 3+ years with Helmcharts, Kustomize, etc.
• 3+ years with Grafana OSS or equivalents (Grafana, Loki, Tempo, Mimir).
• 3+ years with IaC tools such as Terraform or CloudFormation.
• 3+ years with relational databases (PostgreSQL, MySQL).

Responsibilities

• Design, build, and operate core observability platform services using Go, Python, Java (Spring Boot)
• Lead enterprise-wide adoption of OpenTelemetry, including client libraries, semantic conventions, instrumentation patterns, and Collector/agent strategy
• Architect and scale high-throughput, fault-tolerant telemetry pipelines (logs, metrics, traces) with a focus on performance, reliability, and cost efficiency
• Develop self-service observability capabilities that simplify onboarding, troubleshooting, and adoption for application teams
• Implement end-to-end monitoring of the observability platform itself, defining SLOs, health checks, and alerting
• Collaborate with SRE, Platform, and Cloud teams to establish reliability standards, error budgets, and incident response practices
• Participate in on‑call rotations and lead incident mitigation, root‑cause analysis, and post‑incident reviews
• Automate operational workflows and eliminate manual toil through tooling, CI/CD enhancements, and platform automation
• Ensure secure telemetry pipelines through mTLS, secrets management, and zero-trust design patterns
• Produce and maintain high-quality technical documentation, standards, and best practices
• Engage with internal engineering teams to gather requirements, influence roadmap prioritization, and deliver platform improvements
• Provide technical leadership through mentorship, design reviews, architectural guidance, and cross‑team collaboration with principal engineers and engineering leadership

Skills

Backend development (Go/Java)

OpenTelemetry

Cloud platforms (AWS/GCP/Azure)

Docker/Kubernetes

Terraform/CloudFormation

PostgreSQL/MySQL

Grafana

Helm/Kustomize

Distributed systems

Go

Java

Education

Bachelor's degree or equivalent

Tools

Argo CD

Job description

CVS Health Enterprise Technology is seeking a Lead Cloud Engineer to shape the Observability Platform, handling billions of logs, metrics, and traces across public clouds and datacenters. You’ll collaborate with SRE and application teams to drive reliability and adoption of OpenTelemetry.

You’ll mentor engineers, design scalable pipelines, and own end-to-end monitoring, security, and performance improvements in a Fortune 6 environment.