Lead Observability Platform Engineer – Scale & Reliability

Koitecc Solutions; Washington (District of Columbia); On-site; USD 107,000 - 284,000; Full time

Job summary

CVS Health Enterprise Technology is seeking a Lead Cloud Engineer to shape the Observability Platform, building scalable data pipelines for logs, metrics, and traces across multicloud and datacenters.

You will mentor teams, design high-throughput systems, and collaborate with SRE and application teams to deliver reliable platform features and secure telemetry. A strong focus on distributed systems, performance, and cost efficiency drives this role.

Qualifications

• 7+ years of experience in Software Engineering.
• 5+ years with observability practices including SLIs/SLOs/SLAs, alerting, and incident management.
• 5+ years building production-grade backend services in Go and/or Java.
• 5+ years implementing and operating OpenTelemetry, including OTLP, semantic conventions, and instrumentation patterns.
• 5+ years with cloud-native and containerized platforms (Docker, Kubernetes, Argo CD).
• 5+ years working with public cloud platforms (AWS, GCP, or Azure).
• 3+ years designing and scaling distributed, high-volume data pipelines.
• 3+ years of experience with Helmcharts, Kustomize etc.
• 3+ years working with Grafana OSS or comparable observability backends (Grafana, Loki, Tempo, Mimir).
• 3+ years of experience with Infrastructure as Code tools such as Terraform or CloudFormation.
• 3+ years with relational databases (PostgreSQL, MySQL).

Responsibilities

• Design, build, and operate core observability platform services using Go, Python, Java (Spring Boot).
• Lead enterprise-wide adoption of OpenTelemetry, including client libraries and instrumentation patterns.
• Architect and scale high-throughput telemetry pipelines (logs, metrics, traces) with focus on performance and reliability.
• Develop self-service observability capabilities for onboarding, troubleshooting, and adoption.
• Implement end-to-end monitoring of the observability platform, define SLOs and health checks.
• Collaborate with SRE, Platform, and Cloud teams to establish reliability standards and incident response practices.
• Participate in on-call rotations and lead incident mitigation and post-incident reviews.
• Automate operational workflows and reduce manual toil via CI/CD and platform tooling.
• Ensure secure telemetry pipelines through mTLS and zero-trust patterns.
• Produce and maintain high-quality technical documentation and standards.
• Engage with internal teams to gather requirements and influence roadmap prioritization.
• Provide technical leadership through mentorship and cross-team collaboration.

Skills

Go

Python

Java

OpenTelemetry

AWS

GCP

Azure

Kubernetes

Argo CD

Distributed systems

SRE collaboration

Incident management

Education

Bachelor's degree

Tools

Helmcharts

Kustomize

Terraform

CloudFormation

PostgreSQL

MySQL

Docker

Grafana OSS

Prometheus

Loki

Tempo

Mimir

Job description

CVS Health Enterprise Technology is seeking a Lead Cloud Engineer to shape the Observability Platform, building scalable data pipelines for logs, metrics, and traces across multicloud and datacenters.

You will mentor teams, design high-throughput systems, and collaborate with SRE and application teams to deliver reliable platform features and secure telemetry. A strong focus on distributed systems, performance, and cost efficiency drives this role.