Senior Observability Platform Engineer for AI GPUs

Devopsroles; Northern (KY); Hybrid; USD 190,000 - 260,000; Full time

Job summary

Nscale is seeking a Staff Observability Platform Engineer to design, build, and evolve the observability platform for GPU clusters and AI workloads. You will treat observability as a product and partner across SRE, infra, platform, and AI/ML teams to diagnose issues and operate complex distributed systems with confidence.

You will lead with hands-on engineering, drive architectural decisions, mentor engineers, and champion engineering best practices to improve reliability, performance, and

Qualifications

• 6+ years of experience in SRE, platform engineering, or observability roles.
• Experience building and operating observability platforms in cloud-native environments.
• Hands-on expertise with Prometheus/Thanos and Grafana or comparable tools.
• Strong software engineering skills (Go, Python, or equivalent).

Responsibilities

• Design, build, and evolve observability platforms across metrics, logs, traces, alerts, and telemetry pipelines.
• Lead implementation of scalable observability solutions for GPU and AI infra.
• Partner with SRE, infra, platform, and AI/ML teams to embed observability.
• Improve monitoring coverage, alert quality, and service health visibility.
• Develop standards and reusable patterns for wide adoption of observability.
• Identify reliability risks and operational blind spots.
• Contribute to telemetry architecture including storage and retention.
• Lead initiatives to improve scalability and reliability of platforms.
• Mentor engineers through reviews and knowledge sharing.
• Participate in incident investigations and postmortems for durable improvements.
• Evaluate new observability technologies balancing innovation with maintainability.

Skills

SRE experience

Observability platform

Go/Python

Kubernetes

IaC tooling

Communication

Cloud-native

Leadership

Tools

Prometheus

Thanos

VictoriaMetrics

Grafana

Loki

Tempo

OpenTelemetry

ClickHouse

Elastic

Job description

Nscale is seeking a Staff Observability Platform Engineer to design, build, and evolve the observability platform for GPU clusters and AI workloads. You will treat observability as a product and partner across SRE, infra, platform, and AI/ML teams to diagnose issues and operate complex distributed systems with confidence.

You will lead with hands-on engineering, drive architectural decisions, mentor engineers, and champion engineering best practices to improve reliability, performance, and