Staff Observability Engineer for Scalable AI Inference

Cerebras

Sunnyvale (CA)

On-site

USD 180,000 - 240,000

Full time

10 days ago

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Cerebras Systems in Sunnyvale, CA is seeking a Software Engineer focused on Observability to build and evolve the systems that give us deep visibility into large-scale, performance-critical production systems. You’ll design and implement metrics, logging, tracing, and alerting infrastructure that enables fast debugging, high reliability, and confident operation of complex distributed systems.

This role sits at the intersection of platform engineering, distributed systems, and reliability.

Qualifications

Proven backend or systems software development experience.
Proficiency in Go, C++, Rust, Java, or Python.
Solid understanding of distributed systems, networking, and concurrency.
Hands-on observability experience with metrics, logs, and traces.
Familiarity with OpenTelemetry, Prometheus, Grafana and related tooling.
Ability to design high-signal alerts and scalable telemetry pipelines.
Experience debugging large-scale production systems is a plus.
Hardware-aware observability in AI/ML or accelerator contexts is a plus.

Responsibilities

Design and implement observability instrumentation across services and platforms.
Build and maintain telemetry pipelines for metrics, logs, and traces at scale.
Develop internal observability platforms, libraries, and tooling.
Define and operationalize SLIs, SLOs, and alerting strategies.
Partner with engineers to make systems debuggable by design.
Reduce MTTR by enabling fast root-cause analysis during incidents.
Create clear, actionable dashboards and alerts that reflect real system health.
Balance telemetry signal vs cost, noise, and performance impact.
Improve the developer experience around observability and debugging.