Staff Observability Engineer: Telemetry at Scale

Anthropic Limited; New York (NY); Hybrid; USD 320,000 - 485,000; Full time

Job summary

Anthropic is seeking Software Engineers to join our Observability team within the Infrastructure organization. The Observability team builds telemetry pipelines, dashboards, and diagnostic tools to improve reliability across GPU, TPU, and Trainium clusters.

You will enable engineers and researchers to detect, diagnose, and resolve issues quickly, even when they lie below the application layer. As Anthropic scales its infrastructure, you will own and evolve observability platforms, instrument

Qualifications

• Experience building and operating large-scale observability or monitoring infrastructure.
• Hands-on experience with signals end-to-end from instrumentation to query and analysis.
• Understanding of high-throughput telemetry pipelines and data handling at scale.
• Comfort debugging below the application layer, in kernel, network, or hardware.
• Excellent communication and collaboration with internal teams.

Responsibilities

• Design and build scalable telemetry ingestion and storage for metrics, logs, traces, and error data.
• Develop observability solutions that give deep, low-overhead visibility across the fleet.
• Own and evolve core observability platforms, driving migrations and architectural improvements.
• Create instrumentation libraries, SDKs, and eBPF-based auto-instrumentation.
• Reduce detection and resolution time with cross-signal correlation and AI-assisted tooling.
• Turn continuous profiling into actionable optimization insights for CPUs, memory, and accelerators.
• Collaborate with Research, Inference, Product, and Infrastructure teams to meet diverse needs.

Skills

Observability infra

Telemetry pipelines

Kernel/network debugging

Cross-team collaboration

Independent problem solving

Education

Bachelor's degree or equivalent

Tools

OpenTelemetry

eBPF

ClickHouse

BigQuery

Job description

Anthropic is seeking Software Engineers to join our Observability team within the Infrastructure organization. The Observability team builds telemetry pipelines, dashboards, and diagnostic tools to improve reliability across GPU, TPU, and Trainium clusters.

You will enable engineers and researchers to detect, diagnose, and resolve issues quickly, even when they lie below the application layer. As Anthropic scales its infrastructure, you will own and evolve observability platforms, instrument