Staff Observability Engineer — Scalable Telemetry & AI-Driven Ops

Anthropic; New York (NY); Hybrid; USD 320,000 - 485,000; Full time

Benefits offered by this job

Equity donation matching

Flexible working hours

Generous vacation

Office in San Francisco

Parental leave

Job summary

Anthropic is seeking Software Engineers to join our Observability team within the Infrastructure organization. You will help design and operate scalable telemetry ingest, logging pipelines, and profiling tools that keep Anthropic’s research and product systems reliable and observable.

You’ll work on high-throughput telemetry, including eBPF tracing and AI‑assisted diagnostics, to reduce MTTR while improving cost‑efficiency.

Qualifications

• Experience building and operating large‑scale observability or monitoring infrastructure.
• Hands-on experience with observability signals end to end, from instrumentation through ingest to query and analysis.
• Understanding of high‑throughput telemetry pipelines and the tradeoffs involved in collecting, storing, and querying operational data at scale.
• Comfort debugging below the application layer, in the kernel, the network stack, or the hardware.
• Excellent communication skills and ability to partner with internal teams to improve their operational visibility and incident response capabilities.
• Ability to work independently on ambiguous, high‑impact technical challenges.

Responsibilities

• Design and build scalable telemetry ingest and storage pipelines for metrics, logs, traces, and error data across Anthropic's multi‑cluster infrastructure.
• Build observability solutions that give engineers deep, low‑overhead visibility into system behavior across the fleet.
• Own and evolve core observability platforms, leading migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growth.
• Build instrumentation libraries, SDKs, and eBPF‑based auto‑instrumentation to emit high‑quality telemetry, with and without code changes.
• Reduce mean time to detection and resolution by building cross‑signal correlation and unified query interfaces.
• Improve fleet‑wide efficiency by turning continuous profiling into actionable optimization insights across CPU, memory, and accelerator fleets.
• Partner with Research, Inference, Product, and Infrastructure teams to ensure observability solutions meet the unique needs of each organization.

Skills

Observability infra

Telemetry pipelines

eBPF tracing

Kernel debugging

OpenTelemetry

Education

Bachelor’s degree

Tools

ClickHouse

BigQuery

OpenTelemetry

eBPF

Job description

Anthropic is seeking Software Engineers to join our Observability team within the Infrastructure organization. You will help design and operate scalable telemetry ingest, logging pipelines, and profiling tools that keep Anthropic’s research and product systems reliable and observable.

You’ll work on high-throughput telemetry, including eBPF tracing and AI‑assisted diagnostics, to reduce MTTR while improving cost‑efficiency.