Senior Capacity Engineer - Data Pipelines & Fleet Optimization

Doist; New York, Seattle, San Francisco (NY, WA, CA); Hybrid; USD 320,000 - 485,000; Full time

Job summary

Anthropic seeks a Capacity Engineer to help manage one of the largest AI infrastructure fleets. You will build production systems that ingest telemetry, provide observability, and measure utilization of compute resources across Kubernetes clusters and cloud providers.

You will own planning, capacity allocation, and efficiency programs, rebuild data pipelines in BigQuery, and partner with researchers, finance, and leadership to forecast demand and control costs while maintaining strong SLOs.

Qualifications

• Production systems in a dev-ops environment.
• Proficiency in Python and SQL with well-tested code.
• Hands-on experience with at least one major cloud provider (AWS, GCP, or Azure).
• Experience with Prometheus, PromQL, Grafana.

Responsibilities

• Build data pipelines ingesting occupancy and utilization telemetry from Kubernetes clusters.
• Develop real-time tooling for fleet health, capacity planning and alerting.
• Measure and improve utilization of training, inference and evaluation workloads.
• Reconcile cloud provider billing exports with internal telemetry for spend attribution.

Skills

DevOps

Python

SQL

Cloud platforms

Observability

Education

Bachelor's degree

Tools

Prometheus

Grafana

BigQuery

Job description

Anthropic seeks a Capacity Engineer to help manage one of the largest AI infrastructure fleets. You will build production systems that ingest telemetry, provide observability, and measure utilization of compute resources across Kubernetes clusters and cloud providers.

You will own planning, capacity allocation, and efficiency programs, rebuild data pipelines in BigQuery, and partner with researchers, finance, and leadership to forecast demand and control costs while maintaining strong SLOs.