Senior AI Infrastructure Reliability Engineer

Fireworks; San Mateo (CA); On-site; USD 190,000 - 270,000; Full time

Job summary

Fireworks AI is seeking a Reliability Engineer to own the reliability tooling, establish SLOs, and drive incident response across cloud infrastructure and AI systems.

You will work with product and engineering teams to keep the platform reliable at scale, engineering robust observability, automation, and failure handling. A CS/CE degree is required and startup/scale-up experience is valued.

Qualifications

• 5+ years with Linux internals, system performance troubleshooting, and networking fundamentals (TCP/IP, HTTP, gRPC).
• 5+ years in Python, Go, C++, or Rust, writing production-grade tools and systems code.
• Operating and debugging Kubernetes, Terraform, and Docker in high-throughput production.
• High-throughput control planes, microservices, or multi-region setups.
• Fault-tolerant design, SLO/SLA management, automated failover, high-availability architecture.
• You can influence without authority via credible tooling and collaboration.
• Willingness to dig into unfamiliar parts of the stack when problems cross boundaries.
• Bachelor's or Master's in CS/CE or equivalent experience.

Responsibilities

• Define reliability standards: SLOs, error budgets, production readiness criteria.
• Own the reliability toolchain: Logging and telemetry pipelines, alerting standards, failure injection, load testing, self-healing automation.
• Keep customer experience from falling through the cracks: ensure failures are owned and fixed.
• Own the seams: identify cross-system issues and drive fixes.
• Run incident management: coordinate live production issues and postmortems.
• Reduce toil: automate repetitive operational work.
• Partner across org: cloud capacity, multi-region risk, performance in rollout stacks.

Skills

Linux internals

System performance troubleshooting

Networking fundamentals

Python

Go

C++

Rust

Kubernetes

Terraform

Docker

Distributed systems

SLO/SLA management

Failover automation

Influence without authority

Versatility

BS in CS/CE

Education

Bachelor's or Master's in Computer Science, Computer Engineering, or equivalent

Tools

Prometheus

Grafana

OpenTelemetry

Job description

Fireworks AI is seeking a Reliability Engineer to own the reliability tooling, establish SLOs, and drive incident response across cloud infrastructure and AI systems.

You will work with product and engineering teams to keep the platform reliable at scale, engineering robust observability, automation, and failure handling. A CS/CE degree is required and startup/scale-up experience is valued.