Staff SRE for Distributed AI Infra at Scale

Crusoe; Illinois; On-site; USD 170,000 - 250,000; Full time

Benefits offered by this job

Pension contributions

Work-life balance

Job summary

Crusoe is seeking a Staff Site Reliability Engineer to scale and operate an AI-optimized cloud platform, with a strong focus on distributed systems and large language models. You will build reliable, scalable AI services, automate observability, and drive SLIs/SLOs while collaborating across AI, platform, and infrastructure teams.

The role emphasizes hands-on development in modern languages, Kubernetes expertise, and a proactive, results-driven approach in a fast-paced environment at Crusoe.

Qualifications

• Experience building production-grade systems beyond scripting.
• Proven experience in distributed systems design and implementation.
• Hands-on work with large language models (LLMs) or AI/ML infrastructure.
• Proficiency in at least one modern programming language (Python, Go, Java, C++).

Responsibilities

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads.
• Build automation and reliability tooling to support distributed AI pipelines and inference services.
• Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met.
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters.
• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services.
• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling.
• Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments.

Skills

Distributed systems design

SRE practices

LLMs / AI infra

Programming: Python/Go/Java/C++

Kubernetes

Observability

Tools

Kubernetes

Telemetry/Monitoring tooling

Job description

Crusoe is seeking a Staff Site Reliability Engineer to scale and operate an AI-optimized cloud platform, with a strong focus on distributed systems and large language models. You will build reliable, scalable AI services, automate observability, and drive SLIs/SLOs while collaborating across AI, platform, and infrastructure teams.

The role emphasizes hands-on development in modern languages, Kubernetes expertise, and a proactive, results-driven approach in a fast-paced environment at Crusoe.