Senior AI Infra Engineer - LLM & Distributed Systems

Crusoe; Bellevue (WA); On-site; USD 170,000 - 205,000; Full time

Benefits offered by this job

Restricted Stock Units (RSUs)

Health insurance

HSA contributions

Paid parental leave

401(k) with match

Job summary

Crusoe is seeking a Senior Production Engineer to ensure reliability and scalability of our AI-optimized cloud platform. You will work on distributed systems and hands-on with large language models to deliver highly available, cost-efficient AI infrastructure at scale.

You will design and operate managed AI services, build automation, and drive observability and performance improvements across latency-sensitive workloads.

Qualifications

• Strong software engineering background beyond scripting or Bash.
• Experience designing and implementing distributed systems.
• Hands-on work with large language models or AI/ML infrastructure.
• SRE mindset including defining/measuring SLIs/SLOs, monitoring/observability, fault tolerance, and automated testing.

Responsibilities

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads.
• Build automation and reliability tooling to support distributed AI pipelines and inference services.
• Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met.
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters.
• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services.
• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling.
• Contribute to the architecture of next-generation distributed systems for AI-first environments.

Skills

Production engineering

Distributed systems

LLM infra

Programming languages

Tools

Kubernetes

Python

Go

Java

C++

Job description

Crusoe is seeking a Senior Production Engineer to ensure reliability and scalability of our AI-optimized cloud platform. You will work on distributed systems and hands-on with large language models to deliver highly available, cost-efficient AI infrastructure at scale.

You will design and operate managed AI services, build automation, and drive observability and performance improvements across latency-sensitive workloads.