Senior Production Engineer, Managed AI

AItoolnavio; San Francisco (CA); On-site; USD 170,000 - 205,000; Full time

Benefits offered by this job

Health insurance

401(k) with match

Restricted Stock Units

Paid parental leave

Teladoc

Paid time off

Commuter benefits

Tuition reimbursement

HSAs/vision/dental

Life/disability insurance

Job summary

Crusoe is seeking a Senior Production Engineer to join our Production Engineering team in San Francisco. You will design and operate reliable managed AI services, focusing on serving and scaling LLM workloads, with a strong emphasis on reliability, performance, and cost efficiency.

You’ll own automation, observability, and SLIs/SLOs, collaborating across AI, platform, and infra teams to optimize large-scale training and inference clusters, and to resolve issues in distributed AI systems.

Qualifications

• Experience designing and implementing production-grade distributed systems.
• Hands-on with large language models and ML infrastructure.
• Ability to define and measure SLIs/SLOs for AI workloads.
• Strong programming skills in Python, Go, Java or C++.
• Familiarity with container orchestration (Kubernetes).

Responsibilities

• Design and operate reliable managed AI services for LLM workloads.
• Build automation and reliability tooling for AI pipelines and inference.
• Define and improve SLIs/SLOs to meet performance targets.
• Collaborate with AI, platform, and infra teams to optimize clusters.
• Develop observability through telemetry and performance tuning.
• Investigate reliability issues in distributed AI systems.
• Contribute to architecture of next-gen distributed systems for AI-first environments.

Skills

Distributed systems design

LLMs / AI infrastructure

SRE mindset

Python

Go

Java

C++

Kubernetes

Collaboration & communication

Job description

Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack - from electrons to tokens - to power the world's most ambitious AI workloads. When you join Crusoe, you join a team that is building the future, faster.

We're in the midst of the greatest industrial revolution of our time. The demand for AI compute is boundless, and power is a bottleneck. We're solving that - with an energy-first approach that makes AI infrastructure better for the world and faster for the people innovating with AI.

We're looking for problem-solving, opportunity-finding teammates with a sense of urgency, who believe in the scale of our ambition and thrive on a path not fully paved - people who want to grow their careers alongside a team of experts across energy, manufacturing, data center construction, and cloud services.

If you want to do the most meaningful work of your career, help our customers and partners advance their AI strategies, and be part of a high-performing team that believes in each other, come build with us at Crusoe.

About the Role:

At Crusoe, our Production Engineering team ensures the reliability and scalability of Crusoe's AI-optimized cloud platform. We're looking for a Senior Production Engineer with a strong background in distributed systems and hands-on experience with large language models to help us build and operate managed AI services at scale. This role is central to delivering highly available, performant, and cost-efficient AI infrastructure that powers compute-intensive, latency-sensitive workloads for our customers.

What You’ll Work On:

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads

• Build automation and reliability tooling to support distributed AI pipelines and inference services

• Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met

• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters

• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services

• Investigate and resolve reliability issues in distributed AI systems using telemetry, logs, and profiling

• Contribute to the architecture of next-generation distributed systems purpose-built for AI-first environments

What You’ll Bring:

• Strong software engineering background - experience building production-grade systems beyond scripting or Bash

• Demonstrated experience in distributed systems design and implementation

• Hands-on work with large language models (LLMs) or AI/ML infrastructure

• SRE mindset and experience (whether or not under the SRE title) including:

  • Defining and measuring SLIs/SLOs

  • Building monitoring and observability systems

  • Driving performance and reliability improvements

  • Designing fault-tolerant systems and automated testing strategies

• Proficiency in at least one modern programming language (Python, Go, Java, C++)

• Familiarity with Kubernetes or container orchestration platforms

• Strong collaboration and communication skills

• Ability to thrive in a fast-paced, mission-driven environment

Bonus Points:

• Experience scaling inference or training workloads for LLMs

Benefits:

• Industry competitive pay

• Restricted Stock Units in a fast growing, well-funded technology company

• Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents

• Employer contributions to HSA accounts

• Paid Parental Leave

• Paid life insurance, short-term and long-term disability

• Teladoc

• 401(k) with a 100% match up to 4% of salary

• Generous paid time off and holiday schedule

• Cell phone reimbursement

• Tuition reimbursement

• Subscription to the Calm app

• MetLife Legal

• Company paid commuter benefit; $300 per month

Compensation:

Compensation will be paid in the range of $170,000 - $205,000. Restricted Stock Units are included in all offers. Compensation to be determined by the applicant's education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data.

Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.