Applied AI Inference Engineer: LLM Performance in Production

Fdetimes; San Francisco (CA); On-site; USD 215,000 - 260,000; Full time

Benefits offered by this job

Competitive compensation & equity

401(k) retirement plan

Paid time off & holidays

Health, dental & vision insurance

Parental leave

Professional development & tuition

Cell phone stipend

Commuter benefits

Global travel insurance

Meals allowance

Other location perks

Job summary

Crusoe is seeking an engineering leader to accelerate AI workloads by making large language models run faster, cheaper, and more reliably in production. You will own the inference stack end to end, profiling time and cost, bringing modern optimization techniques to real deployments, and diving into serving code when needed.

The role blends core systems work with customer-facing responsibilities, product input, and technical solutions, delivering measurable performance gains for diverse models

Qualifications

• MSc/PhD in CS/Engineering/Math or related field.
• Hands-on production software delivery with Python or C++.

Responsibilities

• Own inference stack end to end: profiling, optimization, deployment.
• Collaborate with customer engineering teams to tailor deployments.
• Build production-grade features around the inference stack.

Skills

Python

C++

LLM optimization

Profiling

Client communication

Education

Bachelor's/Master's/PhD in CS/Engineering/Math

Tools

Docker

Kubernetes

CUDA

vLLM

SGLang

Job description

Crusoe is seeking an engineering leader to accelerate AI workloads by making large language models run faster, cheaper, and more reliably in production. You will own the inference stack end to end, profiling time and cost, bringing modern optimization techniques to real deployments, and diving into serving code when needed.

The role blends core systems work with customer-facing responsibilities, product input, and technical solutions, delivering measurable performance gains for diverse models