Senior AI Inference Engineer - Production LLM Optimizer

Crusoe Energy Systems LLC; San Francisco, Northern (CA, KY); Hybrid; USD 215,000 - 260,000; Full time

Benefits offered by this job

Equity

RSUs

Paid time off

Health insurance

HSA contributions

Parental leave

Life insurance

Tuition reimbursement

Mental health support

Commuter benefits

Cell phone stipend

401(k) match

Volunteer time off

Travel insurance

Meals allowance

Location perks

Job summary

Crusoe Energy Systems LLC is seeking an experienced engineer to accelerate large language models in production. You will own the end-to-end inference stack, profiling time and cost, and bringing advanced optimization techniques into live deployments.

The role involves close collaboration with customer teams, turning proofs of concept into monitored production services, and developing low-level optimizations. Expect hands-on coding, profiling, and cross-functional collaboration.

Qualifications

• Bachelor’s, Master’s or PhD in Computer Science, Engineering, Mathematics, or a related field.
• Hands-on experience shipping production code in Python or C++, with a preference for Python.
• Familiarity with optimizing LLMs for high throughput and low latency inference.
• Comfort with LLM serving frameworks such as vLLM or SGLang, and profiling down to kernel level.
• Understanding of GPU architectures and how they behave.
• Strong interest and experience with large language models.
• Knowledge of AI/ML pipelines from development to deployment.
• Strong communication skills for explaining technical topics to customers and teammates.

Responsibilities

• Own optimization end-to-end from experiment to production deployment.
• Design and optimize serving architectures and routing for inference workloads.
• Profile and diagnose performance across frameworks and kernels.
• Scale optimization methods across diverse ML models, especially LLMs.
• Collaborate with customer engineering teams to tailor deployments.
• Write and ship features for the inference stack in production.

Skills

Python

C++

LLM optimization

GPU basics

Communication

Education

Bachelor’s/Master’s/PhD in CS/Engineering/Math

Tools

Docker

Kubernetes

CUDA

vLLM

SGLang

Job description

Crusoe Energy Systems LLC is seeking an experienced engineer to accelerate large language models in production. You will own the end-to-end inference stack, profiling time and cost, and bringing advanced optimization techniques into live deployments.

The role involves close collaboration with customer teams, turning proofs of concept into monitored production services, and developing low-level optimizations. Expect hands-on coding, profiling, and cross-functional collaboration.