Senior Engineering Manager, AI Inference (LLM Production)

Crusoe Energy Systems LLC; San Francisco, Northern (CA, KY); Hybrid; USD 250,000 - 300,000; Full time

Benefits offered by this job

Competitive compensation and equity

Restricted Stock Units

Paid time off, holidays & leave

Healthcare: medical, dental & vision

HSA contributions

Parental leave

Life insurance

Tuition reimbursement

Mental health support

Commuter benefits

Cell phone stipend

401(k) with company match

Volunteer time off

Global travel insurance

Daily meals allowance

Location-specific perks

Job summary

Crusoe Energy Systems LLC is seeking a Senior Engineering Manager in San Francisco to lead an ML inference optimization team. You will stay hands-on with the stack, profiling performance and deploying improvements in production for large language models and diverse workloads.

The role blends leadership with deep technical work, collaborating with customers to tailor deployments and delivering measurable performance gains in real-world environments.

Qualifications

• BS/MS/PhD in CS/Engineering/Math or related field.
• Hands-on production coding in Python or C++.
• Experience shipping ML inference systems.
• Familiarity with optimizing LLMs for throughput and latency.
• Understanding GPUs and kernel behavior.
• Strong communication with customers and teammates.

Responsibilities

• Bring current inference techniques into production and refine them.
• Design and optimize serving architectures for latency, throughput and cost.
• Dive into serving stack from frameworks to CUDA kernels to identify performance issues.
• Scale optimization methods across ML models, especially large language models.
• Profile and tune deployments to meet real production targets.
• Lead team delivery end-to-end and align with product and engineering leadership.

Skills

Team leadership

Python

C++

LLM optimization

GPU basics

Communication

Education

Bachelors, Masters, or PhD in CS/Engineering/Math

Tools

Docker

Kubernetes

Job description

Crusoe Energy Systems LLC is seeking a Senior Engineering Manager in San Francisco to lead an ML inference optimization team. You will stay hands-on with the stack, profiling performance and deploying improvements in production for large language models and diverse workloads.

The role blends leadership with deep technical work, collaborating with customers to tailor deployments and delivering measurable performance gains in real-world environments.