Senior ML Inference Engineering Lead

Fdetimes; San Francisco (CA); On-site; USD 250,000 - 300,000; Full time

Benefits offered by this job

Competitive compensation

Equity packages

Paid time off

Health insurance

HSA contributions

Parental leave

Life insurance

Professional development

Tuition reimbursement

Wellness support

401(k) Retirement with match

Commuter benefits

Cell phone stipend

Travel insurance

Job summary

Crusoe is seeking a Senior Engineering Manager to lead an AI inference stack team, optimizing large language model deployments in production. You will stay hands-on, profiling performance, applying modern optimization techniques, and guiding customers on tailored deployments.

This role blends leadership, technical direction, and customer-facing work to deliver measurable improvements. In this engineering leadership position, you will shape strategy, collaborate with product teams, and own

Qualifications

• 2+ years of experience directly managing and leading an engineering team in a high-performance or ML-focused environment.
• Strong hands-on software engineering background with a deep understanding of production ML systems.
• Experience shipping code in production using Python or C++.
• Familiarity with ML serving frameworks and GPU-accelerated inference.
• Excellent communication skills for cross-functional alignment.

Responsibilities

• Lead an engineering team delivering optimized ML inference stacks to production.
• Profile performance and apply optimization techniques across models and deployments.
• Collaborate with product and customers to tailor deployments to workload needs.
• Guide technical strategy, roadmaps, and hands-on coding when needed.
• Partner with engineering leaders to drive end-to-end delivery from experiments to production.

Skills

Engineering management

Low-level optimization

ML infrastructure

Python

C++

GPU architecture

LLM deployment

Education

Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or related field

Tools

Docker

Kubernetes

vLLM

SGLang

CUDA

Job description

Crusoe is seeking a Senior Engineering Manager to lead an AI inference stack team, optimizing large language model deployments in production. You will stay hands-on, profiling performance, applying modern optimization techniques, and guiding customers on tailored deployments.

This role blends leadership, technical direction, and customer-facing work to deliver measurable improvements. In this engineering leadership position, you will shape strategy, collaborate with product teams, and own