Senior ML Inference Engineer — Production Systems

MakerMaker.AI; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability.

The ideal candidate will have 3+ years of experience in production-grade serving infrastructure, be fluent in Python, and have strong knowledge in GPU-accelerated inference. Excellent communication skills are essential as you'll be creating runbooks for incident resolution.

Qualifications

• 3+ years building production-grade, large-scale serving infrastructure.
• Experience shipping production infrastructure handling millions of requests.
• Ability to read flame graphs and perform analytical changes.

Responsibilities

• Build and operate production inference systems serving large models.
• Own performance characteristics: throughput, latency, cost-per-token.
• Diagnose production incidents and write systemic fixes.

Skills

Performance profiling and optimization fluency

Fluent Python

Strong distributed systems experience

Experience with GPU-accelerated inference at scale

Good written communication

Tools

C++

CUDA

ROCm

Triton

Job description

MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability.

The ideal candidate will have 3+ years of experience in production-grade serving infrastructure, be fluent in Python, and have strong knowledge in GPU-accelerated inference. Excellent communication skills are essential as you'll be creating runbooks for incident resolution.