Production ML Infrastructure Engineer – Inference & Scale

Mixpeek; San Mateo (CA); On-site; USD 180,000 - 230,000; Full time

Benefits offered by this job

Onsite culture in San Mateo

Full benefits (medical, dental, vision

401k

H-1B visa sponsorship

Job summary

zaimler seeks an engineer to own end-to-end inference and model-serving infrastructure, building scalable systems for production AI workloads. You will work closely with ML and infra teams to run agents efficiently, at increasing concurrency, in a fast, reliable production environment.

Join a team shaping enterprise AI infrastructure with a culture of hands-on building. Onsite in San Mateo, with full benefits and visa sponsorship options for the right candidate.

Qualifications

• Proven ability to build scalable ML/AI platforms end-to-end for production.
• Deep understanding of the inference stack: vLLM, KV cache, and optimization layers.
• Experience building distributed AI/ML systems at scale.
• 3+ years of relevant experience.

Responsibilities

• Set up and scale inference/Ray Serve for ML and LLM model serving.
• Scale agent GPU infrastructure for concurrency and efficiency.
• Optimize and improve engine builder and model server for scalable orchestration.

Skills

Scale ML infra

Inference stack

Distributed systems

Zero-to-one build

Ray Serve

MLOps

Tools

Ray Serve

AIBrix

Job description

zaimler seeks an engineer to own end-to-end inference and model-serving infrastructure, building scalable systems for production AI workloads. You will work closely with ML and infra teams to run agents efficiently, at increasing concurrency, in a fast, reliable production environment.

Join a team shaping enterprise AI infrastructure with a culture of hands-on building. Onsite in San Mateo, with full benefits and visa sponsorship options for the right candidate.