Scale ML Inference & Model-Serving Engineer

Essence Ventures

San Mateo (CA)

On-site

USD 150,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Full benefits (medical, dental, vision
401k
H-1B visa sponsorship and immigration”

Job summary

zaimler is seeking an engineer to own our inference and model-serving infrastructure end to end, enabling production-grade AI agents to run fast and reliably at scale. You’ll report to Sofus and collaborate with ML and infra teams on deployment and scalability.

You will set up and scale inference systems, manage GPU resources for concurrency, and optimize the engine that powers scalable agent orchestration, joining an early engineering team in a cutting-edge context.

Qualifications

  • Proven ability to build scalable ML/AI platforms end-to-end for production.
  • Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving.
  • Experience building distributed AI/ML workloads at scale, connecting them to real product or vertical integrations.
  • 3+ years of relevant experience. We care about capability, not tenure.

Responsibilities

  • Set up and scale inference/Ray Serve for ML and LLM model serving.
  • Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads.
  • Optimize and improve the engine builder and model server that power scalable agent orchestration.

Skills

Scalable ML platforms
Distributed systems
Model serving
Ray Serve

Tools

Ray Serve
vLLM
KV cache
Distributed systems tooling

Job description

zaimler is seeking an engineer to own our inference and model-serving infrastructure end to end, enabling production-grade AI agents to run fast and reliably at scale. You’ll report to Sofus and collaborate with ML and infra teams on deployment and scalability.

You will set up and scale inference systems, manage GPU resources for concurrency, and optimize the engine that powers scalable agent orchestration, joining an early engineering team in a cutting-edge context.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Applied ML Engineer, AI Infrastructure
Staff Applied ML Engineer, AI Infrastructure

Essence Ventures • San Mateo (CA)

On-site
USD 180,000 - 240,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Essence Ventures • San Mateo (CA)

On-site
USD 150,000 - 230,000
Full benefits (medical, dental, vision
401k
H-1B visa sponsorship and immigration”
Staff Applied Machine Learning Engineer
Staff Applied Machine Learning Engineer

Essence Ventures • San Mateo (CA)

On-site
USD 180,000 - 240,000
ML Infrastructure Engineer — Scalable AI Inference
ML Infrastructure Engineer — Scalable AI Inference

Abridge • San Francisco (CA)

On-site
USD 170,000 - 210,000
Generous Time Off
Comprehensive Health Plans
Generous 401(k) Matching
+4
Inference & Model Serving Engineer
Inference & Model Serving Engineer

Safeguard • United States

Remote
USD 120,000 - 180,000
Staff ML Engineer: Scale AI Infra & Realm-X
Staff ML Engineer: Scale AI Infra & Realm-X

AppFolio, Inc. • Denver (CO)

Hybrid
USD 200,000 - 275,000
Production ML Engineer: Scalable Inference & Deployment
Production ML Engineer: Scalable Inference & Deployment

Nouvells • United States

Remote
USD 120,000 - 190,000
Cloud Infrastructure Engineer
Cloud Infrastructure Engineer

Essence Ventures • San Mateo (CA)

On-site
USD 180,000 - 280,000
Equity
Full benefits (Medical, Dental, Vision
401k
+2
Senior ML Infra Engineer – Scalable Model Serving
Senior ML Infra Engineer – Scalable Model Serving

Etsy, Inc. • New York (NY)

On-site
USD 182,000 - 246,000
Senior ML Platform Engineer - Scalable Inference & Data
Senior ML Platform Engineer - Scalable Inference & Data

SNAP, Inc. • Palo Alto (CA)

On-site
USD 209,000 - 313,000
Equity RSUs