Robotics ML Infrastructure Engineer

Efference

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Efference is building the compute platform that schedules and runs robot models on shared GPUs in the cloud. You will own placement, model lifecycle, and service reliability across inference, training, and evaluation workloads, ensuring latency and continuity for active robot sessions.

You’ll develop scheduling, admission control, and efficient container lifecycle management to minimize startup delays and maintain performance during capacity changes.

Qualifications

  • Experience building distributed infrastructure, schedulers, runtimes, or ML platforms that run production workloads.

Responsibilities

  • Develop scheduling and admission control based on model memory, accelerator capacity, session requirements, and measured network and inference latency.
  • Build model loading, warm pools, caching, and container lifecycle management to reduce startup delays and avoid disruption during capacity changes.
  • Coordinate inference-serving behavior with performance engineers, balancing batching and GPU utilization against observation freshness and response deadlines.
  • Isolate customer workloads and manage quotas, resource contention, and priority so background training or evaluation cannot silently degrade live robot sessions.
  • Implement health checks, failure recovery, staged model rollouts, and rollback, preserving the session and version information needed to diagnose incidents.
  • Instrument queue time, GPU utilization, memory pressure, deadline misses, and serving cost; use workload replay and load tests to guide capacity planning.

Skills

Distributed infrastructure
Systems programming (Go, Rust, C++, or
Linux, containers, networking
Reliability engineering
Workload scheduling and latency
Performance instrumentation

Tools

Kubernetes
Ray
Slurm

Job description

Efference is building the compute platform that schedules and runs robot models on shared GPUs in the cloud. You will own placement, model lifecycle, and service reliability across inference, training, and evaluation workloads, ensuring latency and continuity for active robot sessions.

You’ll develop scheduling, admission control, and efficient container lifecycle management to minimize startup delays and maintain performance during capacity changes.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Infrastructure Engineer, Orchestration
Machine Learning Infrastructure Engineer, Orchestration

Efference • San Francisco (CA)

On-site
USD 180,000 - 240,000
Robotics Real-Time Networking Engineer
Robotics Real-Time Networking Engineer

Efference • San Francisco (CA)

On-site
USD 180,000 - 240,000
Robotics Software Engineer, Infrastructure
Robotics Software Engineer, Infrastructure

Efference • San Francisco (CA)

On-site
USD 150,000 - 190,000
Robotics ML Training Infrastructure Engineer
Robotics ML Training Infrastructure Engineer

Eka Robotics • Boston (MA)

On-site
USD 140,000 - 190,000
Robotics Software Engineer - Real-Time Perception & Fleet
Robotics Software Engineer - Real-Time Perception & Fleet

Efference • San Francisco (CA)

On-site
USD 150,000 - 190,000
Full-Stack Engineer — Robotics Deployment & Fleet Tools
Full-Stack Engineer — Robotics Deployment & Fleet Tools

Efference • San Francisco (CA)

On-site
USD 140,000 - 210,000
ML Infrastructure Engineer — Robotics Inference
ML Infrastructure Engineer — Robotics Inference

Rhoda AI • Mountain View (WY)

On-site
USD 150,000 - 190,000
Real-Time Robotics Control Engineer
Real-Time Robotics Control Engineer

Efference • San Francisco (CA)

On-site
USD 140,000 - 210,000
Robotics ML Infrastructure Engineer: GPU Fleet & Inference
Robotics ML Infrastructure Engineer: GPU Fleet & Inference

Generalist AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Robotics ML Infra Engineer: GPU Fleet & Inference
Robotics ML Infra Engineer: GPU Fleet & Inference

Generalist AI, Inc. • Boston (MA)

On-site
USD 150,000 - 230,000