Machine Learning Infrastructure Engineer, Orchestration

Efference

San Francisco (CA)

Vor Ort

USD 180.000 - 240.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Efference is building the compute platform that schedules and runs robot models on shared GPUs in the cloud. You will own placement, model lifecycle, and service reliability across inference, training, and evaluation workloads, ensuring latency and continuity for active robot sessions.

You’ll develop scheduling, admission control, and efficient container lifecycle management to minimize startup delays and maintain performance during capacity changes.

Qualifikationen

  • Experience building distributed infrastructure, schedulers, runtimes, or ML platforms that run production workloads.

Aufgaben

  • Develop scheduling and admission control based on model memory, accelerator capacity, session requirements, and measured network and inference latency.
  • Build model loading, warm pools, caching, and container lifecycle management to reduce startup delays and avoid disruption during capacity changes.
  • Coordinate inference-serving behavior with performance engineers, balancing batching and GPU utilization against observation freshness and response deadlines.
  • Isolate customer workloads and manage quotas, resource contention, and priority so background training or evaluation cannot silently degrade live robot sessions.
  • Implement health checks, failure recovery, staged model rollouts, and rollback, preserving the session and version information needed to diagnose incidents.
  • Instrument queue time, GPU utilization, memory pressure, deadline misses, and serving cost; use workload replay and load tests to guide capacity planning.

Kenntnisse

Distributed infrastructure
Systems programming (Go, Rust, C++, or
Linux, containers, networking
Reliability engineering
Workload scheduling and latency
Performance instrumentation

Tools

Kubernetes
Ray
Slurm

Jobbeschreibung

About the company

Efference provides high-performance perception and compute infrastructure for training and deploying robot models in the cloud. Our vision is to make robotic deployments scalable with shared compute.

We approach the problem by owning the entire path from the image sensor to the datacenter GPU. We shrink the load at the sensor, fix the uplink so robot traffic is fast and reliable, and clock synchronize the system so observations arrive time-aligned, ready for inference.

About the role

You’ll build the compute platform that schedules and runs robot models on shared GPUs. You’ll own placement, model lifecycle, and service reliability across inference, training, and evaluation workloads, accounting for the latency and continuity requirements of active robot sessions.

What you’ll do
  • Develop scheduling and admission control based on model memory, accelerator capacity, session requirements, and measured network and inference latency.
  • Build model loading, warm pools, caching, and container lifecycle management to reduce startup delays and avoid disruption during capacity changes.
  • Coordinate inference-serving behavior with performance engineers, balancing batching and GPU utilization against observation freshness and response deadlines.
  • Isolate customer workloads and manage quotas, resource contention, and priority so background training or evaluation cannot silently degrade live robot sessions.
  • Implement health checks, failure recovery, staged model rollouts, and rollback, preserving the session and version information needed to diagnose incidents.
  • Instrument queue time, GPU utilization, memory pressure, deadline misses, and serving cost; use workload replay and load tests to guide capacity planning.
What we are looking for
  • Experience building distributed infrastructure, schedulers, runtimes, or ML platforms that run production workloads.
  • Strong systems programming in Go, Rust, C++, or Python and sound judgment about concurrency, failures, and consistency.
  • Understanding of Linux, containers, networking, storage, and how resource limits affect application performance.
  • Experience operating services with clear reliability targets and debugging problems across application and infrastructure boundaries.
  • Ability to translate workload measurements into scheduling and architecture decisions, including tradeoffs between utilization and latency.
Nice to Have
  • Experience with Kubernetes, Ray, Slurm, custom schedulers, or GPU-aware container runtimes.
  • Work on inference serving, checkpoint/restore, model caching, multi-GPU workloads, or accelerator isolation.
  • Experience with latency-sensitive robotics, multimodal models, or scheduling mixed training and inference workloads.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Machine Learning Infrastructure Engineer, Kernel Optimization
Machine Learning Infrastructure Engineer, Kernel Optimization

Efference • San Francisco (CA)

Vor Ort
USD 180.000 - 240.000
Robotics ML Infrastructure Engineer
Robotics ML Infrastructure Engineer

Efference • San Francisco (CA)

Vor Ort
USD 180.000 - 240.000
Robotics Software Engineer, Infrastructure
Robotics Software Engineer, Infrastructure

Efference • San Francisco (CA)

Vor Ort
USD 150.000 - 190.000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • USA

Vor Ort
USD 180.000 - 240.000
Software Engineer, Inference Infrastructure
Software Engineer, Inference Infrastructure

Rhoda AI • Mountain View (WY)

Vor Ort
USD 150.000 - 190.000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • USA

Remote
USD 180.000 - 320.000
ML Infra Engineer, Compute
ML Infra Engineer, Compute

Physical Intelligence • San Francisco (CA)

Vor Ort
USD 180.000 - 260.000
Founding Software Engineer (ML-Infra)
Founding Software Engineer (ML-Infra)

Reflection Robotics Inc. • Seattle (WA)

Vor Ort
USD 150.000 - 210.000
Member of Technical Staff, GPU & Distributed Systems
Member of Technical Staff, GPU & Distributed Systems

Reactor • San Francisco (CA)

Vor Ort
USD 160.000 - 230.000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity AI • San Francisco (CA)

Vor Ort
USD 180.000 - 280.000