ML Infrastructure Engineer — Robotics Inference

Roboticsconnected; Mountain View (WY); On-site; USD 150,000 - 190,000; Full time

Job summary

Rhoda AI is building the next generation of generalist intelligent robots and ML infrastructure to support large-scale model workloads. You will design, deploy, and optimize Kubernetes pipelines and GPU scheduling across cloud and on-prem environments, enabling scalable model serving and observability.

Join a fast-growing robotics company with a strong emphasis on reliability, cost-performance, and end-to-end system design, contributing directly to how research translates into real-world robot

Qualifications

• 3+ years of experience in ML infrastructure, MLOps, or distributed systems.
• Strong proficiency with Kubernetes and containerized deployment pipelines.
• Experience with GPU orchestration and resource scheduling across large distributed jobs.
• Experience with cloud providers (e.g., AWS, GCP) and hybrid cloud/on-prem infrastructure.
• Familiarity with ML frameworks (e.g., PyTorch, JAX) and model serving tools (e.g., Triton, Ray Serve, TorchServe).
• Strong debugging instincts and ownership mentality — comfortable driving issues to resolution across the stack.

Responsibilities

• Design and operate large-scale infrastructure to run model workloads across cloud and on-prem environments.
• Build and maintain Kubernetes-based deployment pipelines for managing distributed ML workloads.
• Own resource scheduling and orchestration across GPU clusters — optimizing utilization, workload balancing, and cost-performance tradeoffs.
• Integrate and manage ML frameworks and model serving systems across research and production use cases.
• Build tooling for model deployment, versioning, and observability to support fast iteration cycles.
• Contribute to the reliability and scalability of the infrastructure stack as model complexity and deployment footprint grow.

Skills

ML infrastructure

Distributed systems

Kubernetes

GPU scheduling

Cloud platforms

Tools

Docker

Terraform

SLURM

Job description

Rhoda AI is building the next generation of generalist intelligent robots and ML infrastructure to support large-scale model workloads. You will design, deploy, and optimize Kubernetes pipelines and GPU scheduling across cloud and on-prem environments, enabling scalable model serving and observability.

Join a fast-growing robotics company with a strong emphasis on reliability, cost-performance, and end-to-end system design, contributing directly to how research translates into real-world robot