Robotics AI Inference Engineer Intern

Rhoda AI; Mountain View (CA); On-site; USD 55,000 - 83,000; Part time

Job summary

Rhoda AI is seeking an Inference Infrastructure Engineer Intern to optimize model inference across the stack, from data pipelines to GPU kernels. You will own a scoped project end to end, ship it into production or research workflow, and present results to the team.

You will work with infra and research engineers to accelerate real-world robot model inference, applying quantization, low-precision techniques, and compiler/runtime optimizations while gaining mentorship and hands-on GPU compute

Qualifications

• Pursuing BS/MS/PhD in CS/EE or related field.
• Strong Python and/or C++ programming.
• Solid understanding of deep learning fundamentals and at least one framework (PyTorch preferred).
• Comfortable reading performance data and reasoning about trade-offs between latency, throughput, memory, and accuracy.

Responsibilities

• Profile and benchmark inference for large video and world models to find bottlenecks in latency, throughput, and memory.
• Apply and evaluate inference optimization techniques like quantization and low-precision inference, step distillation and sampling acceleration for diffusion-style models, attention and caching optimizations across frames, model compilation, and graph-level optimizations.
• Make data movement and processing more efficient: video decoding and preprocessing, input pipelines, host-device transfer, caching, and storage/IO paths that feed inference and training.
• Write and tune GPU kernels (CUDA, Triton, or similar) for performance-critical operators, and integrate them into our inference stack.
• Build tooling and benchmarks that let the team track performance regressions and improvements reliably.
• Work with researchers to turn promising ideas into production-quality infrastructure.

Skills

ML inference optimization

Data pipeline optimization

GPU kernel optimization

Education

BS/MS/PhD in Computer Science or Electrical/CS related field

Tools

PyTorch

CUDA

Triton

ONNX Runtime

Job description

Rhoda AI is seeking an Inference Infrastructure Engineer Intern to optimize model inference across the stack, from data pipelines to GPU kernels. You will own a scoped project end to end, ship it into production or research workflow, and present results to the team.

You will work with infra and research engineers to accelerate real-world robot model inference, applying quantization, low-precision techniques, and compiler/runtime optimizations while gaining mentorship and hands-on GPU compute