Senior ML Engineer — Real-Time AI Inference at Scale

Inworld, Inc.; Mountain View (CA); On-site; USD 250,000 - 300,000; Full time

Benefits offered by this job

Relocation assistance

Equity

Benefits

Job summary

Inworld is hiring a senior engineer to advance real-time AI inference at scale in a Mountain View campus setting. You will push performance/latency across multimodal models, containerize research into production, and own end-to-end serving pipelines with a focus on reliability and throughput.

You should bring a PhD or equivalent practical experience in CS/physics/math, strong C++/CUDA skills, and a track record of contributing to high-performance ML systems.

Qualifications

• PhD or equivalent practical experience in CS, physics, math or related field.
• Proven ability to build backend/ML systems and scale inference.
• Experience with high-performance computing and large-scale serving infrastructure.

Responsibilities

• Take models from research to production-ready serving.
• Containerize models and optimize their serving for sub-second multimodal inference.
• Design and maintain scalable backend and inference engines for real-time workloads.
• Contribute to open-source projects or publish technical write-ups.

Skills

Inference optimization

Model acceleration

High-performance systems

Distributed systems

Public/open-source work

Full-cycle ownership

Education

PhD in CS, Physics, Math

Tools

C++

CUDA

Rust

Python

Kubernetes

Ray

Job description

Inworld is hiring a senior engineer to advance real-time AI inference at scale in a Mountain View campus setting. You will push performance/latency across multimodal models, containerize research into production, and own end-to-end serving pipelines with a focus on reliability and throughput.

You should bring a PhD or equivalent practical experience in CS/physics/math, strong C++/CUDA skills, and a track record of contributing to high-performance ML systems.