Senior ML Inference Engineer — Real-Time, Remote Options

AIDA Recruitment; Mountain View (CA); Presencial; USD 250.000 - 300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Relocation assistance

Visa support

Descripción de la vacante

AIDA Recruitment is seeking a Senior Machine Learning Engineer for inference to join a fast-growing AI company building real-time voice and LLM technology. You will own inference optimization end-to-end, taking models from research to production at consumer scale and addressing latency and throughput challenges for real-time AI products used by hundreds of millions.

The team focuses on production deployment of models with engines like vLLM and TRT-LLM, working with Kubernetes and multi-GPU

Formación

• 5+ years in ML inference or systems engineering at senior level.
• Experience with vLLM or TRT-LLM engine-level optimization.
• Proficient in C++, CUDA, Rust or optimized Python.
• Experience with Kubernetes, Ray, and multi-GPU/inference scaling.

Responsabilidades

• Own inference optimization end-to-end from research to production.
• Reduce latency and improve throughput for real-time AI workloads.
• Work inside inference engines to improve performance.
• Collaborate with research and product teams to deploy new models.

Conocimientos

ML inference

Systems programming

C++

CUDA

Rust

Python

Kubernetes

Ray

Distributed systems

English

Educación

PhD in CS/Physics/Math

Top CS program degree

Herramientas

vLLM

TRT-LLM

Descripción del empleo

AIDA Recruitment is seeking a Senior Machine Learning Engineer for inference to join a fast-growing AI company building real-time voice and LLM technology. You will own inference optimization end-to-end, taking models from research to production at consumer scale and addressing latency and throughput challenges for real-time AI products used by hundreds of millions.

The team focuses on production deployment of models with engines like vLLM and TRT-LLM, working with Kubernetes and multi-GPU