Senior ML Inference Engineer — Real‑Time, Scalable

AIDA projektai, MB; Mountain View (CA); Presencial; USD 250.000 - 300.000; Jornada completa

Descripción de la vacante

AIDA projektai, MB is seeking a Senior Machine Learning Engineer for its Inference team in Mountain View, CA. You will own end-to-end inference optimization, moving models from research to consumer-scale production and solving latency/throughput challenges for realtime AI products.

Join a senior team focusing on vLLM/TRT-LLM engines, distributed serving, and GPU-accelerated workloads. This full-time role requires strong English communication and a track record in production ML systems.

Formación

• 5+ years of experience as an ML inference or systems engineer at senior level.
• Hands-on ML inference optimization inside vLLM or TRT-LLM.
• Experience building backend/ML systems and serving models in production.
• Systems programming and GPU optimization with C++, CUDA, Rust or optimized Python.
• Experience with model acceleration techniques and distributed serving.
• Based in the US, Canada, UK, Germany, Switzerland or Serbia.
• Excellent communication skills in English.

Responsabilidades

• Own inference optimization end-to-end from research models to production deployment.
• Optimize latency and throughput of realtime voice and LLM inference at consumer scale.
• Work inside inference engines such as vLLM, TRT-LLM and SGLang to improve performance.
• Apply model acceleration techniques including quantization, distillation, speculative decoding, caching, and paging strategies.
• Write high-performance code for GPU workloads in C++, CUDA, Rust or optimized Python.
• Build and scale distributed multi-GPU and multi-node serving with Kubernetes and Ray.
• Collaborate with research and product teams to bring new models into production.

Conocimientos

ML inference optimization

C++

CUDA

Rust

Kubernetes

Ray

Distributed systems

English fluency

vLLM

TRT-LLM

Model acceleration

Educación

PhD in CS/Physics/Math

Descripción del empleo

AIDA projektai, MB is seeking a Senior Machine Learning Engineer for its Inference team in Mountain View, CA. You will own end-to-end inference optimization, moving models from research to consumer-scale production and solving latency/throughput challenges for realtime AI products.

Join a senior team focusing on vLLM/TRT-LLM engines, distributed serving, and GPU-accelerated workloads. This full-time role requires strong English communication and a track record in production ML systems.