Senior Machine Learning Engineer, Inference

AIDA projektai, MB; Mountain View (CA); Presencial; USD 250.000 - 300.000; Jornada completa

Descripción de la vacante

AIDA projektai, MB is seeking a Senior Machine Learning Engineer for its Inference team in Mountain View, CA. You will own end-to-end inference optimization, moving models from research to consumer-scale production and solving latency/throughput challenges for realtime AI products.

Join a senior team focusing on vLLM/TRT-LLM engines, distributed serving, and GPU-accelerated workloads. This full-time role requires strong English communication and a track record in production ML systems.

Formación

• 5+ years of experience as an ML inference or systems engineer at senior level.
• Hands-on ML inference optimization inside vLLM or TRT-LLM.
• Experience building backend/ML systems and serving models in production.
• Systems programming and GPU optimization with C++, CUDA, Rust or optimized Python.
• Experience with model acceleration techniques and distributed serving.
• Based in the US, Canada, UK, Germany, Switzerland or Serbia.
• Excellent communication skills in English.

Responsabilidades

• Own inference optimization end-to-end from research models to production deployment.
• Optimize latency and throughput of realtime voice and LLM inference at consumer scale.
• Work inside inference engines such as vLLM, TRT-LLM and SGLang to improve performance.
• Apply model acceleration techniques including quantization, distillation, speculative decoding, caching, and paging strategies.
• Write high-performance code for GPU workloads in C++, CUDA, Rust or optimized Python.
• Build and scale distributed multi-GPU and multi-node serving with Kubernetes and Ray.
• Collaborate with research and product teams to bring new models into production.

Conocimientos

ML inference optimization

C++

CUDA

Rust

Kubernetes

Ray

Distributed systems

English fluency

vLLM

TRT-LLM

Model acceleration

Educación

PhD in CS/Physics/Math

Descripción del empleo

Senior Machine Learning Engineer, Inference

Job Summary

For our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise in ML inference optimization to join its inference team.

In this role, you will own inference optimization end-to-end – taking models from research to production at consumer scale and solving latency and throughput problems for realtime AI products used by hundreds of millions of people.

Our client is a well-funded, venture-backed AI research lab and realtime inference provider with a small, senior engineering team.

Team

Inference: The team owns how our client’s models run in production – inference engines, GPU efficiency, model acceleration and the distributed serving infrastructure behind realtime voice and LLM products.

This is an opportunity for senior engineers who want to work deep inside modern inference engines on problems at real consumer scale.

Responsibilities

• Own inference optimization end-to-end, from research models to production deployment;
• Optimize latency and throughput of realtime voice and LLM inference at consumer scale;
• Work inside inference engines such as vLLM, TRT-LLM and SGLang to improve performance;
• Apply model acceleration techniques – quantization, distillation, speculative decoding, caching, continuous batching and paged attention;
• Write high-performance code in C++, CUDA, Rust or optimized Python for GPU workloads;
• Build and scale distributed multi-GPU and multi-node serving with Kubernetes, Ray and custom load balancing for high concurrency;
• Collaborate with research and product teams to bring new models into production.

Requirements

• 5+ years of experience as an ML inference or systems engineer, at senior level (Google L5 / Meta E5 or equivalent);
• Hands-on ML inference optimization inside vLLM or TRT-LLM (engine-level work, not only deployment);
• Experience building backend/ML systems and serving models in production;
• Systems programming and GPU optimization skills: C++, CUDA, Rust or optimized Python;
• Experience with model acceleration: quantization, distillation, speculative decoding, caching, continuous batching, paged attention;
• Distributed systems experience: Kubernetes, Ray, load balancing, multi-GPU/multi-node inference, high concurrency;
• Based in the US, Canada, UK, Germany, Switzerland or Serbia;
• Excellent communication skills in English.

Nice to have

• A track record of fast promotions;
• Public technical work – open-source inference engine contributions or technical write-ups;
• PhD in Computer Science, Physics or Mathematics, or a degree from a top CS program;
• Ability to commute to Mountain View, CA.

The offer

• Project/Client: Fast-growing AI company (realtime voice and LLM)
• Location: Onsite in Mountain View, CA (preferred), or remote in the US, Canada, UK, Germany, Switzerland or Serbia
• Language: English
• Engagement: Full-time
• Contract: Permanent employment
• Salary: $250K–$300K base + competitive equity
• Visa and relocation: H-1B / OPT transfers supported; relocation assistance to the San Francisco Bay Area

Offer and onboarding

Successful candidates will receive an offer and begin the onboarding process.

Information about the processing of your personal data is provided in our Privacy Policy.