Senior ML Engineer: LLM Inference & Optimization

Nebius Group

Zürich

Hybrid

CHF 150.000 - 190.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Competitive compensation
Career growth and learning
Flexibility and ownership
Collaborative and innovative culture
Impactful AI projects
International environment

Zusammenfassung

Nebius Group is seeking a Senior Machine Learning Engineer to own model and endpoint optimization from artifacts to production deployment on the Applied AI team. You will work on model internals, quantization, speculative decoding, and end-to-end optimization to reduce latency, increase throughput, and improve cost per token while preserving quality.

You will collaborate with kernel and platform engineers to validate configurations, benchmark innovations, and ensure safe production rollouts

Qualifikationen

  • Strong engineering skills in Python and PyTorch.
  • Hands-on experience deploying or optimizing LLM/VLM inference.
  • Practical knowledge of modern inference stacks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, NVIDIA Dynamo, Ray Serve, or KServe.
  • Understanding of transformer inference bottlenecks: KV cache, attention, memory bandwidth, batching, parallelism, long-context serving.
  • Ability to quantify trade-offs among latency, throughput, quality, utilization, and cost.
  • Experience designing distributed inference architectures: request routing, distributed scheduling, PDD, multi-node inference, or expert parallelism.
  • Strong communication and collaboration across research, kernel, infrastructure, product, and customer teams.

Aufgaben

  • Own optimization projects for specific model families, customer endpoints, or serving backends.
  • Compare inference engines and recommend serving configurations suited to workloads.
  • Diagnose model-quality and performance regressions during production rollouts.
  • Improve LLM and VLM endpoint latency, throughput, memory efficiency, GPU utilization, quality, and cost per token.
  • Deploy, configure, benchmark, and extend engines such as vLLM, TensorRT-LLM, Triton Inference Server, and NVIDIA Dynamo.
  • Develop production model-compression workflows covering quantization, QAT, distillation, low-bit serving, and accuracy recovery.
  • Implement or integrate speculative decoding, KV-cache optimization, prefix caching, and disaggregated prefill/decode serving (PDD).
  • Design and improve LLM request routers and scheduling policies balancing worker utilization and latency targets.
  • Scale dense and mixture-of-experts inference across multiple GPU nodes with various parallelisms.
  • Build reproducible benchmark harnesses measuring TTFT, TPOT, tokens/sec per GPU, p95/p99 latency, GPU memory, reliability, and cost per token.
  • Collaborate with GPU kernel and platform engineers to trace bottlenecks across model code, kernels, runtime, and cluster layers.
  • Produce design documents, performance reports, rollout plans, and customer-facing explanations.

Kenntnisse

Python
PyTorch
LLM deployment
Distributed inference

Tools

vLLM
SGLang
TensorRT-LLM
Triton Inference Server
NVIDIA Dynamo
Ray Serve
KServe

Jobbeschreibung

Nebius Group is seeking a Senior Machine Learning Engineer to own model and endpoint optimization from artifacts to production deployment on the Applied AI team. You will work on model internals, quantization, speculative decoding, and end-to-end optimization to reduce latency, increase throughput, and improve cost per token while preserving quality.

You will collaborate with kernel and platform engineers to validate configurations, benchmark innovations, and ensure safe production rollouts

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior LLM Inference Optimization Engineer
Senior LLM Inference Optimization Engineer

FDE Times • Zürich

Hybrid
CHF 140.000 - 210.000
Competitive compensation
Career growth
Learning opportunities
+5
Senior AI Inference Scientist: LLM & VLM Optimization
Senior AI Inference Scientist: LLM & VLM Optimization

Nebius Group • Zürich

Vor Ort
CHF 140.000 - 190.000
Competitive compensation
Career growth and learning机会
Flexibility and ownership
+3
Senior AI Inference Scientist - LLM/VLM Optimization
Senior AI Inference Scientist - LLM/VLM Optimization

FDE Times • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior LLM Inference & Model Optimization Scientist–Zurich
Senior LLM Inference & Model Optimization Scientist–Zurich

Nebius Group • Zürich

Hybrid
CHF 180.000 - 240.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior ML Engineer, Agentic Search Platform
Senior ML Engineer, Agentic Search Platform

Nebius • Zürich

Vor Ort
CHF 150.000 - 210.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Machine Learning Engineer, LLM Inference Optimization (opens in a new tab) Zurich
Senior Machine Learning Engineer, LLM Inference Optimization (opens in a new tab) Zurich

Nebius Group • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Scientist, Efficient LLM Inference & Optimization
Senior Scientist, Efficient LLM Inference & Optimization

Nebius • Zürich

Vor Ort
CHF 180.000 - 250.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+2
Senior Machine Learning Engineer, LLM Inference Optimization
Senior Machine Learning Engineer, LLM Inference Optimization

FDE Times • Zürich

Hybrid
CHF 140.000 - 210.000
Competitive compensation
Career growth
Learning opportunities
+5
Senior Applied Scientist, Efficient LLM Inference & Model Optimization (opens in a new tab) Zurich
Senior Applied Scientist, Efficient LLM Inference & Model Optimization (opens in a new tab) Zurich

Nebius Group • Zürich

Hybrid
CHF 180.000 - 240.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Applied Scientist, Efficient LLM Inference & Model Optimization
Senior Applied Scientist, Efficient LLM Inference & Model Optimization

FDE Times • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Top-Standorte