Senior LLM Inference Optimization Engineer

FDE Times

Zürich

Hybrid

CHF 140.000 - 210.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Competitive compensation
Career growth
Learning opportunities
Flexibility
Ownership
Collaborative culture
Impactful AI projects
International environment

Zusammenfassung

Nebius is hiring a Senior Machine Learning Engineer on the Applied AI team to own model and endpoint optimization from artifacts to production deployment. You will tackle model internals, quantization, speculative decoding, KV-cache optimization, and inference engine tuning to improve latency, throughput, memory efficiency, GPU utilization, and token cost.

You will collaborate with kernel and platform engineers to diagnose issues, evaluate configurations, and ensure safe production rollouts

Qualifikationen

  • Strong programming skills in Python and PyTorch.
  • Hands-on experience deploying or optimizing LLM/VLM or high-throughput transformer inference.
  • Practical knowledge of modern inference stacks (e.g., vLLM, SGLang, TensorRT-LLM, Triton, NVIDIA Dynamo).
  • Understanding transformer bottlenecks: KV cache, attention, memory bandwidth, batching, parallelism, and long-context serving.
  • Ability to quantify trade-offs among latency, throughput, quality, utilization, and cost.
  • Experience designing distributed inference architectures (request routing, scheduling, PDD, multi-node inference, or expert parallelism).
  • Strong communication and collaboration across research, kernel, infrastructure, product, and customer teams.

Aufgaben

  • Own optimization projects for model families, endpoints, or backends.
  • Compare inference engines and recommend serving configurations per workload.
  • Diagnose model-quality and performance regressions in production.
  • Improve LLM/VLM endpoint latency, throughput, memory efficiency, GPU utilization, and cost per token.
  • Deploy, configure, benchmark, and extend engines like vLLM, SGLang, TensorRT-LLM, Triton, NVIDIA Dynamo.
  • Develop model-compression workflows including quantization and distillation.
  • Implement speculative decoding, KV-cache optimization, and disaggregated prefill/decode serving.

Kenntnisse

Python
PyTorch
LLM deployment
Performance optimization
Distributed inference
Benchmarking
Communication

Ausbildung

Master’s degree in CS/ML

Tools

vLLM
SGLang
TensorRT-LLM
Triton Inference Server
NVIDIA Dynamo

Jobbeschreibung

Nebius is hiring a Senior Machine Learning Engineer on the Applied AI team to own model and endpoint optimization from artifacts to production deployment. You will tackle model internals, quantization, speculative decoding, KV-cache optimization, and inference engine tuning to improve latency, throughput, memory efficiency, GPU utilization, and token cost.

You will collaborate with kernel and platform engineers to diagnose issues, evaluate configurations, and ensure safe production rollouts

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior ML Engineer: LLM Inference & Optimization
Senior ML Engineer: LLM Inference & Optimization

Nebius Group • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior AI Inference Scientist: LLM & VLM Optimization
Senior AI Inference Scientist: LLM & VLM Optimization

Nebius Group • Zürich

Vor Ort
CHF 140.000 - 190.000
Competitive compensation
Career growth and learning机会
Flexibility and ownership
+3
Senior AI Inference Scientist - LLM/VLM Optimization
Senior AI Inference Scientist - LLM/VLM Optimization

FDE Times • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior LLM Inference & Model Optimization Scientist–Zurich
Senior LLM Inference & Model Optimization Scientist–Zurich

Nebius Group • Zürich

Hybrid
CHF 180.000 - 240.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Machine Learning Engineer, LLM Inference Optimization (opens in a new tab) Zurich
Senior Machine Learning Engineer, LLM Inference Optimization (opens in a new tab) Zurich

Nebius Group • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Machine Learning Engineer, LLM Inference Optimization
Senior Machine Learning Engineer, LLM Inference Optimization

FDE Times • Zürich

Hybrid
CHF 140.000 - 210.000
Competitive compensation
Career growth
Learning opportunities
+5
Senior Applied Scientist, Efficient LLM Inference & Model Optimization (opens in a new tab) Zurich
Senior Applied Scientist, Efficient LLM Inference & Model Optimization (opens in a new tab) Zurich

Nebius Group • Zürich

Hybrid
CHF 180.000 - 240.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Applied Scientist, Efficient LLM Inference & Model Optimization
Senior Applied Scientist, Efficient LLM Inference & Model Optimization

FDE Times • Zürich

Hybrid
CHF 150.000 - 190.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+3
Senior Scientist, Efficient LLM Inference & Optimization
Senior Scientist, Efficient LLM Inference & Optimization

Nebius • Zürich

Vor Ort
CHF 180.000 - 250.000
Competitive compensation
Career growth and learning
Flexibility and ownership
+2
Senior Applied Scientist, Efficient LLM Inference & Model Optimization
Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius Group • Zürich

Vor Ort
CHF 140.000 - 190.000
Competitive compensation
Career growth and learning机会
Flexibility and ownership
+3
Top-Standorte