Senior AI Inference Systems Engineer (GPU & HPC)

NVIDIA; France; Sur place; EUR 90 000 - 150 000; Plein temps

Résumé du poste

NVIDIA in France seeks highly skilled software engineers to design and implement AI inference systems that scale large models with extreme efficiency. You will architect high‑performance inference stacks, optimize GPU kernels and compilers, and drive industry benchmarks for accelerated computing.

You will collaborate across inference, compiler, scheduling, and performance teams to push the pareto frontier of ML systems, enabling multi‑GPU, multi‑node, and multi‑cloud workloads.

Qualifications

• Bachelor’s degree (or equivalent experience) in CS/CE/SE with 7+ years of experience; alternatively, Master’s degree in CS/CE/SE with 5+ years of experience; or PhD degree with the thesis and top-tier publications in ML Systems, GPU architecture, or high-performance computing.

Responsabilités

• Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features; profile and optimize the inference framework (vLLM) with methods like speculative decoding, data/tensor/expert/pipeline-parallelism, prefill-decode disaggregation.
• Develop, optimize, and benchmark GPU kernels (hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization; build and extend high-level DSLs and compiler infrastructure to boost kernel developer productivity while approaching peak hardware utilization.
• Define and build inference benchmarking methodologies and tools; contribute both new benchmark and NVIDIA’s submissions to the industry-leading MLPerf Inference benchmarking suite.
• Architect the scheduling and orchestration of containerized large-scale inference deployments on GPU clusters across clouds.
• Conduct and publish original research that pushes the pareto frontier for the field of ML Systems; survey recent publications and find a way to integrate research ideas and prototypes into NVIDIA’s software products.

Connaissances

Python

C/C++

Go

Rust

Parallel programming

Distributed systems

Deep learning

Formation

Bachelor's degree in CS/CE/SE

Master's degree in CS/CE/SE

PhD in ML Systems / GPU architecture / HPC

Outils

Docker

Kubernetes

Slurm

Nsight Systems/Compute

CUDA

MLIR/LLVM

Triton

Description du poste

NVIDIA in France seeks highly skilled software engineers to design and implement AI inference systems that scale large models with extreme efficiency. You will architect high‑performance inference stacks, optimize GPU kernels and compilers, and drive industry benchmarks for accelerated computing.

You will collaborate across inference, compiler, scheduling, and performance teams to push the pareto frontier of ML systems, enabling multi‑GPU, multi‑node, and multi‑cloud workloads.