Senior AI Inference Architect - Large-Scale GPU Pipelines

NVIDIA; France; Sur place; EUR 150 000 - 210 000; Plein temps

Résumé du poste

NVIDIA is seeking a Senior Solutions Architect with deep experience in large-scale production AI inference. You will collaborate with EMEA AI natives, AI infrastructure providers, and enterprises deploying AI at scale.

You will ensure NVIDIA's inference stack achieves best performance, efficiency, and reliability across demanding environments. Lead architectural decisions for multi-node GPU deployments, MoE inference at scale, and innovative optimization techniques while partnering with product

Qualifications

• MS or PhD in Computer Science, Engineering, High-Performance Computing, or equivalent professional experience.
• 5+ years of experience in Neural Networks inference optimization.
• Solid understanding of transformers inference optimization: quantization, disaggregated inference, speculative decoding, continuous batching, KV cache optimization.
• Practical experience in MoE inference at scale: expert parallelism, WideEP, all-to-all communication, routing overhead, and load balancing at scale.
• Ability to engage effectively with ML engineers, researchers, and systems architects at a deep technical level.

Responsabilités

• Guide EMEA AI Natives customers in deploying and optimizing large-scale inference workloads on multi-node GPU clusters.
• Architect efficient inference pipelines for dense and sparse/latent MoE models distributing workload among thousands of GPUs.
• Improve inference efficiency across quantization (INT4/FP8), speculative decoding, disaggregated prefill/decode, KV cache management, and WideEP for large MoE deployments.
• Collaborate with NVIDIA product teams (Dynamo, TensorRT-LLM, NIXL) to accelerate customer success.
• Animate the AI inference developer’s community across EMEA through technical workshops, hackathons, and reference architectures.

Description du poste

NVIDIA is seeking a Senior Solutions Architect with deep experience in large-scale production AI inference. You will collaborate with EMEA AI natives, AI infrastructure providers, and enterprises deploying AI at scale.

You will ensure NVIDIA's inference stack achieves best performance, efficiency, and reliability across demanding environments. Lead architectural decisions for multi-node GPU deployments, MoE inference at scale, and innovative optimization techniques while partnering with product