Senior AI Inference Solutions Architect (LLM Scale)

NVIDIA Corporation; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Health insurance (if offered)

Job summary

NVIDIA Corporation is seeking a Senior Solutions Architect to lead large-scale neural network inference initiatives across EMEA. You will drive technical direction, identify bottlenecks, and develop scalable, high-impact AI inference solutions in collaboration with frontier labs and enterprise customers.

You will architect end-to-end inference pipelines, optimize GPU utilization, and provide strategic feedback to shape the roadmap for Dynamo, TensorRT-LLM, NIM, and related NVIDIA tools.

Qualifications

• MS or PhD in Computer Science, Engineering, or equivalent experience.
• 8+ years in AI/ML infrastructure with production deployment at scale.
• Deep expertise in transformer inference acceleration (INT4/FP8, spec. decoding, KV cache).
• Experience leading technical initiatives and communicating with researchers and engineers.

Responsibilities

• Lead the inference strategy for a portfolio of EMEA AI Native customers from PoC to production-scale deployments.
• Architect and optimize high-performance inference pipelines using NVIDIA Dynamo, TensorRT-LLM, vLLM, SGLang and other backends.
• Translate deployment patterns into actionable product feedback to inform roadmaps for NVIDIA stack.
• Collaborate with customers and internal teams to align technology decisions and drive scalable AI inference at scale.

Skills

LLM inference optimization

Technical leadership

Production deployment

Communication

Problem solving

Education

MS/PhD in Computer Science or related

Tools

TensorRT-LLM

NVIDIA Dynamo

NIM

Triton Inference Server

Kubernetes

vLLM

SGLang

Job description

NVIDIA Corporation is seeking a Senior Solutions Architect to lead large-scale neural network inference initiatives across EMEA. You will drive technical direction, identify bottlenecks, and develop scalable, high-impact AI inference solutions in collaboration with frontier labs and enterprise customers.

You will architect end-to-end inference pipelines, optimize GPU utilization, and provide strategic feedback to shape the roadmap for Dynamo, TensorRT-LLM, NIM, and related NVIDIA tools.