Senior AI Inference Architect for Scalable LLM Deployments (EMEA)

NVIDIA Corporation

España

On-site

EUR 110,000 - 160,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

NVIDIA Corporation is seeking a Senior Solutions Architect to lead AI inference strategy across EMEA, partnering with frontier labs and enterprises deploying AI at scale. You will define the technical direction and drive deployment-ready solutions, aligning NVIDIA teams with customer programs to remove bottlenecks and accelerate production use of large-scale models.

The role requires a strong background in LLM/VLM inference optimization, transformer acceleration, and scalable pipeline design,

Qualifications

  • MS or PhD in Computer Science, Engineering, or equivalent experience.
  • 8+ years in AI/ML infrastructure, with deep expertise in LLM/VLM inference optimization and production deployment at scale.
  • Deep understanding of transformer inference acceleration: quantization (INT4/FP8), speculative decoding, disaggregated inference, continuous batching, KV cache optimization, and WideEP for MoE models.
  • Understanding of GPU memory hierarchies and low-latency networking along with their influence on inference performance.
  • Proven track record to lead technical initiatives.
  • Excellent communication skills, effective with research scientists, infrastructure engineers, and executive team members.

Responsibilities

  • Lead the inference strategy for a portfolio of EMEA AI Native customers from PoC to production-scale deployments.
  • Identify inference challenges across deployments including latency, efficiency, cost per token, memory utilization, and low-latency networking.
  • Architect and optimize high-performance inference pipelines using NVIDIA Dynamo, TensorRT-LLM, vLLM, SGLang, and other inference backends, improving GPU utilization and AI cluster efficiency.
  • Translate customer insights and deployment patterns into actionable product feedback that develops the roadmap for NVIDIA stack such as Dynamo, TensorRT-LLM, and NIM.

Skills

LLM optimization
GPU memory
Inference scalability
Kubernetes orchestration
Transformer acceleration
Communication

Education

MS/PhD in CS/Engineering

Tools

TensorRT-LLM
NVIDIA Dynamo
Triton Inference Server
vLLM
SGLang
NIM
Kubernetes

Job description

NVIDIA Corporation is seeking a Senior Solutions Architect to lead AI inference strategy across EMEA, partnering with frontier labs and enterprises deploying AI at scale. You will define the technical direction and drive deployment-ready solutions, aligning NVIDIA teams with customer programs to remove bottlenecks and accelerate production use of large-scale models.

The role requires a strong background in LLM/VLM inference optimization, transformer acceleration, and scalable pipeline design,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Training Architect: MoE & Distributed DL (EMEA)
Senior AI Training Architect: MoE & Distributed DL (EMEA)

NVIDIA Corporation • Spain

On-site
EUR 120,000 - 190,000
Government AI Solutions Architect — Strategy & Deployments
Government AI Solutions Architect — Strategy & Deployments

NVIDIA Corporation • Spain

On-site
EUR 90,000 - 120,000
Senior AI Application Engineer – GenAI & Edge Inference
Senior AI Application Engineer – GenAI & Edge Inference

Axelera AI • Spain

Remote
EUR 110,000 - 150,000
Pension plan
Extensive employee insurances
Company shares
Senior AI Architect
Senior AI Architect

Brillio • Castilla-La Mancha

On-site
EUR 120,000 - 180,000
Solution Architect, Local Government AI
Solution Architect, Local Government AI

NVIDIA • Madrid

Hybrid
EUR 110,000 - 150,000
CUDA & AI Performance Engineer for LLM Inference
CUDA & AI Performance Engineer for LLM Inference

MWDN Ltd. • Madrid

On-site
EUR 90,000 - 150,000
PTO 29 days
10 paid recovery days
Free English classes
+2
Enterprise AI Infrastructure Engineer — Deploy & Optimize
Enterprise AI Infrastructure Engineer — Deploy & Optimize

Data Direct Networks • Spain

On-site
EUR 70,000 - 110,000
Highly Competitive Vacation Plans
Paid Holidays
Bonus Programs
+5
Enterprise AI Solutions Architect for Scalable Cloud
Enterprise AI Solutions Architect for Scalable Cloud

develop • Spain

On-site
EUR 90,000 - 120,000
Solution Architect, Local Government AI
Solution Architect, Local Government AI

NVIDIA Corporation • Spain

On-site
EUR 90,000 - 120,000
AI Solutions Architect for Local Government (Flexible Work)
AI Solutions Architect for Local Government (Flexible Work)

NVIDIA • Madrid

Hybrid
EUR 110,000 - 150,000