Senior AI Inference Architect — Scale & Disaggregated Serving

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits package

Job summary

NVIDIA is seeking a senior Solutions Architect to reshape AI inference delivery in complex, partner-driven environments. You’ll lead engagements, design full-stack inference architectures, and drive adoption of advanced NVIDIA technologies across large-scale GPU deployments.

Ideal candidates bring deep expertise in distributed systems, Kubernetes-based AI workloads, and disaggregated inference, with strong leadership and customer-facing skills.

Qualifications

• 6+ years in solutions architecture driving customer engagements to deploy distributed systems.
• 2+ years with AI workloads on Kubernetes.
• Experience with NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM.
• Deep knowledge of disaggregated serving, multi-tier KV cache management, quantization and custom inference kernels.
• BS in CS/Engineering or equivalent experience.

Responsibilities

• Work with inference partners to showcase stack and gather product insights.
• Build and operate inference recipes with NVIDIA Dynamo.
• Accelerate inference pipelines using TensorRT-LLM and related backends.
• Advise on devops practices for Kubernetes, compute fabrics, and observability.
• Provide mentorship and technical leadership to customers and internal teams.

Skills

Solutions Architecture

AI workloads on Kubernetes

Customer engagements

Distributed systems

Cloud infrastructure

Education

BS in CS/Engineering

Tools

NVIDIA Dynamo

Triton Inference Server

TensorRT-LLM

Kubernetes

Observability tooling

Job description

NVIDIA is seeking a senior Solutions Architect to reshape AI inference delivery in complex, partner-driven environments. You’ll lead engagements, design full-stack inference architectures, and drive adoption of advanced NVIDIA technologies across large-scale GPU deployments.

Ideal candidates bring deep expertise in distributed systems, Kubernetes-based AI workloads, and disaggregated inference, with strong leadership and customer-facing skills.