Senior Generative AI Infrastructure Architect (GPU Clusters)

NVIDIA Corporation; Santa Clara (CA); Remote; USD 184,000 - 357,000; Full time

Job summary

NVIDIA is seeking an AI Solutions Architect with deep hands-on experience in large-scale GPU systems. You will work with leading consumer internet companies and frontier labs: accelerating workloads, designing high-performance AI infrastructure, and leading technical engagements around NVIDIA technologies.

Join a team that values cutting-edge infrastructure, collaboration with engineering and product teams, and travel for on-site customer meetings.

Qualifications

• BS, MS, or PhD in CS/EE/Physics/Math or equivalent.
• 6+ years in AI infrastructure, systems engineering, HPC, networking or related role.
• Deep understanding of Linux systems and distributed computing.
• Hands-on design/operation of large-scale GPU networks using InfiniBand, RoCE, or GPUDirect RDMA.
• Experience debugging NCCL communication and distributed performance.
• Experience profiling AI workloads and bottlenecks across compute, network, storage.
• Experience with Kubernetes/Slurm and containerized production monitoring.

Responsibilities

• Collaborate with customers to maximize GPU utilization and throughput while reducing costs.
• Design and optimize large-scale AI clusters across compute, networking, storage, orchestration.
• Profile distributed training to identify bottlenecks across GPUs, CPUs, memory.
• Diagnose issues spanning InfiniBand, RoCE, cloud interconnects, NCCL, NVLink, NVSwitch.
• Lead POCs and performance studies; develop benchmarks, runbooks, and collateral.
• Partner with engineering, product, and sales to win designs based on requirements.

Skills

Linux

Distributed computing

GPU architectures

NCCL

Python

Kubernetes

Education

BS/MS/PhD in CS/EE/Physics/Math or equivalent

Tools

NCCL tests

DCGM

Nsight Systems

Fabric counters

Job description

NVIDIA is seeking an AI Solutions Architect with deep hands-on experience in large-scale GPU systems. You will work with leading consumer internet companies and frontier labs: accelerating workloads, designing high-performance AI infrastructure, and leading technical engagements around NVIDIA technologies.

Join a team that values cutting-edge infrastructure, collaboration with engineering and product teams, and travel for on-site customer meetings.