Senior Generative AI Infrastructure Architect

NVIDIA Corporation; Santa Clara (CA); Remote; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking an AI Solutions Architect to design and operate large-scale AI infrastructure, optimizing GPU clusters and end-to-end workloads for leading consumer internet partners and frontier labs.

You will profile workloads, diagnose complex distributed systems, and drive Proof-of-Concepts with automation, benchmarks, and runbooks, while collaborating with engineering, product, and sales teams to win customer design wins.

Qualifications

• BS, MS or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or related field, or equivalent experience.
• 6+ years in AI infrastructure, systems engineering, HPC, networking, or related technical roles.
• Deep understanding of Linux, distributed computing, GPU architectures and large-scale AI clusters.
• Hands-on experience deploying or operating high-performance GPU networks (InfiniBand, RoCE, GPUDirect RDMA).
• Experience debugging NCCL communication and distributed performance, including topology and routing.
• Experience with cluster schedulers (Kubernetes, Slurm), containers, and production monitoring.

Responsibilities

• Collaborate with customers to maximize GPU utilization and workload throughput while improving reliability and reducing costs.
• Design and optimize large-scale AI clusters across compute, networking, storage, orchestration, and observability.
• Profile distributed workloads to identify bottlenecks across GPUs, CPUs, memory, network, and storage.
• Diagnose complex infrastructure issues spanning InfiniBand, RoCE, cloud interconnects, NCCL, NVLink, and NVSwitch.
• Lead proof-of-concepts and performance studies; develop benchmarking tools, automation, and runbooks.
• Partner with engineering, product, and sales to secure design wins based on customer needs and feedback.
• Advise on NVIDIA infrastructure technologies like DGX/HGX, NVLink, NVSwitch, NCCL, and InfiniBand.

Skills

GPU systems

AI infrastructure

Linux systems

Python

Shell scripting

distributed computing

NCCL

RDMA

Kubernetes

Slurm

Telemetry

Education

BS/MS/PhD in Computer Science/Engineering/Physics

Tools

NVIDIA DGX/HGX

InfiniBand

RoCE

GPUDirect RDMA

NCCL

Nsight Systems

Job description

NVIDIA Corporation is seeking an AI Solutions Architect to design and operate large-scale AI infrastructure, optimizing GPU clusters and end-to-end workloads for leading consumer internet partners and frontier labs.

You will profile workloads, diagnose complex distributed systems, and drive Proof-of-Concepts with automation, benchmarks, and runbooks, while collaborating with engineering, product, and sales teams to win customer design wins.