Senior AI Infra Architect for Enterprise GPU Clusters

NVIDIA; New York (NY); On-site; USD 184,000 - 287,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI and accelerated computing technologies. At NVIDIA, our solutions architects work across product, engineering, sales, developer relations, business development, and partner teams to help customers design, deploy and optimize AI infrastructure.

This role will focus on helping ISVs adopt NVIDIA accelerated infrastructure for training, fine‑tuning, inference,

Qualifications

• BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience)
• 8+ years of hands‑on experience in AI infrastructure, accelerated computing, distributed systems, cloud infrastructure, high-performance computing, or machine learning platforms
• Strong experience designing, deploying, and operating accelerated computing infrastructure at scale
• In‑depth knowledge of AI cluster orchestration, scheduling, automation and CI/CD deployment pipelines
• Understanding of data center networking technologies such as InfiniBand, Ethernet, RDMA, network configuration or performance tuning
• Familiarity with infrastructure requirements for AI workloads, including distributed training, inference serving, model deployment, storage performance, and cluster reliability
• Excellent presentation, communication, problem‑solving, documentation, and collaboration skills

Responsibilities

• Partner with ISVs on discovery, architecture reviews, technical deep dives, POCs, benchmarks, demos, and production deployment guidance
• Advise on the design, build-out, and optimization of accelerated AI infrastructure, including large-scale clusters
• Support infrastructure design across compute, networking, storage, containers, observability, security, power, and data center operations
• Drive adoption of systems monitoring, telemetry, and management tools to improve cluster utilization, reliability, performance and workload insight
• Build repeatable reference architectures, deployment guides, sizing guidance, benchmark reports, technical playbooks, demos and whitepapers
• Travel up to 20%; customer meetings may be required

Skills

AI infrastructure

Accelerated computing

Distributed systems

Cloud infrastructure

High-performance computing

Machine learning platforms

Technical advisory

Public speaking

Education

BS/MS/PhD in CS/EE/Physics/Math or related fields

Tools

OpenMPI

NCCL

Job description

NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI and accelerated computing technologies. At NVIDIA, our solutions architects work across product, engineering, sales, developer relations, business development, and partner teams to help customers design, deploy and optimize AI infrastructure.

This role will focus on helping ISVs adopt NVIDIA accelerated infrastructure for training, fine‑tuning, inference,