Senior AI Infrastructure Architect for Enterprise ISVs

NVIDIA; Washington (Washington County); On-site; USD 184,000 - 287,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks outstanding AI Solutions Architects to help customers design, deploy and optimize AI infrastructure across training, fine‑tuning, inference, retrieval, and agentic AI workloads. You’ll advise on accelerated systems architecture and production deployment for AI data centers.

The role spans product, engineering, sales, developer relations, business development, and partner teams, with travel up to 20% and a base salary of 184,000–287,500 USD plus equity and benefits.

Qualifications

• BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience)
• 8+ years of hands‑on experience in AI infrastructure, accelerated computing, distributed systems, cloud infrastructure, high-performance computing, or machine learning platforms
• Strong experience designing, deploying, and operating accelerated computing infrastructure at scale
• In‑depth knowledge of AI cluster orchestration, scheduling, automation and CI/CD deployment pipelines
• Understanding of data center networking technologies such as InfiniBand, Ethernet, RDMA, network configuration or performance tuning
• Familiarity with infrastructure requirements for AI workloads, including distributed training, inference serving, model deployment, storage performance, and cluster reliability
• Excellent presentation, communication, problem‑solving, documentation, and collaboration skills

Responsibilities

• Partner with ISVs on discovery, architecture reviews, technical deep dives, POCs, benchmarks, demos, and production deployment guidance
• Advise on the design, build-out, and optimization of accelerated AI infrastructure, including large-scale clusters
• Support infrastructure design across compute, networking, storage, containers, observability, security, power, and data center operations
• Drive adoption of systems monitoring, telemetry, and management tools to improve cluster utilization, reliability, performance and workload insight
• Build repeatable reference architectures, deployment guides, sizing guidance, benchmark reports, technical playbooks, demos and whitepapers
• Travel up to 20%—customer meetings may be required

Skills

Presentation

Communication

Problem solving

Documentation

Collaboration

Education

BS/MS/PhD in CS/Engineering/Physics

Tools

OpenMPI

NCCL

Distributed training frameworks

GPU communication patterns

Job description

NVIDIA seeks outstanding AI Solutions Architects to help customers design, deploy and optimize AI infrastructure across training, fine‑tuning, inference, retrieval, and agentic AI workloads. You’ll advise on accelerated systems architecture and production deployment for AI data centers.

The role spans product, engineering, sales, developer relations, business development, and partner teams, with travel up to 20% and a base salary of 184,000–287,500 USD plus equity and benefits.