Principal System Cloud Architect

NVIDIA Corporation; New York (NY); Remote; USD 272,000 - 426,000; Full time

Job summary

NVIDIA Corporation is seeking a Principal System Cloud Architect to define the architectural vision for its GPU Infrastructure-as-a-Service offerings. This role involves building scalable, secure architectures and collaborating with diverse teams to influence product strategies. Ideal candidates will have extensive experience in cloud-scale infrastructures and AI platforms, particularly with NVIDIA technologies.

Benefits

Competitive salary

Generous benefits package

Equity opportunities

Qualifications

• 15+ years in system architecture, focusing on GPU-based IaaS.
• Expertise in GPU platforms and storage technologies.
• Ability to influence product strategies and align with architecture.

Responsibilities

• Lead architectural vision for NVIDIA’s GPU IaaS offerings.
• Define scalable architectures using NVIDIA's full tech stack.
• Collaborate with partners to publish validated reference architectures.

Skills

System architecture

Cloud-scale infrastructure

HPC

AI platforms

Data center networking

Kubernetes

Infrastructure automation

Bar-metal provisioning

Education

MS or PhD in Computer Engineering

Electrical Engineering

related field

Job description

Principal System Cloud Architect page is loaded

Principal System Cloud Architect

Apply locations US, CA, Remote US, Remote time type Full time posted on Posted 2 Days Ago job requisition id JR1998514

We are seeking a Principal System Architect to lead the architectural vision for NVIDIA’s GPU Infrastructure-as-a-Service (IaaS) offerings. This strategic role focuses on defining reference architectures and system blueprints that integrate NVIDIA’s latest innovations — including GB200 Grace Blackwell systems, Spectrum-X, Bluefield, InfiniBand, Storage (Block, File, Object), and AI Enterprise software stacks — into scalable, high-performance cloud infrastructure for on-prem, Neo Clouds, and CSPs.

This role requires deep engagements across hardware, networking, orchestration, and partner ecosystems to define the future of GPU cloud services.

What you’ll be doing:

• Architect Future-Ready GPU Infrastructure

• Define scalable, secure, and efficient architectures for GPU-based IaaS using NVIDIA’s full stack: DGX/HGX, GB200, NVLink/NVSwitch, InfiniBand, and Spectrum-X.

• Lead Reference Architecture Development

• Work with internal engineering, cloud partners, and OEMs to define and publish validated reference architectures covering bare-metal provisioning, virtualization, storage fabrics, and networking.

• Drive End-to-End Cloud Infrastructure Strategy

• Architect solutions for bare-metal-as-a-service, VMaaS, and container orchestration (Kubernetes), integrated with virtual networking (VPCs), Infiniband fabrics, high-performance storage, and AI workloads.

• Influence Product Strategy Across Domains

• Partner with silicon, platform, networking, and software teams to ensure alignment of architecture with NVIDIA’s roadmap for GPU, DPU, and AI services.

• Engage with Ecosystem Partners

• Represent NVIDIA in joint solution development with CSPs, OEMs, and hyperscale customers to align infrastructure strategies and deployment practices.

• Evaluate Trade-Offs and Drive Decisions

• Make high-impact architectural decisions across performance, scalability, multi-tenancy, power efficiency, and manageability

What we need to see:

• 15+ years in system architecture, with deep experience in cloud-scale infrastructure, HPC, or AI platforms.

• Proven expertise in GPU platforms, data center networking (InfiniBand, RoCE, Spectrum), virtual networking, storage, and orchestration technologies.

• Strong understanding of Kubernetes, VM provisioning, bare-metal provisioning, and infrastructure automation.

• MS or PhD in Computer Engineering, Electrical Engineering, related field, or equivalent experience..

• Demonstrated ability to define, document, and present architectural designs and influence cross-functional teams.

Ways to stand out from the crowd:

• Experience with NVIDIA technologies such as DGX, HGX, GB200, NVLink, NVSwitch, BlueField, Magnum IO, and Spectrum-X.

• Deep knowledge of AI/ML workloads, distributed training architectures, and GPU scheduler integration.

• Familiarity with CSP environments (AWS, Azure, OCI, GCP) and hybrid/multi-cloud architectures.

• Participation in open standards and industry bodies (e.g., OCP, CNCF, Kubernetes SIGs).

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers; we have some of the most forward-thinking and hardworking people in the world working for us and, due to unparalleled growth, our outstanding teams are rapidly growing.

The base salary range is 272,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs (5)

Solutions Architect, DGX Cloud

locations 2 Locations time type Full time posted on Posted 6 Days Ago

Distinguished Engineer, Cloud Architecture

locations 2 Locations time type Full time posted on Posted 2 Days Ago

Senior AI Infrastructure Engineer - DGX Cloud

locations 3 Locations time type Full time posted on Posted 6 Days Ago

NVIDIA is the world leader in accelerated computing.

NVIDIA pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI and digital twins is transforming the world's largest industries and profoundly impacting society.