Distinguished Engineer, Cloud Architecture

NVIDIA; United States; Remote; USD 308,000 - 472,000; Full time

Job summary

NVIDIA invites you to join a team at the forefront of technological advances, where you will lead the architecture for next-gen GPU clouds. This role demands a skilled technical leader with extensive experience in cloud infrastructure and a passion for mentoring. As part of a dynamic company committed to diversity, you will influence the direction of products that shape the future of AI and cloud technologies.

Benefits

Competitive salary

Generous benefits package

Opportunities for equity

Qualifications

• 15+ years of experience in large-scale systems or cloud infrastructure.
• Hands-on expertise with GPU platforms and workload orchestration.
• Excellent communication skills to interact with executives and engineers.

Responsibilities

• Lead architecture of next-gen GPU clouds for balance in performance and efficiency.
• Design and implement provisioning systems and control planes.
• Drive external partnerships and represent NVIDIA at industry forums.

Skills

GPU platforms

High-bandwidth fabrics

Distributed storage

Workload orchestration

Communication

Education

Bachelor’s, Master’s, or PhD in Computer Science

Tools

Kubernetes

Slurm

Terraform

BMaaS tooling

Job description

Join the team that powers every breakthrough from autonomous vehicles to generative AI. NVIDIA’s DGX Cloud and GB200 superchip platforms are redefining what’s possible in the data center. We’re seeking a technical leader who can transform ground breaking hardware, open software, and cloud-native practices into reference designs that anyone—from hyperscalers to research labs—can deploy with confidence and speed. If you enjoy teamwork, care about sustainable performance, and are passionate about mentoring emerging talent, this role is for you.

What You’ll Be Doing:

• Lead the architecture of next-generation GPU clouds on DGX/HGX/GB200 platforms—balancing performance, energy efficiency, and lifecycle simplicity.

• Build modular blueprints that integrate NVSwitch, NVLink 5.0, Spectrum-X, InfiniBand, and BlueField DPUs into secure, multi-tenant “AI Factory” architectures. Publish and validate reference designs for Bare-Metal-as-a-Service, virtualized, and Kubernetes-native stacks, partnering with engineering and operations teams to deploy them in production environments.

• Build comprehensive end-to-end infrastructure pipelines.

• Design and implement Redfish/IPMI/iPXE provisioning systems, Slurm and Kubernetes control planes, virtual networking solutions, and distributed storage architectures. Influence strategy across silicon, networking, software, and AI infrastructure groups—ensuring unified vision from chip to cloud.

• Drive external partnerships and industry leadership.

• Represent NVIDIA at key industry forums including OCP, CNCF, UCF, and major cloud service providers. Lead co-design efforts that accelerate customer success while guiding critical trade-offs in power consumption, cost optimization, density requirements, and operational simplicity—always prioritizing business impact and sustainability.

What We Need to See:

• 15+ years proven experience crafting and shipping large-scale systems or cloud infrastructure with measurable real-world impact

• Hands-on expertise with GPU platforms, high-bandwidth fabrics (InfiniBand/Spectrum/RoCE), distributed storage, and workload orchestration

• Production experience with Kubernetes, Slurm, Terraform, and BMaaS tooling across bare-metal, VM, and container ecosystems

• Proven track record delivering secure, scalable, multi-tenant infrastructure in production environments

• Bachelor’s, Master’s, or PhD in Computer Science, Electrical/Computer Engineering, or related field (or equivalent experience)

• Excellent communication skills—able to build technical architecture documentation and work optimally with both executives and engineers

Ways to Stand Out from the Crowd:

• Direct experience with GB200, NVSwitch 5.0, Magnum IO, DOCA, or Spectrum-X deployments

• Deep understanding of AI/ML training and inference pipelines, GPU scheduling, and multi-tenant cluster management

• Hands-on design experience across AWS, Azure, OCI, or GCP plus hybrid-cloud architecture patterns

• Active contribution to OCP, UCF, Kubernetes SIGs, or similar industry standards bodies

• Leadership experience mentoring senior engineers and leading cross-organizational architecture programs with VP/C-suite visibility

With competitive salaries and a generous benefits package (www.nvidiabenefits.com ), we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our best-in-class engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you!

The base salary range is 308,000 USD - 471,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.