Distinguished Engineer, Cloud Architecture

NVIDIA; New York (NY); On-site; USD 308,000 - 472,000; Full time

Job summary

A leading technology company seeks a Distinguished Engineer in Cloud Architecture to lead and innovate on next-generation GPU cloud infrastructure. This role demands a technical leader with extensive experience in cloud systems, architecture, and a passion for mentoring. Competitive salary and a comprehensive benefits package available.

Benefits

Generous benefits package

Equity opportunities

Qualifications

• 15+ years experience in large-scale systems or cloud infrastructure.
• Hands-on expertise with GPU platforms and high-bandwidth fabrics.
• Excellent communication skills for architect documentation.

Responsibilities

• Lead architecture of next-gen GPU clouds on DGX platforms.
• Design and implement comprehensive infrastructure pipelines.
• Influence strategy across silicon, networking, software, and AI.

Skills

Leadership

Cloud Infrastructure

AI/ML Understanding

Kubernetes

Distributed Systems

Education

Bachelor's, Master's, or PhD in Computer Science, Electrical/Computer Engineering

Tools

Kubernetes

Terraform

Job description

Join to apply for the Distinguished Engineer, Cloud Architecture role at NVIDIA

1 day ago Be among the first 25 applicants

Join to apply for the Distinguished Engineer, Cloud Architecture role at NVIDIA

Join the team that powers every breakthrough from autonomous vehicles to generative AI. NVIDIA’s DGX Cloud and GB200 superchip platforms are redefining what’s possible in the data center. We’re seeking a technical leader who can transform ground breaking hardware, open software, and cloud-native practices into reference designs that anyone—from hyperscalers to research labs—can deploy with confidence and speed. If you enjoy teamwork, care about sustainable performance, and are passionate about mentoring emerging talent, this role is for you.

What You’ll Be Doing

• Lead the architecture of next-generation GPU clouds on DGX/HGX/GB200 platforms—balancing performance, energy efficiency, and lifecycle simplicity.
• Build modular blueprints that integrate NVSwitch, NVLink 5.0, Spectrum-X, InfiniBand, and BlueField DPUs into secure, multi-tenant “AI Factory” architectures. Publish and validate reference designs for Bare-Metal-as-a-Service, virtualized, and Kubernetes-native stacks, partnering with engineering and operations teams to deploy them in production environments.
• Build comprehensive end-to-end infrastructure pipelines.
• Design and implement Redfish/IPMI/iPXE provisioning systems, Slurm and Kubernetes control planes, virtual networking solutions, and distributed storage architectures. Influence strategy across silicon, networking, software, and AI infrastructure groups—ensuring unified vision from chip to cloud.
• Drive external partnerships and industry leadership.
• Represent NVIDIA at key industry forums including OCP, CNCF, UCF, and major cloud service providers. Lead co-design efforts that accelerate customer success while guiding critical trade-offs in power consumption, cost optimization, density requirements, and operational simplicity—always prioritizing business impact and sustainability.
  
  

What We Need To See

• 15+ years proven experience crafting and shipping large-scale systems or cloud infrastructure with measurable real-world impact
• Hands-on expertise with GPU platforms, high-bandwidth fabrics (InfiniBand/Spectrum/RoCE), distributed storage, and workload orchestration
• Production experience with Kubernetes, Slurm, Terraform, and BMaaS tooling across bare-metal, VM, and container ecosystems
• Proven track record delivering secure, scalable, multi-tenant infrastructure in production environments
• Bachelor’s, Master’s, or PhD in Computer Science, Electrical/Computer Engineering, or related field (or equivalent experience)
• Excellent communication skills—able to build technical architecture documentation and work optimally with both executives and engineers
  
  

Ways To Stand Out From The Crowd

• Direct experience with GB200, NVSwitch 5.0, Magnum IO, DOCA, or Spectrum-X deployments
• Deep understanding of AI/ML training and inference pipelines, GPU scheduling, and multi-tenant cluster management
• Hands-on design experience across AWS, Azure, OCI, or GCP plus hybrid-cloud architecture patterns
• Active contribution to OCP, UCF, Kubernetes SIGs, or similar industry standards bodies
• Leadership experience mentoring senior engineers and leading cross-organizational architecture programs with VP/C-suite visibility
  
  

With competitive salaries and a generous benefits package ( www.nvidiabenefits.com ), we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our best-in-class engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you!

The base salary range is 308,000 USD - 471,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

JR1998516

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing

Referrals increase your chances of interviewing at NVIDIA by 2x

Sign in to set job alerts for “Cloud Engineer” roles.

New York, NY $100,000.00-$150,000.00 2 weeks ago

New York, NY $90,000.00-$115,000.00 2 weeks ago

New York, United States $40.00-$50.00 23 hours ago

New York, NY $165,000.00-$180,000.00 2 weeks ago

New York, NY $180,000.00-$215,000.00 4 months ago

Senior DevOps and Site Reliability Engineer, remote

New York, NY $165,000.00-$200,000.00 3 months ago

New York, NY $145,000.00-$260,000.00 7 months ago

New York, NY $140,000.00-$185,000.00 1 week ago

Senior Software Engineer (Node.js & AWS)

New York, NY $120,000.00-$130,000.00 1 week ago

New York, NY $140,000.00-$180,000.00 2 weeks ago

Azure Operations Engineer (Artificial Intelligence)

New York, NY $140,000.00-$160,000.00 1 day ago

Senior DevOps Engineer, Site Reliability

New York, NY $160,000.00-$200,000.00 1 month ago

New York, NY $140,000.00-$170,000.00 2 months ago

New York, NY $150,000.00-$200,000.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.