Solutions Architect - Rack Scale AI Systems

NVIDIA; Santa Clara (CA); On-site; USD 208,000 - 414,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Solutions Architect to join IPP's Cloud Infrastructure Team. The role focuses on designing and deploying Rack Scale AI products across data centers and labs, working with product teams and engineering to accelerate time to market.

You will lead cross-functional efforts, implement scalable cloud services, and optimize hardware/software deployments. Strong Linux, scripting, and cloud architecture expertise are essential for success.

Qualifications

• Bachelor's or Master's degree in CS or SE, or equivalent experience.
• 12+ years of relevant experience.
• 6+ years of Linux and scripting experience.
• Solid background on OS kernels and system engineering.
• Strong understanding of embedded systems, orchestration & automation systems, data centers and cloud architecture.
• Excellent communication and planning skills.
• Strong problem-solving ability in product engineering, failure analysis and debugging.

Responsibilities

• Work with NVIDIA product teams to understand roadmaps and requirements for Rack Scale AI products.
• Design optimum solutions to deploy products in a datacenter or lab environment using advanced techniques and tools.
• Assist in rollout of new features supporting NVIDIA hardware and technologies.
• Collaborate with engineers, architects, PMs and developers to plan product launches.
• Define and implement full-scale solutions for onboarding into hosted and private cloud environments.
• Solve multi-site deployment challenges to improve time to market for next-gen products.
• Coordinate with system engineering, software engineering, data center teams and vendors to deliver a robust platform from concept to deployment.
• Integrate and optimize cluster deployment methods and manage software stacks for cloud provisioning.

Skills

Linux

Scripting

OS Kernels

Embedded Systems

Orchestration & Automation

Cloud Architecture

Data Center Design

Communication Skills

Planning Skills

Problem Solving

Education

Bachelor's or Master's degree in Computer Science or Software Engineering or equivalent

Tools

MPI

InfiniBand

Job description

NVIDIA is looking for a Solutions Architect to work in IPP's (Infrastructure, Planning and Process) Cloud Infrastructure Team. IPP is a global organization within NVIDIA that works with various other groups such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on thousands of servers helping with the productivity of thousands of NVIDIA's software engineers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra Processors. If you are passionate about distributed infrastructure and ready to build the next generation of cloud services, design creative solutions, mine through data for real problems and fix them, NVIDIA wants you on our team.

What You’ll Be Doing

• Work with NVIDIA Product Teams to understand new product roadmaps and requirements primarily Rack Scale AI Products.
• Find optimum solutions to deploy these products in a datacenter or a lab environment using sophisticated design techniques, services and tools.
• Assist in roll‑out and deployment of new development features aimed at supporting the latest NVIDIA hardware and technologies.
• Work closely with world‑class engineers, architects, technical product managers and application developers setting the best strategies in place for a product launch.
• Define and implement full‑scale solutions for product onboarding into our hosted and private cloud environments.
• Solve sophisticated problems involving multi‑site deployments of NVIDIA products and directly contribute to overall quality of deployments and improve time to market for next‑gen products.
• Collaborate with multi‑functional teams, including system engineering, software engineering, mechanical/thermal engineering, operations, data center teams, external vendors, and other partners to successfully deliver a reliable and robust platform from concept to prototype to deployments.
• Integrate and optimize cluster deployment methods and manage SW stack deployments, including provisioning these services into the cloud.

What We Need To See

• Bachelor's or Master's Degree in Computer Science or Software Engineering, or equivalent experience.
• 12+ years of relevant experience.
• 6+ years of Linux and scripting experience.
• Solid background on OS kernels and system engineering.
• A track record of quickly understanding new technologies outside of your domain expertise and deploying systems in sophisticated configurations from hardware through multiple layers of software in a fast‑paced environment.
• Strong technical skills and understanding of embedded systems, orchestration & automation systems, data centers and cloud architecture, as well as excellent communication and planning skills.
• Strong problem‑solving ability and experience in product engineering, failure analysis and debug, hardware or test design.
• Understanding of dense datacenter design including compute, storage and networking.

Ways To Stand Out From The Crowd

• Understanding of software engineering principles and enterprise system architecture.
• Experience with GPU and compute clusters administration & automation.
• Experience in large‑scale QA environments for product bring‑ups.
• Special skills in large‑scale computing and cluster computing (MPI), data center design including high‑speed interconnect InfiniBand, cluster storage and scheduling related design and/or management experience.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD - 333,500 USD for Level 5, and 256,000 USD - 414,000 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 17, 2026.

This posting is for an existing vacancy.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal‑opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.