Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA; United States; Remote; USD 190,000 - 320,000; Full time

Job summary

NVIDIA is seeking a Product Architect with strong systems architecture expertise to design and shape architectures for connecting AI clusters and datacenter-scale HPC. You’ll translate ideas into well-defined, functional products balancing technical feasibility with user needs.

You’ll lead prototyping, collaborate across hardware, software, security and systems teams, engage with partners and customers to develop POCs and MVPs, and produce comprehensive documentation and technical content.

Qualifications

• 8+ years of experience architecting datacenter-scale HPC or AI infrastructure.
• Bachelor's degree in computer science or related field (or equivalent).
• Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage.
• Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments.
• Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation.
• Exceptional communication skills, with the ability to translate complex technical details for diverse audiences.
• A passion for staying updated with the latest technological advancements in AI and related fields.

Responsibilities

• Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts.
• Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements.
• Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance.
• Iterate and refine designs based on feedback, testing results, and evolving requirements.
• Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems.
• Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision.
• Provide comprehensive documentation for product designs, including technical specifications and user guides.
• Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users.

Skills

Datacenter infra

DevOps tooling

AI workloads

Communication

Continuous learning

Education

Bachelor's degree in CS or related field

Tools

Python

Ansible

Container runtimes

Kubernetes

Job description

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We're on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we're seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you'll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

What you’ll be doing:

• Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
• Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
• Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
• Iterate and refine designs based on feedback, testing results, and evolving requirements
• Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
• Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
• Provide comprehensive documentation for product designs, including technical specifications and user guides
• Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

What we need to see:

• 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
• Bachelors degree in computer science or related field (or equivalent experience).
• Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
• Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
• Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
• Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
• A passion for staying updated with the latest technological advancements in AI and related fields

Ways to stand out from the crowd:

• Prior first-hand experience on having built large scale AI infrastructure
• Advanced certifications or publications in AI, deep learning, or related fields
• Experience leading high-impact projects or initiatives in cutting-edge tech domains

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until August 24, 2026. This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry.

Learn more about NVIDIA.