Senior System Architect, Enterprise Reference Architectures

NVIDIA; Boulder (CO); On-site; USD 208,000 - 327,750; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is looking for a Senior System Architect in Boulder, Colorado, to define and design enterprise AI factory reference architectures. This position requires deep experience in data center architecture and the ability to translate customer needs into clear technical requirements.

Candidates should possess at least 12 years in infrastructure architecture and expertise in AI, HPC, and cloud environments. The role offers competitive salary ranging from 208,000 USD to 327,750 USD based on experience.

Qualifications

• 12+ years of software or infrastructure architecture experience.
• 3+ years of experience with micro‑services architectures.
• Experience with system architecture, performance, and networking.

Responsibilities

• Define and drive full-stack enterprise AI factory architectures.
• Architect reference builds for end-to-end software systems.
• Work with cross-functional teams to develop architecture requirements.

Skills

Data center architecture experience

Product and customer instincts

Kubernetes

AI/ML operations

High-performance networking

Automation

Observability

Distributed solutions

Education

Bachelor's degree or equivalent experience

Tools

Kubernetes

Docker

Job description

NVIDIA Enterprise Platforms Group is seeking a Senior System Architect to define, design, and validate enterprise AI factory reference architectures. This role sits at the intersection of product strategy, system architecture, customer requirements, and hands‑on infrastructure validation, helping turn NVIDIA accelerated computing, networking, storage, and AI software into repeatable blueprints that enterprises and partners can deploy with confidence. The ideal candidate brings deep data center architecture experience, strong product and customer instincts, and practical proficiency across accelerated compute, high‑performance networking, storage, Kubernetes, observability, automation, and AI/ML operations. This person can translate ambiguous customer and partner needs into clear requirements, architecture patterns, validation plans, and field‑ready technical mentorship.

What You'll Be Doing

• Define and drive full‑stack enterprise AI factory baseline architectures across compute, networking, storage, virtualization, orchestration, security, observability, and NVIDIA AI software to deliver on‑prem cloud native‑platform and cluster reference builds.
• Architect reference builds for end‑to‑end software systems and platforms based on scalable, portable, and resilient builds and drive evaluation of different platforms, capture information on differences in implementations, and conduct research on the platform behavior under different workloads.
• Work with Product Management, Product Architects, Engineering, Solution Architecture, Program Management, and field teams to develop product direction, architecture requirements, roadmap inputs, and execution plans.
• Develop and validate scalable cluster designs for enterprise AI/ML systems, including on‑premises and hybrid‑cloud deployments optimized for training, fine‑tuning, inference, agentic AI, physical AI, and HPC workloads.
• Evaluate tradeoffs across performance, scalability, resiliency, manageability, security, power, cooling, cost, TCO, and operational complexity.
• Understand design patterns, fundamental business logic, component‑based architecture, and evolutionary architecture.
• Build and detail comprehensive API strategies, middleware integrations, and orchestration workflows to ensure seamless communication across distributed enterprise software.
• Integrate with non‑cloud technologies and third‑party vendor products/services.

What We Need To See

• Bachelor's degree or equivalent experience.
• 12+ years of software or infrastructure architecture experience.
• 3+ years of experience with micro‑services architectures.
• Experience with system architecture, performance, and networking specifically developing and deploying distributed solutions.
• Proven experience designing, building, or maintaining complex AI, HPC, or cloud‑native infrastructure from rack‑scale systems through full data center deployments.
• Proven expertise in crafting and deploying complete software platforms spanning edge, on‑premises, and cloud environments.
• Strong understanding of GPU‑accelerated systems, high‑density servers, PCIe, NVLink, CPU/GPU platform design, rack integration, power, cooling, mechanical constraints, and data center deployment realities.
• Deep networking knowledge across Ethernet, InfiniBand, RDMA, RoCE, routing, switching, congestion control, network segmentation, and high‑performance cluster fabrics.
• Deep proficiency in modern integration patterns, event‑driven architectures (e.g., Kafka, RabbitMQ), and container orchestration (e.g., Kubernetes, Docker).
• Strong grasp of cloud‑native systems with emphasis on high availability, scalability, and security in compute environments.

Ways To Stand Out From The Crowd

• Ability to work optimally with NVIDIA and its partners to deliver prescriptive, validated, and scalable enterprise AI factory architectures that reduce deployment complexity and accelerate time to value.
• Ability to connect product vision, customer feedback, and deep system architecture to develop practical designs that enterprises can deploy, operate, and expand in production.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD – 327,750 USD for Level 5, and 240,000 USD – 379,500 USD for Level 6.

You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.