Senior Architect, Enterprise AI Factory Platforms

NVIDIA Corporation; Santa Clara (CA); On-site; USD 208,000 - 380,000; Full time

Job summary

NVIDIA Corporation seeks a Senior System Architect to define, design, and validate enterprise AI factory reference architectures. This role blends product strategy, system architecture, customer requirements, and hands-on validation to turn NVIDIA technologies into repeatable blueprints for deployments.

The ideal candidate has deep data center architecture experience and expertise in AI/ML operations, Kubernetes, observability, and scalable, secure on-prem and hybrid-cloud solutions.

Qualifications

• Bachelor's degree or equivalent experience.
• 12+ years of software or infrastructure architecture experience.
• 3+ years of experience with micro-services architectures.
• Experience with system architecture, performance, and networking for distributed solutions.
• Proven experience designing, building, or maintaining complex AI, HPC, or cloud-native infrastructure.
• Proven expertise in crafting and deploying complete software platforms spanning edge, on-premises, and cloud environments.
• Strong understanding of GPU-accelerated systems and data center deployment realities.
• Deep networking knowledge across Ethernet, InfiniBand, RDMA, RoCE, routing, switching, congestion control, network segmentation, and high-performance cluster fabrics.
• Proficiency in modern integration patterns, event-driven architectures (e.g., Kafka, RabbitMQ), and container orchestration (e.g., Kubernetes, Docker).
• Strong grasp of cloud-native systems with emphasis on high-availability, scalability, and security in compute environments.

Responsibilities

• Define and drive full-stack enterprise AI factory baseline architectures across compute, networking, storage, virtualization, orchestration, security, observability, and NVIDIA AI software to deliver on-prem cloud native-platform and cluster reference builds.
• Architect reference builds for end-to-end software systems and platforms based on scalable, portable, and resilient builds and drive evaluation of different platforms, capture information on differences in implementations, and conduct research on the platform behavior under different workloads.
• Work with Product Management, Product Architects, Engineering, Solution Architecture, Program Management, and field teams to develop product direction, architecture requirements, roadmap inputs, and execution plans.
• Develop and validate scalable cluster designs for enterprise AI/ML systems, including on-premises and hybrid-cloud deployments optimized for training, fine-tuning, inference, agentic AI, physical AI, and HPC workloads.
• Evaluate trade-offs across performance, scalability, resiliency, manageability, security, power, cooling, cost, TCO, and operational complexity.
• Understand design patterns, fundamental business logic, component-based architecture, and evolutionary architecture.
• Build and detail comprehensive API strategies, middleware integrations, and orchestration workflows to ensure seamless communication across distributed enterprise software.
• Integrate with non-cloud technologies and third-party vendor products/services.

Skills

Microservices architectures

Distributed systems design

Networking (high-performance)

GPU-accelerated systems

Kubernetes

Docker

Observability

Automation

AI/ML operations

Education

Bachelor's degree or equivalent experience

Tools

Kubernetes

Docker

NVLink

PCIe

Job description

NVIDIA Corporation seeks a Senior System Architect to define, design, and validate enterprise AI factory reference architectures. This role blends product strategy, system architecture, customer requirements, and hands-on validation to turn NVIDIA technologies into repeatable blueprints for deployments.

The ideal candidate has deep data center architecture experience and expertise in AI/ML operations, Kubernetes, observability, and scalable, secure on-prem and hybrid-cloud solutions.