Senior Software System Architect, AI Factory Management

NVIDIA Corporation

United States

Remote

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

NVIDIA is seeking a Senior Software System Architect to shape networking management, AIOps platforms, and AI factory solutions for large AI clusters. You will collaborate with customers, internal teams, and product groups to translate operational challenges into scalable architectures and actionable requirements.

The role requires deep technical judgment, broad system perspective, and the persistence to move ideas into production across compute, networking, and management domains.

Qualifications

  • Master's degree in Computer Engineering or Computer Science or equivalent experience.
  • 8+ years in system or software architecture delivering distributed systems in production.
  • Hands-on experience architecting distributed software systems including cloud-native services and deployment/orchestration.
  • Deep understanding of data center infrastructure across compute, networking, and management systems at scale.
  • Ability to connect big picture with precise technical reasoning and translate customer needs into system capabilities.

Responsibilities

  • Define architectures for management and intelligent automation capabilities spanning telemetry, observability, remediation, and operational automation.
  • Engage customers and teams to understand challenges and architect scalable solutions.
  • Partner with Product and Engineering to translate architectural recommendations into prioritized features and requirements.
  • Resolve tradeoffs across hardware, firmware, software, and data platforms with focus on scale and reliability.
  • Guide design decisions through implementation with hands-on PoCs and investigations as needed.
  • Provide system-level leadership and strategic direction across teams.

Skills

Distributed systems design
Cloud-native architectures
Architecture leadership
Technical writing
Requirements translation

Education

Master's degree in Computer Engineering or Computer Science

Tools

Cloud orchestration (Kubernetes)

Job description

What you'll be doing:
  • Define architectures for management and intelligent automation capabilities spanning telemetry, observability, remediation, and operational automation.
  • Engage customers, cluster operations teams, and compute authorities to understand their challenges and architect solutions that improve operational efficiency, reliability, and scalability.
  • Partner with Product and Engineering to translate architectural recommendations into prioritized features and drive their inclusion in the Plan of Record (POR), defining requirements, dependencies, and success criteria.
  • Resolve system tradeoffs across hardware, firmware, software, and data platforms, with attention to scale, reliability, performance, and usability.
  • Guide design decisions through implementation, with hands‑on development of targeted proofs of concept (PoCs) and technical investigations as needed to validate critical assumptions.
  • Offer strategic direction and system‑level leadership throughout teams, guiding engineering choices and promoting sophisticated, AI‑centered operating practices.
What we need to see:
  • MSc. or higher in Computer Engineering or Computer Science (or equivalent experience).
  • 8+ years in system or software architecture, with a record of delivering sophisticated distributed systems in production.
  • Hands‑on experience architecting and delivering distributed software systems, including cloud‑native services, deployment, and orchestration.
  • Deep understanding of data center infrastructure across compute, networking, and management systems, including how these components interact at scale.
  • Ability to connect the big picture with precise technical reasoning—and recognize which details matter.
  • Experience translating customer needs into system capabilities and influencing decisions across technical and product teams.
  • Strong ownership, initiative, and follow‑through, supported by clear technical writing and communication.
Ways to stand out from the crowd:
  • Experience with AI factory infrastructure, large‑scale GPU clusters, HPC, or distributed AI training and inference workloads.
  • Hardware/software co‑design experience spanning compute, networking, firmware, and software.
  • Deep understanding of telemetry and observability platforms, including applying AI/ML.
  • Hands‑on development of LLM agents, including orchestration, tool integration, context management, and evaluation.
  • Contributions to open‑source communities, particularly in AI infrastructure or observability.

NVIDIA is looking for a Senior Software System Architect to join the team shaping networking management systems, AIOps platforms, and applied AI solutions for AI cluster operations. You will work with customers, internal operational teams, fellow architects, Product, and Engineering teams to translate sophisticated operational challenges into clear requirements and scalable architectures, and carry these capabilities through implementation and delivery into products that deliver measurable value for customers.

We seek someone with deep technical judgment, a broad system perspective, and the persistence to move ideas into production‑someone who asks sharp questions, catches consequential details, and builds alignment across teams.

With competitive salaries and a generous benefits package, NVIDIA is widely regarded as one of the technology world's most desirable employers. We offer the opportunity to work with some of the most forward‑thinking engineers in the industry, and due to unprecedented growth, our engineering teams continue to expand. If you are a senior technical leader passionate about intelligent systems, AIOps, and large‑scale AI Factories, we want to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Solutions Architect, NVIDIA AI Factory Infrastructure
Senior Solutions Architect, NVIDIA AI Factory Infrastructure

NVIDIA Corporation • United States

Remote
USD 184,000 - 288,000
Equity
Senior Solutions Architect, NVIDIA AI Factory Infrastructure
Senior Solutions Architect, NVIDIA AI Factory Infrastructure

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Software Architect, Networking AI
Senior Software Architect, Networking AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Solutions Architect, Enterprise AI Factories
Senior Solutions Architect, Enterprise AI Factories

NVIDIA Corporation • Santa Clara (CA)

Remote
USD 152,000 - 288,000
Equity and benefits
Senior Solutions Architect, NVIDIA AI Factory Infrastructure
Senior Solutions Architect, NVIDIA AI Factory Infrastructure

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity compensation
Benefits
Senior Solutions Architect, AI Infrastructure Build Readiness - Execution
Senior Solutions Architect, AI Infrastructure Build Readiness - Execution

NVIDIA Corporation • California

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Architect, Scaled AI Inference & Orchestration
Senior Architect, Scaled AI Inference & Orchestration

NVIDIA Corporation • California

On-site
USD 320,000 - 489,000
Equity
Benefits
Senior Solutions Architect, AI Infrastructure Build Readiness - Execution
Senior Solutions Architect, AI Infrastructure Build Readiness - Execution

NVIDIA Corporation • California

On-site
USD 184,000 - 288,000
Senior Solutions Architect, Enterprise AI Factories
Senior Solutions Architect, Enterprise AI Factories

NVIDIA Corporation • United States

Remote
USD 152,000 - 242,000
Remote work locations
Principal Software Architect, Networking AI
Principal Software Architect, Networking AI

NVIDIA Corporation • United States

On-site
USD 272,000 - 431,000
Equity
Benefits