Principal Software Engineer: Frontier AI Infra & Platform

NVIDIA

Santa Clara (CA)

On-site

USD 248,000 - 391,000

Full time

8 days ago
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking a Principal Software Engineer to lead the architectural vision for a global compute platform, spanning thousands of nodes, VMs, and containers. You will drive the operationalization of frontier-class AI inference systems and shape the paved road for standardized platforms across autonomous engineering teams.

You will design scalable, self-service architectures using Terraform/OpenTofu, champion GitOps with ArgoCD, and guide migrations of large workloads to modern Kubernetes

Qualifications

  • Bachelor's degree or equivalent experience in Engineering, CS, Mathematics, or related field.
  • 15+ years of proven experience in compute platform engineering or systems architecture with automation at massive scale.
  • Deep Kubernetes expertise and virtualization architectures (KubeVirt/OpenShift).
  • Experience across bare metal, virtualized, and cloud with a unified GitOps posture (ArgoCD or similar).

Responsibilities

  • Define Platform Architecture: Architect and transform the global enterprise compute platform across thousands of nodes, VMs, and containers with OpenShift and KubeVirt.
  • Operationalize Frontier AI Infrastructure: Build automated remediation pipelines, hardware watchdogs, and telemetry for AI inference systems.
  • Drive Strategic Capacity & Scale: Analyze data for capacity planning amid hardware constraints; explore public cloud bursting and alternative compute architectures.
  • Build the 'Paved Road': Create self-service architectures, APIs, and Terraform/OpenTofu providers to encourage adoption by NVIDIA teams.
  • Lead Complex Migrations: Migrate massive legacy workloads to modern Kubernetes orchestration.

Skills

Leadership
Go
Python
Automation

Education

Bachelor’s degree or equivalent

Tools

Kubernetes
OpenShift
KubeVirt
Terraform
OpenTofu
ArgoCD

Job description

NVIDIA is seeking a Principal Software Engineer to lead the architectural vision for a global compute platform, spanning thousands of nodes, VMs, and containers. You will drive the operationalization of frontier-class AI inference systems and shape the paved road for standardized platforms across autonomous engineering teams.

You will design scalable, self-service architectures using Terraform/OpenTofu, champion GitOps with ArgoCD, and guide migrations of large workloads to modern Kubernetes

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Principal Compute Infra Architect (Kubernetes/GPU)
Principal Compute Infra Architect (Kubernetes/GPU)

Nvidia Corporation in • Santa Clara (CA)

Hybrid
USD 248,000 - 391,000
Equity
Benefits
Senior Platform Engineer - AI/ML Infra & Edge CDN
Senior Platform Engineer - AI/ML Infra & Edge CDN

NVIDIA • Santa Clara (CA)

On-site
USD 200,000 - 322,000
Principal Infra Architect for AI-Driven Operations Equity
Principal Infra Architect for AI-Driven Operations Equity

NVIDIA AI • Redmond (WA)

On-site
USD 230,000 - 380,000
Competitive salary
Comprehensive benefits
Equity
Senior Systems Software Engineer: AI Infra & Kubernetes
Senior Systems Software Engineer: AI Infra & Kubernetes

NVIDIA • Seattle (WA)

Hybrid
USD 184,000 - 357,000
Equity
Health benefits
Flexible work arrangement
+1
Principal Software Engineer - Compute Infrastructure
Principal Software Engineer - Compute Infrastructure

Nvidia Corporation in • Santa Clara (CA)

Hybrid
USD 248,000 - 391,000
Equity
Benefits
Principal Software Engineer - Compute Infrastructure
Principal Software Engineer - Compute Infrastructure

NVIDIA • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Equity
Benefits
Principal Architect for Agentic AI Platforms & Foundations
Principal Architect for Agentic AI Platforms & Foundations

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 272,000 - 432,000
Equity
Benefits
Principal Cloud Engineer: Kubernetes & AI Infra, Equity
Principal Cloud Engineer: Kubernetes & AI Infra, Equity

NVIDIA Gruppe • Seattle (WA)

On-site
USD 272,000 - 431,000
Equity
Benefits package
Senior Cluster Infra Architect for Frontier AI — Equity
Senior Cluster Infra Architect for Frontier AI — Equity

RadixArk • Palo Alto (CA)

On-site
USD 200,000 - 400,000
Senior AI Infra Architect: Kubernetes at Scale (Equity)
Senior AI Infra Architect: Kubernetes at Scale (Equity)

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 224,000 - 357,000
Equity
Benefits