AI Infra Architect & Lead - HPC GPU Clusters

Cisco Systems, Inc; San Jose (CA); On-site; USD 140,000 - 178,000; Full time

Benefits offered by this job

Medical insurance

401(k) plan

Paid parental leave

Job summary

Cisco Systems, Inc is seeking an AI Infrastructure Technical System Engineer and Technical Leader to serve as principal systems architect for enterprise AI platforms. You will define architectural direction, lead large-scale bare-metal GPU clusters, and mentor engineers across global teams.

You will collaborate with Cisco Hardware & Network Architecture, AI researchers, and ecosystem partners to build secure, high-performance HPC infrastructure, implement IaC and GitOps, optimize AI workloads,

Qualifications

• Bachelor’s degree in Computer Science, Engineering, IT, or related discipline with 5+ years of progressive enterprise systems engineering, HPC, AI infrastructure, or SRE experience.
• Proficiency in Python, Go, or Bash with experience building declarative automation (Ansible, Terraform, CI/CD, GitOps).
• Advanced expertise designing production Kubernetes, OpenShift, and HPC workload managers (Slurm, Kueue, Volcano, Ray).

Responsibilities

• Lead architectural design, hardware qualification, capacity planning, and maintenance of large-scale bare-metal GPU clusters.
• Architect resilient, multi-tenant compute and control planes across bare-metal Kubernetes, OpenShift, and HPC cluster managers.
• Oversee IaC and GitOps deployment pipelines; champion Site Reliability Engineering and SLOs.
• Define end-to-end observability standards and mentor engineers to foster innovation.

Skills

Python

Go

Bash

Kubernetes

OpenShift

Terraform

Ansible

CI/CD

GitOps

RDMA

Education

Bachelor’s degree in CS/Engineering

Master’s degree (preferred)

Tools

NVIDIA CUDA

AMD ROCm

Red Hat OpenShift

Terraform

Ansible

Job description

Cisco Systems, Inc is seeking an AI Infrastructure Technical System Engineer and Technical Leader to serve as principal systems architect for enterprise AI platforms. You will define architectural direction, lead large-scale bare-metal GPU clusters, and mentor engineers across global teams.

You will collaborate with Cisco Hardware & Network Architecture, AI researchers, and ecosystem partners to build secure, high-performance HPC infrastructure, implement IaC and GitOps, optimize AI workloads,