AI Infrastructure Architect & Systems Lead (HPC & GPU)

Cisco Systems, Inc.; North Carolina; On-site; USD 140,000 - 178,000; Full time

Job summary

Cisco Systems, Inc. is seeking an AI Infrastructure Technical System Engineer and Technical Leader to set architectural direction for enterprise AI platforms.

You will drive complex infrastructure initiatives, mentor engineers, and bridge accelerated hardware with software execution. Collaborate with global teams including AI researchers, hardware, and ecosystem partners to engineer and operate a large-scale AI tech stack.

Qualifications

• Bachelor's degree in Computer Science, Engineering, IT, or related discipline with 5+ progressive experience in enterprise systems engineering, HPC, AI infrastructure, or SRE.
• Proficiency in Python, Go, or Bash, with extensive experience building declarative automation (Ansible, Terraform, CI/CD, GitOps).
• Advanced expertise designing and administering production Kubernetes, Red Hat OpenShift, and HPC workload managers (Slurm, Kueue, Volcano, Ray).
• Strong hands-on understanding of AI backend network fabrics, RDMA technologies (RoCEv2), and high-speed multi-gigabit network topologies.
• In-depth knowledge of enterprise Linux (RHEL/Ubuntu), kernel module lifecycle, memory subsystems, GPU device drivers, and out-of-band management (Redfish, IPMI).

Responsibilities

• Architecture, Strategy & Capacity Engineering: Lead design, qualification, capacity planning, and maintenance of large-scale bare-metal GPU clusters.
• IaC, GitOps & SRE Automation: Champion Site Reliability Engineering and architect IaC deployment pipelines using Ansible, Terraform, Python, Go, and CI/CD tooling.
• AI Workload Orchestration & Systems Performance: Optimize distributed workload scheduling and profile low-level systems performance across frameworks.
• Observability, Governance & Technical Leadership: Establish end-to-end observability, lead RCAs, and mentor engineers to foster innovation.

Skills

Python

Go

Bash

Education

Bachelor's degree in Computer Science, Engineering, IT, or related discipline

Master's degree in Computer Science, Computer Engineering, or related discipline

Tools

Kubernetes

Red Hat OpenShift

Slurm

Kueue

Volcano

Ray

Ansible

Terraform

CI/CD tooling

GitOps

RDMA

RoCEv2

NVIDIA CUDA

AMD ROCm

RHEL/Ubuntu

Job description

Cisco Systems, Inc. is seeking an AI Infrastructure Technical System Engineer and Technical Leader to set architectural direction for enterprise AI platforms.

You will drive complex infrastructure initiatives, mentor engineers, and bridge accelerated hardware with software execution. Collaborate with global teams including AI researchers, hardware, and ecosystem partners to engineer and operate a large-scale AI tech stack.