AI Infrastructure Engineer

AMD

San Jose (CA)

On-site

USD 140,000 - 170,000

Full time

2 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

AMD benefits

Job summary

AMD is seeking a DevOps / Platform Engineer to build and operate large-scale GPU compute infrastructure powering AI/ML workloads. The role emphasizes Kubernetes orchestration across on-prem and multi-cloud, with a focus on platform features and developer tooling.

The ideal candidate has hands-on Kubernetes expertise, experience with Helm and GitOps, and works well in a collaborative, startup-like environment within a large company.

Qualifications

  • Experience in DevOps/Platform or Infrastructure Engineering.
  • Hands-on experience with Kubernetes at scale.
  • Experience building developer-facing platforms or internal developer portals.

Responsibilities

  • Build and extend platform capabilities to enable new workloads.
  • Design and operate Kubernetes orchestration across on-prem and multi-cloud environments.
  • Develop platform features such as secret/config management and deployment automation for customers.
  • Partner with development teams to extend the GPU developer platform with features, templates, and self-service workflows.
  • Manage service lifecycle within Kubernetes using Helm and GitOps (ArgoCD or Flux).
  • Apply storage and networking expertise to design CSI drivers and high-performance GPU workloads.

Skills

DevOps experience
Kubernetes expert
Platform engineering
Observability tooling

Education

Bachelor's or Master's in Computer Science/Engineering

Tools

Kubernetes
Terraform
Prometheus
Grafana
ArgoCD
Flux
CSI drivers

Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.
The Role

We are seeking a DevOps / Platform Engineer to join our team building and operating large-scale GPU compute infrastructure that powers AI and ML workloads.

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.
The Role

We are seeking a DevOps / Platform Engineer to join our team building and operating large-scale GPU compute infrastructure that powers AI and ML workloads.

The Person

The ideal candidate should be passionate about software engineering and possess leadership skills to independently deliver on multi-quarter projects. They should be able to communicate effectively and work optimally with their peers within our larger organization. Finally, you aren't afraid of a team in more of a startup mode at a larger company and willing to jump in to help in areas adjacent to your main project as needed.

Key Responsibilities
  • Build and extend platform capabilities to enable new classes of workloads (e.g., interactive development pods, CI pipelines, inference services, benchmarking jobs).
  • Design and operate scalable orchestration systems using Kubernetes across both on-prem and multi-cloud environments.
  • Develop platform features such as secret management, configuration management, and deployment automation for customers.
  • Partner with development teams to extend the GPU developer platform with features, APIs, templates, and self-service workflows that streamline job orchestration and environment management.
  • Manage service lifecycle within Kubernetes using Helm and GitOps workflows (e.g., ArgoCD or Flux).
  • Apply expertise in storage and networking to design and integrate CSI drivers, persistent volumes, and network policies that enable high-performance GPU workloads.
Preferred Experience
  • Experience in DevOps, Platform, or Infrastructure Engineering.
  • Deep hands-on experience with Kubernetes and container orchestration at scale.
  • Proven ability to design and deliver platform features that serve internal customers or developer teams
  • Experience building developer-facing platforms or internal developer portals (e.g.custom workflow tooling).
  • Hands-on experience in storage or network engineering within Kubernetes environments (e.g., CSI drivers, dynamic provisioning, CNI plugins, or network policy).
  • Experience with Infrastructure as Code tools like Terraform.
  • Background in HPC, Slurm, or GPU-based compute systems for ML/AI workloads.
  • Practical experience with monitoring and observability tools (Prometheus, Grafana, Loki, etc.).
  • Understanding of machine learning frameworks (PyTorch, vLLM, SGLang, etc.).
Preferred Academic Credentials
  • Bachelors or Masters degree in Computer Science, Computer Engineering, or a related field.

LOCATION: San Jose, CA

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer
AI Infrastructure Engineer

Socket.dev • San Jose (CA), Northern (KY)

Hybrid
USD 140,000 - 200,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Advanced Micro Devices • San Jose (CA)

Hybrid
USD 140,000 - 190,000
AI Systems Engineer - HPC
AI Systems Engineer - HPC

AMD • San Jose (CA)

On-site
USD 180,000 - 260,000
AMD benefits
AI Platform Architect
AI Platform Architect

AMD • Austin (TX)

On-site
USD 180,000 - 260,000
Sr. AI/ML Platform Engineer
Sr. AI/ML Platform Engineer

Advanced Micro Devices • Santa Clara (CA)

On-site
USD 190,000 - 260,000
Frontier AI Workloads - Performance and Scalability Engineer
Frontier AI Workloads - Performance and Scalability Engineer

AMD • San Jose (CA)

On-site
USD 150,000 - 200,000
Competitive salary
Health benefits
Career advancement opportunities
Software Development Engineer — GPU Fleet Management & AI Infrastructure
Software Development Engineer — GPU Fleet Management & AI Infrastructure

Advanced Micro Devices • San Jose (CA)

On-site
USD 150,000 - 210,000
Software Engineer, Devops Platform Engineering
Software Engineer, Devops Platform Engineering

AMD • Longmont (CO)

On-site
USD 140,000 - 190,000
Devops Platform Engineer
Devops Platform Engineer

AMD • San Jose (CA)

On-site
USD 140,000 - 210,000
Devops Platform Engineer
Devops Platform Engineer

Advanced Micro Devices • San Jose (CA), Northern (KY)

Hybrid
USD 150,000 - 190,000