AI Systems Engineer - HPC

Advanced Micro Devices

San Jose, Northern (CA, KY)

Hybrid

USD 140,000 - 190,000

Full time

7 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

AMD in San Jose, CA is seeking an AI Systems Engineer to design, develop, and administer HPC infrastructure, GPU clusters, and AI workload schedulers.

The role centers on building scalable, high-performance AI/ML platforms, collaborating with cross-functional teams, and implementing automation, monitoring, and security practices across AMD’s AI infrastructure.

Qualifications

  • Experience developing Python-based AI apps and UI.
  • HPC infrastructure engineering for AI/HPC.
  • SLURM and Kubernetes management.
  • GPU cluster management and optimization.
  • Web services with HPC backend.
  • RoCEv2, K8s, KVM, Ubuntu, Python, Shell, GPU drivers, 400G interconnect.
  • AI workload schedulers and allocation optimization.
  • Automation/monitoring with Ansible, Terraform, Prometheus, Grafana.
  • Strong organizational, problem-solving, and multitasking abilities.
  • Excellent communication skills.

Responsibilities

  • Develop, implement, and maintain GPU-based clusters, ensuring optimal performance.
  • Administer ML/AI platforms – Distributed ML, LLMs and AI inference, by managing deployments, resource allocation, monitoring, and security.
  • Automate system provisioning and cluster management end to end.
  • Collaborate with cross-functional teams to address AI infrastructure requirements, support AI projects, and provide technical expertise.
  • Monitor and evaluate AI systems and cluster performance to meet industry and company standards.
  • Leverage AI/ML to improve internal tools and delivery processes.

Skills

Python
AI
HPC
Kubernetes
RoCEv2
KVM
Ubuntu
Shell
GPU drivers
Ansible
Terraform
Prometheus
Grafana
SLURM
Web services
LLMs

Education

Bachelor’s or Master’s in CS/CE

Tools

GA / GPU clusters

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.

AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.

THE ROLE:

We are seeking an AI Systems Engineer to join our AMD ITcomputeplatforms engineering team. The AI Systems Engineeris responsible forthe design, development, and administration of High-Performance Computing (HPC) infrastructure, GPU clusters, and AI workload schedulers.

THE PERSON:

You have a passion for learning. You are passionate about the field of large-scale distributed computing in AI and HPC workloads. You take responsibility for end-to-end outcomes of your efforts. You want to build scalable and highly performant HPC/AI/Data services with AMD hardware, software,peopleand processes. You have a curiosity to learn and improve scalable HPC systems. You havesignificant experiencein working across a globally distributed organization.

KEY RESPONSIBILITIES:
  • Develop, implement, andmaintainGPU-based clusters, ensuringoptimalperformance
  • Administer ML/AI platforms – Distributed ML services, LLMsandAIinferencing, by managing deployments, resource allocation, monitoring, and security.
  • Automate system provisioning and Cluster management end to end
  • Collaborate with cross-functional teams to address AI infrastructure requirements, support AI-related projects, and provide technicalexpertise.
  • Monitor and evaluate the performance of AI systems and clusters, ensuring that they adhere to industry best practices and meet company standards.
  • Use AI/ML to continuously improve internal processes and tools that are used in end-to-end delivery of your services in this team
PREFERRED EXPERIENCE:
  • Experience in developingPython basedAI apps and UI
  • HPC infrastructure engineering for AI/HPC domain
  • SLURM and Kubernetes management
  • Managing GPU clustersoptimizingGPU-based services/tools/software
  • Experience in creating web services with HPC backend (like AI)
  • Proficiencyin RoCEv2, K8s, KVM, Ubuntu, Python, Shell, GPU drivers, and Cluster interconnect with 400G networking.
  • Demonstrated experience with AI workload schedulers and allocation optimization.
  • Automation/monitoring tool - Ansible / Saltstack, Terraform, Prometheus, Grafana
  • Strong organizational, problem-solving, and troubleshooting skills, with the ability to manage multiple projects simultaneously.
  • Excellent verbal and written communication skills, with the ability to collaborate effectively with team members and stakeholders at all levels of the organization.
EDUCATION:

Bachelor's or master's degree in computer science or computer engineering preferred.

LOCATION:

San Jose, CA

This role is not eligible for visa sponsorship.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Systems Engineer - HPC
AI Systems Engineer - HPC

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 180,000 - 260,000
AI Systems Engineer - HPC
AI Systems Engineer - HPC

AMD • San Jose (CA)

On-site
USD 180,000 - 260,000
AMD benefits
AI/HPC Cluster Design Engineer
AI/HPC Cluster Design Engineer

AMD • Austin (TX)

On-site
USD 140,000 - 200,000
AI/HPC Cluster Design Engineer
AI/HPC Cluster Design Engineer

Socket.dev • Austin (TX)

On-site
USD 140,000 - 230,000
AI/HPC Cluster Design Engineer
AI/HPC Cluster Design Engineer

Advanced Micro Devices • Austin (TX)

On-site
USD 120,000 - 180,000
AMD benefits
AI Cluster & Data Center Design Engr
AI Cluster & Data Center Design Engr

Advanced Micro Devices • Austin (TX)

On-site
USD 120,000 - 180,000
AMD benefits
AI Cluster & Data Center Design Engr
AI Cluster & Data Center Design Engr

AMD • Austin (TX)

On-site
USD 120,000 - 180,000
AMD benefits at a glance
AI/HPC Cluster Design Engineer
AI/HPC Cluster Design Engineer

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 120,000 - 190,000
AMD benefits at a glance
AI Cluster & Data Center Design Engr
AI Cluster & Data Center Design Engr

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 140,000 - 190,000
AMD benefits
Equal opportunity employer
Visa sponsorship not available
Systems Design Engineer (AI, Software)
Systems Design Engineer (AI, Software)

Socket.dev • San Jose (CA)

Hybrid
USD 150,000 - 190,000