Senior GPU Performance Engineer - AI Kernel Optimizer

Advanced Micro Devices, Inc.

Santa Clara (CA)

On-site

USD 180,000 - 260,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Advanced Micro Devices, Inc. in Santa Clara, CA, seeks a GPU Performance Engineer to optimize AI workloads and push the performance of AMD Instinct GPUs.

You will analyze kernels, identify bottlenecks, and drive low-level optimizations across multi-node, multi-GPU systems. Collaborating with kernel, compiler, runtime, framework, and distributed systems teams, you will develop benchmarks and microbenchmarks, and communicate findings to drive hardware-software co-design for future AMD

Qualifications

  • MS/PhD in CS, CE, or related field.
  • Hands-on GPU kernel-level performance analysis and low-level optimization (CUDA/HIP/ROCm).
  • Deep GPU microarchitecture knowledge: pipelines, SIMD, memory, interconnects.
  • Experience using perf counters, traces, profilers, and ISA/assembly to root-cause bottlenecks.
  • Proficient in C++ and GPU kernel programming; Python for automation.
  • Linux, Docker, Git/GitHub skills.
  • Familiar with AI workloads and frameworks (PyTorch, JAX, Megatron-LM, NCCL/RCCL, MPI).

Responsibilities

  • Profile and optimize large-scale AI workloads across multi-node multi-GPU systems.
  • Perform deep GPU kernel-level analysis to identify bottlenecks in compute pipelines and memory.
  • Root-cause performance gaps using performance counters, traces, ISA/assembly, and microbenchmarks.
  • Collaborate with kernel, compiler, runtime, framework, and distributed systems teams to improve performance.
  • Develop and maintain benchmarks, microbenchmarks, and traces for foundation model workloads.
  • Provide kernel- and microarchitecture-level performance insights to inform hardware/software co-design.

Skills

GPU kernel analysis
Low-level optimization
C++ and GPU kernel programming
Python for performance analysis
Linux
Docker
Git/GitHub
AI workloads familiarity

Education

MS or PhD in CS/CE

Tools

CUDA
HIP/ROCm
Performance counters
ISA/assembly analysis
Microbenchmarks
Reproducer kernels

Job description

Advanced Micro Devices, Inc. in Santa Clara, CA, seeks a GPU Performance Engineer to optimize AI workloads and push the performance of AMD Instinct GPUs.

You will analyze kernels, identify bottlenecks, and drive low-level optimizations across multi-node, multi-GPU systems. Collaborating with kernel, compiler, runtime, framework, and distributed systems teams, you will develop benchmarks and microbenchmarks, and communicate findings to drive hardware-software co-design for future AMD

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Performance Software Engineer (AI/Datacenter)
Senior GPU Performance Software Engineer (AI/Datacenter)

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 150,000 - 230,000
Senior GPU Kernel Engineer for AI and LLM Workloads
Senior GPU Kernel Engineer for AI and LLM Workloads

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 150,000 - 190,000
AMD Benefits
Senior GPU Kernel Optimizer for AI & LLM
Senior GPU Kernel Optimizer for AI & LLM

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Senior GPU Performance Engineer - AI Workloads
Senior GPU Performance Engineer - AI Workloads

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 180,000 - 260,000
Senior GPU Kernel Architect for AI & ML
Senior GPU Kernel Architect for AI & ML

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 190,000 - 250,000
Senior GPU/AI Systems Engineer - Performance & ML
Senior GPU/AI Systems Engineer - Performance & ML

AMD • Santa Clara (CA)

On-site
USD 170,000 - 250,000
AMD Benefits
Senior GPU AI Software Engineer — Kernels to Scale AI
Senior GPU AI Software Engineer — Kernels to Scale AI

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
GPU Performance Architect for AI & Graphics
GPU Performance Architect for AI & Graphics

Advanced Micro Devices • Santa Clara (CA)

Hybrid
USD 150,000 - 230,000
Senior GPU Kernel Engineer for AI Infrastructure
Senior GPU Kernel Engineer for AI Infrastructure

Designworks Talent LLC • Bellevue (KY)

Hybrid
USD 170,000 - 250,000
Hybrid work model
Medical, dental, vision insurance
Senior GPU Kernel & Performance Engineer
Senior GPU Kernel & Performance Engineer

Designworks Talent LLC • Bellevue (WA)

Hybrid
USD 180,000 - 240,000
Medical insurance
Dental insurance
Vision insurance
+2