GPU Performance Engineer for AI Models

Advanced Micro Devices, Inc

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AMD in San Francisco seeks a hands-on Performance Engineer to optimize world-class AI workloads. You will profile, design, build, and ship high-performance GPU code, focusing on inference, serving, and training throughput.

You will write CUDA and Triton kernels, tune memory hierarchy, enable FP8/INT8 paths, and push latency down while maximizing utilization across multi-GPU systems. Collaboration with researchers and engineers is essential to productionize models.

Qualifications

  • Profile, design, and ship performance-focused code.
  • Optimize inference/serving latency, throughput, and batching.
  • Tune GPU kernels and enable FP8/INT8 execution.
  • Improve training throughput and GPU utilization.
  • Develop observability and performance models.

Responsibilities

  • Optimize inference and serving end to end at production scale.
  • Write and tune GPU kernels (CUDA, Triton) for hot paths.
  • Optimize training throughput and GPU utilization.
  • Build performance models and profiling workflows.
  • Ensure numerical correctness across precision changes.
  • Collaborate with researchers to productionize models.
  • Contribute to distributed systems that training and inference run on.

Skills

CUDA programming
GPU kernel optimization
Python programming
C++ programming
PyTorch/JAX proficiency
Knowledge of FP8/INT8

Education

BS/MS/PhD in Electrical Engineering, Computer Science, or related field

Tools

CUDA
Triton
Python
C++
PyTorch
JAX
XLA

Job description

AMD in San Francisco seeks a hands-on Performance Engineer to optimize world-class AI workloads. You will profile, design, build, and ship high-performance GPU code, focusing on inference, serving, and training throughput.

You will write CUDA and Triton kernels, tune memory hierarchy, enable FP8/INT8 paths, and push latency down while maximizing utilization across multi-GPU systems. Collaboration with researchers and engineers is essential to productionize models.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Performance Engineer: GPU Kernel & Inference Optimize
Performance Engineer: GPU Kernel & Inference Optimize

WORLD LABS • San Francisco (CA)

On-site
USD 200,000 - 300,000
Performance Engineer
Performance Engineer

Advanced Micro Devices, Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior GPU AI Inference Performance Engineer
Senior GPU AI Inference Performance Engineer

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 280,000
Senior GPU Performance Engineer - AI Kernel Optimizer
Senior GPU Performance Engineer - AI Kernel Optimizer

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 260,000
GPU Performance Architect for AI & Graphics
GPU Performance Architect for AI & Graphics

Advanced Micro Devices, Inc • Santa Clara (CA)

Hybrid
USD 150,000 - 230,000
AI Performance Software Engineer – GPU & DL Optimizations
AI Performance Software Engineer – GPU & DL Optimizations

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 120,000 - 160,000
Comprehensive benefits package
Inclusive culture
Career advancement opportunities
Senior GenAI Inference & GPU Performance Engineer
Senior GenAI Inference & GPU Performance Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 220,000 - 320,000
GPU Performance Engineer | Experienced Hire
GPU Performance Engineer | Experienced Hire

SIG Susquehanna • Pennsylvania

On-site
USD 120,000 - 150,000
AI Inference & Performance Engineer (C/C++, Python)
AI Inference & Performance Engineer (C/C++, Python)

Advanced Micro Devices, Inc. • Austin (TX)

On-site
USD 140,000 - 200,000
GPU Performance Engineer | Experienced Hire
GPU Performance Engineer | Experienced Hire

Susquehanna International Group, LLP • Bala Cynwyd (PA)

On-site
USD 100,000 - 130,000