Performance Engineer

Advanced Micro Devices, Inc

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AMD in San Francisco seeks a hands-on Performance Engineer to optimize world-class AI workloads. You will profile, design, build, and ship high-performance GPU code, focusing on inference, serving, and training throughput.

You will write CUDA and Triton kernels, tune memory hierarchy, enable FP8/INT8 paths, and push latency down while maximizing utilization across multi-GPU systems. Collaboration with researchers and engineers is essential to productionize models.

Qualifications

  • Profile, design, and ship performance-focused code.
  • Optimize inference/serving latency, throughput, and batching.
  • Tune GPU kernels and enable FP8/INT8 execution.
  • Improve training throughput and GPU utilization.
  • Develop observability and performance models.

Responsibilities

  • Optimize inference and serving end to end at production scale.
  • Write and tune GPU kernels (CUDA, Triton) for hot paths.
  • Optimize training throughput and GPU utilization.
  • Build performance models and profiling workflows.
  • Ensure numerical correctness across precision changes.
  • Collaborate with researchers to productionize models.
  • Contribute to distributed systems that training and inference run on.

Skills

CUDA programming
GPU kernel optimization
Python programming
C++ programming
PyTorch/JAX proficiency
Knowledge of FP8/INT8

Education

BS/MS/PhD in Electrical Engineering, Computer Science, or related field

Tools

CUDA
Triton
Python
C++
PyTorch
JAX
XLA

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger— technology that moves the world forward. Join us and, together, we’ll advance your career.

THE ROLE:

We are looking for a Performance Engineer to make World Labs’ models train and serve as fast as the hardware allows.

Running large generative world models at scale is a novel systems problem. You will find the bottlenecks — in kernels, in the serving path, in the training loop, in how we use our GPUs — and eliminate them. Your ownership is technical and concrete: the throughput you unlock, the latency you cut, the utilization you win back, and the correctness you hold while doing it. You will work up and down the stack, from low-level tensor and kernel optimization to fleet-wide serving efficiency, in close partnership with the researchers whose models you are accelerating.

THE PERSON

This is a hands-on, individual-contributor role. You will profile, design, build, and ship code directly.

KEY RESPONSIBILITIES:
  • Optimize inference and serving end to end — latency, throughput, batching, caching, and scheduling — to serve our models efficiently at production scale.
  • Write and tune GPU kernels (CUDA, Triton) for hot paths; drive kernel fusion, memory- and bandwidth-bound optimization, and low-precision (FP8/INT8) execution.
  • Optimize training throughput and GPU utilization: parallelism strategies, communication/compute overlap, mixed precision, and eliminating pipeline stalls.
  • Build performance models, profiling workflows, and observability that make throughput, latency, cost, utilization, and their tradeoffs legible across the stack.
  • Own numerical correctness across precision, kernel, and hardware changes — treating correctness as part of performance, not separate from it.
  • Partner with researchers to productionize models for serving and to make experiments run faster and more reliably.
  • Where needed, work on the distributed systems that training and inference run on — but the core of the job is squeezing the most out of every GPU.
PREFERRED EXPERIENCE:

You should excel at the fundamentals below — we index on inference, serving, GPU optimization, and training performance. Distributed-systems breadth is welcome, but secondary.

  • Strong performance-engineering foundations: profiling, roofline analysis, latency/throughput optimization, and disciplined root-cause investigation.
  • Deep GPU programming and optimization experience (CUDA and/or Triton) — kernel-level tuning, memory hierarchy, and bandwidth optimization at scale.
  • Hands-on experience optimizing inference and serving for large models: batching, KV/prompt caching, quantization, and low-latency, high-throughput sampling.
  • Hands-on experience optimizing training performance: parallelism, distributed communication, mixed/low precision, and utilization.
  • Working knowledge of ML framework internals (PyTorch and/or JAX; torch.compile, XLA, or similar compiler paths).
  • Strong proficiency in Python, with the ability to drop into C++/CUDA (and Rust or Go) as the work demands.
  • High-ownership mindset — you measure yourself by throughput shipped and latency cut, not tickets closed.
Additional Qualifications
  • Experience at an AI lab or ML-native company, optimizing systems used directly by researchers and productionizing research code.
  • Low-precision and numerics depth: FP8/INT8 quantization, mixed-precision, and detecting numerical regressions across hardware platforms.
  • Distributed systems for large-scale training and inference — collective communication (NCCL), interconnects (NVLink), model and tensor parallelism, and fault tolerance. A strong plus, but not a substitute for the core skills above.
  • Experience serving generative, diffusion, video, or 3D/spatial models — not just text LLMs.
  • Multi-accelerator experience (GPU plus TPU or Trainium) and partnering with hardware vendors on accelerator capabilities.
  • Building performance-modeling and observability frameworks for GPU utilization and cost.
ACADEMIC CREDENTIALS:

BS/MS/PhD in Electrical Engineering, Computer Science, Computer Engineering, or a closely related field.

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Performance Engineer - AI Workloads
Senior GPU Performance Engineer - AI Workloads

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 180,000 - 260,000
Senior GPU Inference Performance Engineer
Senior GPU Inference Performance Engineer

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 180,000 - 280,000
Principal GenAI Inference Optimization Engineer
Principal GenAI Inference Optimization Engineer

Advanced Micro Devices, Inc • San Jose (CA)

On-site
USD 220,000 - 320,000
Senior Staff GPU Datacenter Performance Engineer
Senior Staff GPU Datacenter Performance Engineer

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 140,000 - 210,000
AMD benefits at a glance
Senior GPU Kernel Development Engineer
Senior GPU Kernel Development Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 150,000 - 190,000
AMD Benefits
Software Design Engineer - GPU Kernel Optimization
Software Design Engineer - GPU Kernel Optimization

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Principal Competitive CPU Microarchitecture & Platform Performance Engineer
Principal Competitive CPU Microarchitecture & Platform Performance Engineer

AMD • Texas

On-site
USD 140,000 - 210,000
Frontier AI Workloads - Performance and Scalability Engineer
Frontier AI Workloads - Performance and Scalability Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 150,000 - 200,000
Competitive salary
Health benefits
Career advancement opportunities
Principal / Senior GPU SW Performance Engineer — Post‑Training
Principal / Senior GPU SW Performance Engineer — Post‑Training

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 120,000 - 160,000
Software Design Engineer- GPU Kernel Optimization
Software Design Engineer- GPU Kernel Optimization

AMD • San Jose (CA)

On-site
USD 150,000 - 230,000