Software Engineer- GPU/AI/ML

Advanced Micro Devices, Inc.

Santa Clara (CA)

On-site

USD 250,000 - 320,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AMD is hiring a Senior Software Engineer in Santa Clara to advance GPU-based AI workloads. You will shape software from GPU kernels through distributed training and inference, influencing ROCm and related stacks.

You will join a core team focused on AMD hardware and software, collaborating across teams to drive performance and efficiency for foundation models and agentic systems.

Qualifications

  • Expert in modern C++ and large, performance-critical systems.
  • Deep understanding of GPU architecture, memory hierarchy, and kernel optimization.
  • Hands-on delivery on large-scale C++/HIP/CUDA codebases and ML frameworks.

Responsibilities

  • Own the AI software stack from low-level kernels to large distributed systems.
  • Accelerate foundation models and agents for training, post-training, and inference.
  • Co-design hardware and software across the full lifecycle with the AI community.

Skills

Modern C++
GPU kernel engineering
Performance optimization
Profiler usage

Tools

ROCm
HIP/CUDA
rocBLAS
hipDNN
Composable Kernel
AITemplate
cuBLAS
cuDNN
CUTLASS
Thrust
CUB
NCCL
PyTorch
TensorFlow
JAX

Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences-from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you'll discover the real differentiator is our culture. We push the limits of innovation to solve the world's most important challenges-striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

THE ROLE:

At AMD, we build products that accelerate next-generation computing-from AI and data centers to PCs, gaming, and embedded systems. Progress here comes from bold ideas, strong execution, and people who care about hard problems.

This role sits at the center of that mission: making AMD the platform of choice for the most demanding AI workloads by improving how models train, align, and run on our GPUs.

THE PERSON:

We're looking for a senior software engineer who combines deep systems performance work with modern AI—someone who can shape software from GPU kernels through distributed training and inference.

You'll join a core team of specialists working on the latest AMD hardware and software. Your work will directly influence the ROCm ecosystem and how foundation models and agentic systems perform on AMD GPUs.

The challenge: Help train and run AI systems that make AI itself more efficient on GPUs-tuning stacks, kernels, and workflows in ways that can materially shift what's possible on our hardware.

This is a high-impact, hands-on role. You'll own hard technical problems, influence direction across teams, and mentor others as we scale AMD's AI software strategy.

WHAT YOU'LL DO
  • Own the AI software stack: Establish best practices and drive performance from low-level GPU kernels to large-scale distributed systems. Use modern LLMs and agent-based tooling where it accelerates development and tuning of the ROCm ecosystem.
  • Accelerate foundation models and agents: Improve training, post-training, and inference for LLMs and autonomous AI workloads so AMD is the default platform for the most demanding use cases.
  • Co-design hardware and software: Partner on the full lifecycle—from GPU architecture input to software for new accelerators—and engage with the broader AI community to keep AMD at the frontier.
WHAT WE'RE LOOKING FOR

We need someone who can go deep in the areas below and collaborate effectively.

SYSTEMS & GPU PERFORMANCE (KERNEL ENGINEERING)
  • Expert-level modern C++ and design of large, performance-critical systems.
  • Strong grasp of GPU architecture, memory hierarchy, and kernel optimization (HIP/CUDA).
  • Hands‑on delivery on large-scale C++/HIP/CUDA codebases, such as ROCm (rocBLAS, hipDNN, Composable Kernel, AITemplate), the CUDA ecosystem (cuBLAS, cuDNN, CUTLASS, Thrust, CUB, NCCL), and ML framework cores such as PyTorch, TensorFlow, or JAX (C++/HIP/CUDA paths).
  • Comfort diagnosing bottlenecks with profilers (for example, ROCm Profiler and Nsight) in multi‑GPU, distributed settings.
AI POST‑TRAINING & LLM SYSTEMS
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Staff Software Development Engineer- GPU/AI/ML
Senior Staff Software Development Engineer- GPU/AI/ML

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Software Engineer- GPU/AI/ML
Software Engineer- GPU/AI/ML

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 170,000 - 250,000
AMD Benefits
Senior GPU/AI Systems Engineer - Performance & ML
Senior GPU/AI Systems Engineer - Performance & ML

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 170,000 - 250,000
AMD Benefits
Principal / Senior GPU SW Performance Engineer — Post‑Training
Principal / Senior GPU SW Performance Engineer — Post‑Training

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 120,000 - 160,000
Senior GPU AI Software Engineer — Kernels to Scale AI
Senior GPU AI Software Engineer — Kernels to Scale AI

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Frontier AI Workloads - Performance and Scalability Engineer
Frontier AI Workloads - Performance and Scalability Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 150,000 - 200,000
Competitive salary
Health benefits
Career advancement opportunities
Senior AI/ML Solutions Engineer
Senior AI/ML Solutions Engineer

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 190,000 - 230,000
AMD GPU Performance Engineer
AMD GPU Performance Engineer

MindSource • San Francisco (CA)

On-site
USD 140,000 - 190,000
Senior GPU Performance Engineer - AI Workloads
Senior GPU Performance Engineer - AI Workloads

Advanced Micro Devices, Inc • Santa Clara (CA)

On-site
USD 180,000 - 260,000
Senior AI/ML Solutions Engineer
Senior AI/ML Solutions Engineer

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 170,000 - 210,000