GPU Kernel Engineer for AI & Open-Source DL

Advanced Micro Devices, Inc.

Santa Clara (CA)

On-site

USD 180,000 - 240,000

Full time

40 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Advanced Micro Devices, Inc. (AMD) is seeking a skilled engineer to optimize and develop deep learning frameworks for AMD GPUs.

The role focuses on kernel performance, large-scale training and inference, and collaboration with internal GPU software teams and external open-source communities. The candidate will work with C++ and Python in Linux environments, with a strong emphasis on SGLang optimization, compiler/toolchain integration, and scalable distributed systems across heterogeneous

Qualifications

  • Bachelor’s degree (or working towards a Master’s) in CS/CE/EE or related field.
  • Strong programming skills in C++ and Python, with experience in Linux environments.
  • Experience with SGLang or similar LLM inference frameworks is highly preferred.
  • Familiarity with GPU architectures and optimization techniques.

Responsibilities

  • Optimize and develop deep learning frameworks for AMD GPUs, enhancing kernel performance and scaling across multi-GPU/multi-node systems.
  • Profile and tune large-scale training and inference models for AMD hardware.
  • Design and optimize high-performance GPU kernels using HIP, CUDA, or related tools.
  • Collaborate with GPU library and compiler teams to integrate kernel-level optimizations with full-stack goals.
  • Contribute to SGLang development and upstream contributions for AMD’s AI software ecosystem.
  • Tune distributed systems for scale-out/inference, and engage with open-source communities.

Skills

C++
Python
Linux
LLM optimization
debugging
profiling

Education

Bachelor’s degree in Computer Science/Engineering

Tools

HIP
CUDA
LLVM/MLIR
Triton
ROCm

Job description

Advanced Micro Devices, Inc. (AMD) is seeking a skilled engineer to optimize and develop deep learning frameworks for AMD GPUs.

The role focuses on kernel performance, large-scale training and inference, and collaboration with internal GPU software teams and external open-source communities. The candidate will work with C++ and Python in Linux environments, with a strong emphasis on SGLang optimization, compiler/toolchain integration, and scalable distributed systems across heterogeneous

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Frameworks & GPU Kernel Engineer
Senior AI Frameworks & GPU Kernel Engineer

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Benefits at a glance
Senior GPU Kernel Architect for AI & ML
Senior GPU Kernel Architect for AI & ML

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 190,000 - 250,000
Senior GPU Kernel Engineer for AI and LLM Workloads
Senior GPU Kernel Engineer for AI and LLM Workloads

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 150,000 - 190,000
AMD Benefits
Senior GPU AI Software Engineer — Kernels to Scale AI
Senior GPU AI Software Engineer — Kernels to Scale AI

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Senior GPU Kernel Engineer for AI & LLMs
Senior GPU Kernel Engineer for AI & LLMs

AMD • San Jose (CA)

On-site
USD 150,000 - 230,000
GPU Kernel Engineer
GPU Kernel Engineer

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Senior GPU Kernel Optimizer for AI & LLM
Senior GPU Kernel Optimizer for AI & LLM

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 240,000
Senior GPU Performance Engineer - AI Kernel Optimizer
Senior GPU Performance Engineer - AI Kernel Optimizer

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 260,000
Sr. Software Development Engineer – GPU Kernel Development
Sr. Software Development Engineer – GPU Kernel Development

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Benefits at a glance
Software Design Engineer - GPU Kernel Optimization
Software Design Engineer - GPU Kernel Optimization

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 240,000