Senior GPU/AI Systems Engineer - Performance & ML

AMD; Santa Clara (CA); On-site; USD 170,000 - 250,000; Full time

Benefits offered by this job

AMD Benefits

Job summary

AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs.

The role emphasizes collaboration across teams, architecture input, and scaling AI workloads for demanding use cases in a fast-moving, innovative environment.

Qualifications

• Expert-level C++ for performance-critical systems.
• Strong grasp of GPU architecture, memory hierarchies, and kernel optimization (HIP/CUDA).
• Experience with large-scale C++/HIP/CUDA codebases (ROCm, CUDA ecosys).
• Profiler experience (ROCm Profiler, Nsight) for multi-GPU settings.

Responsibilities

• Own the AI software stack from kernels to distributed systems.
• Improve training, post-training, and inference for LLMs and AI workloads.
• Co-design hardware and software across GPU architectures and accelerators.

Skills

C++

HIP/CUDA

GPU Architecture

Distributed Systems

PyTorch

CUDA paths

NCCL

Education

Bachelor in CS/CE

Master's preferred

Tools

ROCm

Nsight

Job description

AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs.

The role emphasizes collaboration across teams, architecture input, and scaling AI workloads for demanding use cases in a fast-moving, innovative environment.