Sr. Software Engineer - AI Triton Communication

Advanced Micro Devices, Inc.

United States

On-site

USD 190,000 - 270,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AMD is advancing Triton-based distributed AI for AMD Instinct GPUs, building native distributed execution and communication within the Triton AMDGPU backend. You will optimize inter-GPU data movement, synchronization, and overlap of compute with communication across multi-GPU systems.

The role spans compiler, runtime, and hardware layers, collaborating with architecture and performance teams to deliver scalable GPU infrastructure and contribute to open-source Triton/ROCm projects.

Qualifications

  • Deep experience in compiler development, GPU software, distributed systems, or performance engineering.
  • Familiarity or hands-on experience with Triton compiler and runtime.
  • Deep understanding of modern GPU architectures and inter-GPU communication.

Responsibilities

  • Design and develop native distributed communication and execution capabilities within the Triton AMDGPU backend, enabling scalable multi-GPU execution for large-scale AI workloads.
  • Design and implement Triton compiler and runtime mechanisms for native GPU-initiated communication, including collective operations, remote memory access, synchronization, and distributed execution primitives.
  • Drive performance optimization across compute and communication, including inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling efficiency.
  • Develop and optimize distributed Triton kernels and execution models to achieve high performance, scalability, and efficient hardware utilization for AI workloads.
  • Analyze, profile and debug complex cross-stack issues spanning Triton compiler, runtime, ROCm stack, and GPU hardware execution.
  • Collaborate closely with GPU architecture, compiler, runtime, and performance teams to co-design and enable next-generation distributed GPU programming and execution capabilities.
  • Contribute to open-source Triton and ROCm distributed ecosystem, driving innovation in distributed GPU computing

Skills

Compiler development
GPU software
Distributed systems
Performance engineering
Triton compiler
CUDA/HIP
Inter-GPU communication

Tools

RCCL
NCCL
NVSHMEM
rocSHMEM
MPI

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD. At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger - technology that moves the world forward. Join us and, together, we’ll advance your career.

THE ROLE:

Triton is a widely adopted language and compiler for high-performance GPU kernels, powering major AI frameworks such as PyTorch, vLLM, and SGLang. As AI workloads increasingly scale across multiple GPUs and nodes, first-class support for distributed execution and communication in Triton is strategically critical to enabling efficient large-scale training and inference on AMD Instinct Accelerators. AMD GPUs are an official Triton backend, and delivering industry-leading distributed performance and scalability on AMD Instinct accelerators is a key priority. The performance, scalability, and usability of Triton directly impact the competitiveness of AMD hardware in large-scale AI deployments. In this role, you will advance the Triton compiler and runtime stack for AMD CDNA and next-generation GPU architectures by building native distributed execution and communication capabilities. You will develop compiler and runtime infrastructure that enables efficient inter-GPU communication, scalable execution, and optimal hardware utilization. You will work across compiler, runtime, and hardware layers, collaborating closely with GPU architecture and software teams to help establish AMD GPUs as a best-in-class platform for Triton-based distributed AI.

THE PERSON:

The ideal candidate has deep expertise in GPU architecture, compiler technologies, and distributed GPU systems, with proven experience optimizing workloads at multi-GPU scale. You are comfortable working across the full execution stack - from compiler and runtime to hardware - and understand how GPU execution, memory hierarchy, and inter-GPU communication impact performance. You have experience working close to the GPU runtime, communication stack, or compiler backend, and are motivated to build native distributed execution and communication capabilities tightly integrated with the compiler and runtime to maximize scalability and hardware utilization. You thrive on solving complex system-level performance challenges and delivering scalable, high-performance GPU infrastructure.

KEY RESPONSIBILITIES:
  • Design and develop native distributed communication and execution capabilities within the Triton AMDGPU backend, enabling scalable multi-GPU execution for large-scale AI workloads
  • Design and implement Triton compiler and runtime mechanisms for native GPU-initiated communication, including collective operations, remote memory access, synchronization, and distributed execution primitives
  • Drive performance optimization across compute and communication, including inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling efficiency
  • Develop and optimize distributed Triton kernels and execution models to achieve high performance, scalability, and efficient hardware utilization for AI workloads
  • Analyze, profile and debug complex cross-stack issues spanning Triton compiler, runtime, ROCm stack, and GPU hardware execution
  • Collaborate closely with GPU architecture, compiler, runtime, and performance teams to co-design and enable next-generation distributed GPU programming and execution capabilities
  • Contribute to open-source Triton and ROCm distributed ecosystem, driving innovation in distributed GPU computing
PREFERRED EXPERIENCE:
  • Deep experience in compiler development, GPU software, distributed systems, or performance engineering
  • Familiarity or hands-on experience with Triton compiler and runtime
  • Deep understanding of modern GPU architectures, including execution model, memory hierarchy (LDS, L2, HBM), scheduling, occupancy, and hardware performance characteristics
  • Good understanding of GPU runtime systems, communication stacks, and multi-GPU interconnects such as XGMI, NVLink, PCIe, or InfiniBand and their performance implications
  • Familiarity with distributed GPU communication libraries such as RCCL, NCCL, NVSHMEM, rocSHMEM, or MPI and similar technologies
  • Experience developing, optimizing, and scaling workloads across multiple GPUs, including inter-GPU communication, synchronization, and communication/computation overlap
  • Strong experience with GPU programming using Triton, HIP, CUDA, or similar parallel programming environments
  • Strong knowledge of MLIR and/or LLVM internals
  • Experience profiling, debugging, and optimizing performance across compiler, runtime, and hardware layers
  • Familiarity with ROCm, HIP, CUDA, or similar GPU programming
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Software Engineer - AI Triton Communication
Sr. Software Engineer - AI Triton Communication

Advanced Micro Devices, Inc • Washington

On-site
USD 190,000 - 280,000
Sr. Software Engineer - AI Triton Communication
Sr. Software Engineer - AI Triton Communication

Advanced Micro Devices, Inc. • Seattle (WA)

On-site
USD 180,000 - 240,000
Sr. Software Engineer - AI Triton Kernels
Sr. Software Engineer - AI Triton Kernels

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 190,000 - 270,000
Triton Compiler and Kernel Software Engineer
Triton Compiler and Kernel Software Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 260,000
AMD benefits
Senior AI GPU Systems Engineer — Distributed Triton
Senior AI GPU Systems Engineer — Distributed Triton

Advanced Micro Devices, Inc • Washington

On-site
USD 190,000 - 280,000
Senior AI Triton: Distributed-GPU Engineer
Senior AI Triton: Distributed-GPU Engineer

Advanced Micro Devices, Inc. • United States

On-site
USD 190,000 - 270,000
Senior AI Triton Engineer: Distributed GPU Backends
Senior AI Triton Engineer: Distributed GPU Backends

Advanced Micro Devices, Inc. • Seattle (WA)

On-site
USD 180,000 - 240,000
Senior Triton Kernel & Compiler Engineer for GPUs
Senior Triton Kernel & Compiler Engineer for GPUs

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 260,000
AMD benefits
Triton Compiler
Triton Compiler

Intellectual Capital Resources Ltd • United States

Remote
USD 140,000 - 190,000
Software Engineer- GPU/AI/ML
Software Engineer- GPU/AI/ML

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 250,000 - 320,000