Senior AI Triton: Distributed-GPU Engineer

Advanced Micro Devices, Inc.

United States

On-site

USD 190,000 - 270,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AMD is advancing Triton-based distributed AI for AMD Instinct GPUs, building native distributed execution and communication within the Triton AMDGPU backend. You will optimize inter-GPU data movement, synchronization, and overlap of compute with communication across multi-GPU systems.

The role spans compiler, runtime, and hardware layers, collaborating with architecture and performance teams to deliver scalable GPU infrastructure and contribute to open-source Triton/ROCm projects.

Qualifications

  • Deep experience in compiler development, GPU software, distributed systems, or performance engineering.
  • Familiarity or hands-on experience with Triton compiler and runtime.
  • Deep understanding of modern GPU architectures and inter-GPU communication.

Responsibilities

  • Design and develop native distributed communication and execution capabilities within the Triton AMDGPU backend, enabling scalable multi-GPU execution for large-scale AI workloads.
  • Design and implement Triton compiler and runtime mechanisms for native GPU-initiated communication, including collective operations, remote memory access, synchronization, and distributed execution primitives.
  • Drive performance optimization across compute and communication, including inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling efficiency.
  • Develop and optimize distributed Triton kernels and execution models to achieve high performance, scalability, and efficient hardware utilization for AI workloads.
  • Analyze, profile and debug complex cross-stack issues spanning Triton compiler, runtime, ROCm stack, and GPU hardware execution.
  • Collaborate closely with GPU architecture, compiler, runtime, and performance teams to co-design and enable next-generation distributed GPU programming and execution capabilities.
  • Contribute to open-source Triton and ROCm distributed ecosystem, driving innovation in distributed GPU computing

Skills

Compiler development
GPU software
Distributed systems
Performance engineering
Triton compiler
CUDA/HIP
Inter-GPU communication

Tools

RCCL
NCCL
NVSHMEM
rocSHMEM
MPI

Job description

AMD is advancing Triton-based distributed AI for AMD Instinct GPUs, building native distributed execution and communication within the Triton AMDGPU backend. You will optimize inter-GPU data movement, synchronization, and overlap of compute with communication across multi-GPU systems.

The role spans compiler, runtime, and hardware layers, collaborating with architecture and performance teams to deliver scalable GPU infrastructure and contribute to open-source Triton/ROCm projects.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Triton Engineer: Distributed GPU Backends
Senior AI Triton Engineer: Distributed GPU Backends

Advanced Micro Devices, Inc. • Seattle (WA)

On-site
USD 180,000 - 240,000
Senior AI GPU Systems Engineer — Distributed Triton
Senior AI GPU Systems Engineer — Distributed Triton

Advanced Micro Devices, Inc • Washington

On-site
USD 190,000 - 280,000
Sr. Software Engineer - AI Triton Communication
Sr. Software Engineer - AI Triton Communication

Advanced Micro Devices, Inc. • United States

On-site
USD 190,000 - 270,000
Senior Triton Kernel & Compiler Engineer for GPUs
Senior Triton Kernel & Compiler Engineer for GPUs

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 260,000
AMD benefits
Sr. Software Engineer - AI Triton Communication
Sr. Software Engineer - AI Triton Communication

Advanced Micro Devices, Inc. • Seattle (WA)

On-site
USD 180,000 - 240,000
Sr. Software Engineer - AI Triton Communication
Sr. Software Engineer - AI Triton Communication

Advanced Micro Devices, Inc • Washington

On-site
USD 190,000 - 280,000
Sr. Software Engineer - AI Triton Kernels
Sr. Software Engineer - AI Triton Kernels

Advanced Micro Devices, Inc. • San Jose (CA)

On-site
USD 190,000 - 270,000
Senior GPU/AI Systems Engineer - Performance & ML
Senior GPU/AI Systems Engineer - Performance & ML

Advanced Micro Devices, Inc. • Santa Clara (CA)

On-site
USD 170,000 - 250,000
AMD Benefits
Triton Compiler and Kernel Software Engineer
Triton Compiler and Kernel Software Engineer

Advanced Micro Devices, Inc. • San Jose (CA)

Hybrid
USD 180,000 - 260,000
AMD benefits
Senior AI Compiler Engineer - Triton & MLIR Expert
Senior AI Compiler Engineer - Triton & MLIR Expert

NVIDIA Corporation • United States

Remote
USD 184,000 - 288,000
Equity eligibility
Benefits package