Lead Distributed Systems Engineer - Collectives & Networking

Advanced Micro Devices, Inc.; San Jose (CA); On-site; USD 180,000 - 230,000; Full time

Benefits offered by this job

AMD benefits at a glance

Onsite role in San Jose or Austin

Job summary

AMD is seeking a senior expert to lead Collectives and Network Performance for AI workloads. You will architect algorithms for all-reduce, all-gather, and scale-out networks across multi-node GPUs, driving performance at scale.

Collaborate with GPU library, compiler, ROCm teams and open-source projects, while mentoring engineers and shaping roadmaps. The role demands leadership, deep Linux/C++ expertise and strong analytical skills.

Qualifications

• Expertise in designing and optimizing collective communication libraries.
• Deep knowledge of NIC, RDMA, scale-up and scale-out networks.
• Experience integrating optimized communication into ML frameworks.
• Strong software engineering practices and leadership ability.

Responsibilities

• Define goals, scope and roadmap for AMD’s collectives and network optimizations.
• Lead design and development of collective algorithms across networks.
• Drive performance tuning for large-scale models on multi-node systems.
• Collaborate with GPU library, compiler and runtime teams and open-source maintainers.
• Provide mentorship and technical guidance to team members.
• Present performance analyses and concrete recommendations to leadership.

Skills

Collective communication

NCCL / RCCL

GPU networking

Performance analysis

C++

Python

Linux expertise

Technical leadership

Education

Master’s or PhD in CS/CE/EE

Tools

RCCL

NCCL

MPI

Job description

AMD is seeking a senior expert to lead Collectives and Network Performance for AI workloads. You will architect algorithms for all-reduce, all-gather, and scale-out networks across multi-node GPUs, driving performance at scale.

Collaborate with GPU library, compiler, ROCm teams and open-source projects, while mentoring engineers and shaping roadmaps. The role demands leadership, deep Linux/C++ expertise and strong analytical skills.