Sr. Software Development Engineer

Advanced Micro Devices, Inc.; Austin (TX); On-site; USD 140,000 - 200,000; Full time

Job summary

Advanced Micro Devices, Inc. (AMD) is hiring a Senior Software Development Engineer to design, implement, and benchmark high-performance GPU communication software for AI/HPC workloads on AMD Instinct GPUs and ROCm stack.

You will develop and optimize multi-GPU and multi-node communication, contribute to RCCL, and collaborate with cross-functional teams to improve throughput and reduce latency across PCIe, Infinity Fabric, and InfiniBand/RDMA interconnects.

Qualifications

• Master’s degree or foreign equivalent in Computer Science, Computer Engineering, Electrical Engineering, or related field.
• Experience may be gained through graduate coursework, research, or internship experience.

Responsibilities

• Research, design, develop, and test high-performance GPU communication libraries and benchmarking tools for AI/HPC workloads.
• Design, develop, optimize, and debug software enabling efficient multi-GPU and multi-node communication across ROCm ROCm stack.
• Collaborate with hardware, firmware, driver, and AI framework teams to enable new silicon and validate interconnect performance.

Skills

Python

C or C++

CUDA

GPU software programming

Multi-threading

Software debugging

Education

Master’s degree in Computer Science or related field

Tools

RCCL (ROCm)

RDMA/NCCL protocols

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believetechnology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shapingthefuture.

Whetheryou’redesigning next-gen processors, enabling AI breakthroughs, orbringing leading edge products to market, every role at AMD contributes to something bigger— technologythat moves the world forward.Join us and, together, we’ll advance your career.

Job Role and Responsibility: AMD, Inc. is hiring Sr. Software Development Engineer to research, design, develop, and test high-performance collective communication libraries, GPU communication runtimes, and benchmarking tools for AI/HPC workloads on AMD Instinct GPUs and next-generation accelerator platforms. Design, develop, optimize, troubleshoot, and debug software that enables efficient multi-GPU and multi-node communication across AMD's ROCm software stack. Contribute to open-source libraries for GPU communication, including RCCL (ROCm Collective Communications Library) and benchmarking tools including TransferBench, to maximize bandwidth utilization and minimize latency across PCIe, Infinity Fabric (xGMI), and high-speed network interconnects (RDMA/RoCE/InfiniBand). Develop and tune collective algorithms (AllReduce, AllGather, ReduceScatter, Broadcast, AllToAll, etc.) for distributed training and inference frameworks such as PyTorch, JAX, Megatron-LM, DeepSpeed, and vLLM. Design micro-benchmarks and performance characterization tools to evaluate GPU-to-GPU, GPU-to-NIC, and host-to-device transfer performance, and use results to influence hardware/firmware/topology decisions for upcoming AMD Instinct (MI-series) products. Collaborate with hardware, firmware, driver, and AI framework teams to bring up and enable new silicon, validate interconnect performance, and resolve cross-stack functional and performance issues. Work on problems of complex scope where analysis of situations and performance data requires review of architectural, system-level, and network-level factors. Apply knowledge of GPU architecture, parallel computing, networking (RDMA, NCCL/RCCL protocols), and modern AI/HPC workloads to the design, development, performance tuning, and testing of AMD's communication software and platforms.

Travel required: NO

Qualifications: Degree required

Master’s degree or foreign equivalent in Computer Science, Computer Engineering, Electrical Engineering, or related field.

Qualifications: Amount and type of experience required

NONE

Specific skills required: The following skills are required

Position requires experience in the following:

• Python, C, or C++;
• Developing benchmarks to test software performance;
• GPU software programming and development;
• Software debugging (macOS, Linux, or Unix);
• Data structures and multi-threading; and
• CUDA.

Experience may be gained through graduate-level coursework, research, or internship experience.

Benefits offered are described: AMD benefits at a glance

AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.