Senior AI Networking Engineer - NCCL & Multi-GPU Training

Meta Careers; Menlo Park, Northern (CA, KY); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Meta Careers in Menlo Park, CA is seeking a Software Engineer for SystemML - AI Networking to help build and optimize the NCCL-based communication stack used in large-scale GPU training. The role emphasizes GenAI/LLM scaling, reliability, and performance across the distributed AI network.

You will lead critical software projects, contribute to the PyTorch ecosystem, and collaborate with a team driving meta-wide ML innovations on a multi-GPU, multi-node platform.

Qualifications

• Bachelor's degree or equivalent practical experience in Computer Science, Computer Engineering, or a related field.
• Proven C/C++ and Python programming skills.
• Proven track record of leading successful projects.

Responsibilities

• Lead the development of the collective communication library for Meta's large-scale GPU training infrastructure, focusing on GenAI/LLM scaling.
• Collaborate with cross-functional teams to optimize performance and reliability of distributed AI training.
• Drive design decisions, code quality, and timely delivery of critical software components.

Skills

C/C++

Python

Project leadership

Education

Bachelor's degree in Computer Science or related field

Job description

Meta Careers in Menlo Park, CA is seeking a Software Engineer for SystemML - AI Networking to help build and optimize the NCCL-based communication stack used in large-scale GPU training. The role emphasizes GenAI/LLM scaling, reliability, and performance across the distributed AI network.

You will lead critical software projects, contribute to the PyTorch ecosystem, and collaborate with a team driving meta-wide ML innovations on a multi-GPU, multi-node platform.