Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc[...]

MSU Solutions GmbH; Cupertino (CA); On-site; USD 120,000 - 210,000; Full time

Job summary

Itlearn360 in Cupertino is seeking an experienced distributed AI/ML systems engineer to develop collective operations enabling scale across multiple accelerators and servers.

Most of our stack is C/C++ and low level; you will work with Linux kernels, HPC interconnects, embedded systems, and high‑speed networking to deliver scalable solutions for large models and clusters.

Qualifications

• 3+ years of non‑internship professional software development experience.
• 2+ years of non‑internship design or architecture of new and existing systems.
• Experience programming with at least one software programming language.

Responsibilities

• Build distributed AI/ML systems and collective operations for scaling across accelerators and servers.
• Work on low‑level performance, Linux kernels, and high‑speed networking.
• Collaborate with infrastructure, hardware, RTL engineers, scientists and architects on large‑scale models and clusters.

Skills

Distributed AI/ML systems

C/C++ programming

Linux/kernel knowledge

Embedded systems experience

High-speed networking

HPC interconnects

Software design/architecture

Job description

DESCRIPTION

We are seeking an experienced engineer to work on distributed AI/ML systems and develop collective operations that enable AI to scale across multiple accelerators and servers.

Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important. Experience with embedded systems, high‑speed networking, and HPC interconnects is valued highly.

If you like solving hard problems, working with HPC and ML customers, iterating fast, and delivering meaningful solutions at scale, this role is for you. You will work on features for the largest clusters, customers, and AI models in a fast‑moving environment while collaborating with infrastructure, hardware, RTL engineers, scientists, and architects.

BASIC QUALIFICATIONS

• 3+ years of non‑internship professional software development experience
• 2+ years of non‑internship design or architecture (design patterns, reliability, and scaling) of new and existing systems
• Experience programming with at least one software programming language