Lead Software Engineer, ML Network Stack - Annapurna Labs

Amazon Inc.

Cupertino (CA)

On-site

USD 260,000 - 380,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Annapurna Labs, an integral part of AWS, seeks an experienced engineer and technical leader to own the network stack for EC2 distributed AI/ML systems. The team develops support for NCCL, NVSHMEM, NIXL, NCCL GIN, and CUDA kernels, with strong emphasis on Linux, networking and performant coding.

You will lead senior, mid-level, and junior SDEs, directing work to deliver scalable functions and features for the latest ML workloads, partnering across teams to enable GPUs to work with EC2 instances.

Qualifications

  • 5+ years of leading design or architecture of new and existing systems.
  • 5+ years of experience with programming language: C or C++.
  • Experience mentoring or leading an engineering team.
  • Bachelor's degree in computer science or equivalent.

Responsibilities

  • Be the Leader which works across the NVIDIA ML communication stack for enabling NVIDIA GPUs to work with the AWS EC2 machines.
  • Lead senior, mid-level, and junior SDEs and direct work to deliver functions and features for the latest ML workloads.
  • Collaborate across teams to optimize ML networking and RDMA interconnects for EC2 infrastructure.

Skills

Leadership experience
C/C++ programming
Mentorship
Software development lifecycle

Education

Bachelor's degree in computer science or equivalent

Tools

RDMA Networking
ML Communication Libraries

Job description

We are seeking an experienced engineer and technical leader to join our team that owns the network stack for EC2 distributed AI/ML systems. The team develops support for a variety of frameworks and communication libraries including NCCL, NVSHMEM, NIXL, NCCL GIN, and CUDA kernels. Solid knowledge of Linux, networking, and performant coding is important. Experience with embedded systems is valued, and experience with high-speed networking or HPC/RDMA interconnects is highly valued.

If you like solving hard problems, want to work with HPC and ML customers, iterate fast and deliver meaningful solutions at scale, then come join us! This truly is a role at the forefront of AI/ML-you'll be working on features for the largest clusters, with the largest customers, for the largest AI models.

The organization you would be joining is Annapurna Labs, an integral part of AWS that develops hardware and software components that are critical building blocks for EC2 infrastructure. Every instance in EC2 is running some type of hardware designed by Annapurna Labs. We specialize in designing software, systems, and chips that optimise the AWS customer experience.

Key job responsibilities

Be the Leader which works across the NVIDIA ML communication stack for enabling NVIDIA GPUs to work with the AWS EC2 machines. Knowledge of ML Networking, ML applications, and frameworks will be highly regarded. You'll be leading senior, mid-level, and junior SDEs and directing work to ensure the team delivers functions and features required for the latest and largest ML workloads.

About the team

Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we're building an environment that celebrates knowledge-sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our team members develop your engineering expertise so you feel empowered to take on more complex tasks in the future.

Diverse Experiences

Amazon values diverse experiences.

Work/Life Balance

We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

Inclusive Team Culture

Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences.

Mentorship and Career Growth

We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Basic Qualifications
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Experience as a mentor, tech lead or leading an engineering team, or experience in development in the last 3 years
  • 5+ years of experience with programming language: C or C++
Preferred Qualifications
  • Bachelor's degree in computer science or equivalent
  • Experience working with ML Communication Libraries or RDMA Networking

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise soun

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Development Engineer, Annapurna Labs, Elastic Collectives
Software Development Engineer, Annapurna Labs, Elastic Collectives

Annapurna Labs • Cupertino (CA)

On-site
USD 150,000 - 250,000
Software Development Engineer, Annapurna Labs, Elastic Collectives
Software Development Engineer, Annapurna Labs, Elastic Collectives

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
Lead Software Engineer, ML Network Stack - Annapurna Labs
Lead Software Engineer, ML Network Stack - Annapurna Labs

Amazon Inc. • Seattle (WA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+1
Senior ML Networking Architect for Large-Scale EC2 Systems
Senior ML Networking Architect for Large-Scale EC2 Systems

Amazon Inc. • Cupertino (CA)

On-site
USD 260,000 - 380,000
Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc. Cupertino, CA
Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc. Cupertino, CA

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 140,000 - 200,000
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
Health insurance
401(k) matching
Paid time off
+1
ML Network Stack Lead Engineer
ML Network Stack Lead Engineer

About Amazon • Seattle (WA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+1
Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs
Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs

Amazon Inc. • Seattle (WA)

On-site
USD 193,000 - 262,000
Health insurance
Stock options
Software Development Engineer, ML Symphony, ML-Symphony
Software Development Engineer, ML Symphony, ML-Symphony

Amazon.com • Santa Clara (CA)

On-site
USD 180,000 - 260,000
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives

Amazon Web Services • Cupertino (CA)

On-site
USD 180,000 - 240,000