Software Development Engineer I – AI/ML Network Infrastructure, Annapurna Labs

Amazon Inc.; Cupertino (CA); On-site; USD 126,000 - 171,000; Full time

Job summary

Amazon Inc. in Cupertino, CA is seeking an early-career software engineer to join the team that owns the network stack for EC2 distributed AI/ML systems, building high-performance C/C++ code for communication libraries on AWS hardware.

You will develop tools to monitor, benchmark, and deliver software for massive GPU clusters, and collaborate across Linux environments and diverse stacks. This role blends HPC networking with ML infrastructure, offering hands-on experience with CUDA, MPI, and

Qualifications

• Bachelor's degree or above in Computer Science, Computer Engineering, or related fields.
• Strong proficiency in C/C++.
• Solid coursework or project experience in: Operating Systems (Linux internals, kernel concepts, memory management); Parallel Computer Architecture (multithreading, SIMD, GPU programming, cache coherence); Distributed Systems (consensus, message passing, fault tolerance, scalability).
• Familiarity with Linux development environments and toolchains.

Responsibilities

• Write high-performance C/C++ code for network communication libraries running on custom AWS hardware.
• Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads.
• Develop automation using Python and AWS tools (CI/CD, Grafana, Athena) to test, benchmark, and deliver software to customers.
• Design mechanisms to detect functional and performance regressions before they reach production.
• Work across many instance types, software stacks, and Linux environments.

Skills

C/C++

Linux internals

Parallel computing

Distributed systems

Linux toolchains

Education

Bachelor's degree in CS/CE

Tools

CUDA

MPI

RDMA

Job description

We're looking for a talented early-career engineer to join our team that owns the network stack for EC2 distributed AI/ML systems. You'll work on software that enables the world's largest AI models to train across massive GPU clusters, developing support for communication libraries and frameworks like NCCL, NVSHMEM, and NIXL.

This is a ground-floor opportunity to work at the intersection of high-performance computing, networking, and machine learning infrastructure - building the systems that power the largest AI workloads in the cloud.

Key job responsibilities

• Write high-performance C/C++ code for network communication libraries running on custom AWS hardware
• Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads
• Develop automation using Python and AWS tools (CI/CD, Grafana, Athena) to test, benchmark, and deliver software to customers
• Design mechanisms to detect functional and performance regressions before they reach production
• Work across many instance types, software stacks, and Linux environments

Basic Qualifications

• Bachelor's degree or above in Computer Science, Computer Engineering, or related fields
• Strong proficiency in C/C++
• Solid coursework or project experience in: 1/ Operating Systems (Linux internals, kernel concepts, memory management) 2/ Parallel Computer Architecture (multi-threading, SIMD, GPU programming, cache coherence) 3/ Distributed Systems (consensus, message passing, fault tolerance, scalability)
• Familiarity with Linux development environments and toolchains

Preferred Qualifications

• Internship experience in ML communications, HPC networking, or RDMA/high-speed interconnects
• Exposure to network programming (sockets, MPI, collective communication patterns)
• Experience with performance profiling and optimization
• Familiarity with GPU programming (CUDA) or hardware-software co-design
• Contributions to open-source projects in systems, networking, or HPC

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The starting pay for this position is listed below.Starting Day 1 of employment, Amazon offers EAP, Mental Health Support, Medical Advice Line, 401(k) matching. Learn more about our benefits at https://hiring.amazon.com/why-amazon/benefits .

Preferred Qualifications

• Internship experience in ML communications, HPC networking, or RDMA/high-speed interconnects
• Exposure to network programming (sockets, MPI, collective communication patterns)
• Experience with performance profiling and optimization
• Familiarity with GPU programming (CUDA) or hardware-software co-design
• Contributions to open-source projects in systems, networking, or HPC

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The starting pay for this position is listed below.Starting Day 1 of employment, Amazon offers EAP, Mental Health Support, Medical Advice Line, 401(k) matching. Learn more about our benefits at https://hiring.amazon.com/why-amazon/benefits .

Cupertino, CA, USA - 148,400.00 USD Annually

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Veterans, military spouses, and people with disabilities are encouraged to apply.