AI/ML Network Infrastructure Engineer I

Amazon Inc.

Cupertino (CA)

On-site

USD 126,000 - 171,000

Full time

6 days ago

Be an early applicant

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Amazon Inc. in Cupertino, CA is seeking an early-career software engineer to join the team that owns the network stack for EC2 distributed AI/ML systems, building high-performance C/C++ code for communication libraries on AWS hardware.

You will develop tools to monitor, benchmark, and deliver software for massive GPU clusters, and collaborate across Linux environments and diverse stacks. This role blends HPC networking with ML infrastructure, offering hands-on experience with CUDA, MPI, and

Qualifications

Bachelor's degree or above in Computer Science, Computer Engineering, or related fields.
Strong proficiency in C/C++.
Solid coursework or project experience in: Operating Systems (Linux internals, kernel concepts, memory management); Parallel Computer Architecture (multithreading, SIMD, GPU programming, cache coherence); Distributed Systems (consensus, message passing, fault tolerance, scalability).
Familiarity with Linux development environments and toolchains.

Responsibilities

Write high-performance C/C++ code for network communication libraries running on custom AWS hardware.
Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads.
Develop automation using Python and AWS tools (CI/CD, Grafana, Athena) to test, benchmark, and deliver software to customers.
Design mechanisms to detect functional and performance regressions before they reach production.
Work across many instance types, software stacks, and Linux environments.