AI/ML Systems Engineer – High-Performance Networking

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Annapurna Labs (U.S.) Inc. is seeking a systems engineer to advance the data movement path for KV caches and activations across accelerators and servers on AWS infrastructure.

You will optimize low-level networking, contribute across the stack, and work with senior engineers to ship features for the largest AI models in production. A strong background in C/C++ and high-performance systems is required.

Qualifications

• 3+ years of professional software development experience.
• 2+ years of design or architecture experience on new or existing systems.
• Experience programming with at least one software programming language.
• Experience with C/C++.

Responsibilities

• Build and optimize the low-level data-movement software that transfers KV cache and activations across accelerators, servers, and heterogeneous memory.
• Profile real workloads, identify bottlenecks, and push performance toward hardware limits.
• Collaborate across the stack—from network transport to inference frameworks.
• Deliver features that ship to large AWS clusters and customers for AI models in production.

Skills

C/C++

Software development

Performance optimization

Education

Bachelor's degree in computer science or equivalent

Tools

NCCL

MPI

UCX

libfabric

InfiniBand

RDMA

Job description

Annapurna Labs (U.S.) Inc. is seeking a systems engineer to advance the data movement path for KV caches and activations across accelerators and servers on AWS infrastructure.

You will optimize low-level networking, contribute across the stack, and work with senior engineers to ship features for the largest AI models in production. A strong background in C/C++ and high-performance systems is required.