Software Development Engineer I, ML Infra Services, Annapurna Labs (AWS)

Amazon; Cupertino (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

Annapurna Labs in Cupertino, CA is seeking a Software Development Engineer to help build and evolve ML tools that run and analyze workloads on AWS accelerators. You will work across the stack with hardware engineers, system architects, and ML researchers to create and optimize tooling for large-scale AI workloads.

You will lead design discussions, implement automation, and contribute to high-impact projects that accelerate the Neuron and related AI accelerator teams within AWS.

Qualifications

• Are 18 years of age or older.
• Experience with at least one modern language such as Java, Python, C++, or C# including object-oriented design.
• Experience with at least one general-purpose programming language such as Java, Python, C++, C#, Go, Rust, or TypeScript.
• Experience with data structure implementation, basic algorithm development, and/or object-oriented design principles.
• Proficiency in Java and at least one of Go, Python, or TypeScript.
• Familiarity with Git and CI/CD pipelines.

Responsibilities

• Lead the design and implementation of new tools, pipelines and automation.
• Build high-impact solutions that ship to a large and growing customer base.
• Participate in design discussions, code reviews, and cross-functional collaboration with hardware, software, and customer-facing teams.
• Create metrics, implement automation, and resolve root causes of software defects.
• Work in a startup-like environment where you're always focused on the most important problems.

Skills

Java

Python

C++

C#

Go

TypeScript

Object-oriented design

Data structures

Algorithms

Tools

Git

CI/CD pipelines

Job description

Annapurna Labs was a startup acquired by AWS in 2015 and is now fully integrated. If AWS is an infrastructure company, think of Annapurna Labs as the infrastructure provider of AWS. Our org spans silicon engineering, hardware design and verification, software, and operations. We've delivered AWS Nitro, ENA, EFA, Graviton, F1 EC2 Instances, AWS Neuron, Inferentia and Trainium ML Accelerators, and scalable NVMe storage.

AWS Neuron is the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them.

We're looking for a Software Development Engineer to help build and evolve machine learning tools that run, optimize, and analyze ML workloads on custom AI accelerators. You'll work across the stack, from infrastructure orchestration to developer-facing tooling - alongside hardware engineers, system architects, and ML researchers both within and outside Amazon.

Key job responsibilities

• This engineer will lead the design and implementation of new tools, pipelines and automation, will work with developers, system architects, hardware engineers and users both within and external to Amazon to ensure compatibility of this new toolset with existing and next-generation AI accelerators.
• Build high-impact solutions that ship to a large and growing customer base.
• Participate in design discussions, code reviews, and cross-functional collaboration with hardware, software, and customer-facing teams.
• Create metrics, implement automation, and resolve root causes of software defects.
• Work in a startup-like environment where you're always focused on the most important problems.

About the team

This is a high-impact, high-visibility team where your work directly accelerates every Neuron team's ability to ship, effectively multiplying the output of 100+ engineers. We're a small, senior group actively building greenfield capabilities, which means significant design ownership for SDEs and the opportunity to own major components and drive architectural decisions. You'll work at the cutting edge of AI infrastructure, at the intersection of Kubernetes, custom silicon, and large-scale ML workloads.

Basic Qualifications

• Are 18 years of age or older
• Experience with at least one modern language such as Java, Python, C++, or C# including object-oriented design
• Experience with at least one general-purpose programming language such as Java, Python, C++, C#, Go, Rust, or TypeScript
• Experience with data structure implementation, basic algorithm development, and/or object-oriented design principles
• Proficiency in Java and at least one of Go, Python, or TypeScript.
• Familiarity with Git and CI/CD pipelines.

Preferred Qualifications

• Experience from a technical internship
• Experience in optimization mathematics such as linear programming and nonlinear optimization
• Experience with distributed, multi-tiered systems, algorithms, and relational databases
• Work 40 hours/week, and overtime as required
• Experience from previous technical internship(s) or demonstrated project experience
• Experience with Cloud platforms (preferably AWS), database systems (SQL and NoSQL), AI tools