Neuron Collectives Software Engineer, Trainium Collectives

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Sign-on payments

RSUs

Health insurance

Medical insurance

Dental insurance

Vision insurance

Prescription insurance

Life & AD&D insurance

EAP

Mental health support

FSA

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) is seeking software engineers to develop and optimize collective communication algorithms and low-level device drivers that scale AI compute across data centers. You will collaborate with hardware teams to co-optimize software and Trainium silicon for maximum performance in LLM training.

Requirements include at least 3 years of professional software development experience and 2 years in system design or architecture.

Qualifications

• Requires at least 3 years of professional software development experience and 2 years in system design or architecture.
• A bachelor's degree in computer science or equivalent is preferred.

Responsibilities

• Develop and optimize collective communication algorithms and low-level device drivers for scalable AI compute across data centers.
• Collaborate with hardware teams to co-optimize software for Trainium silicon in LLM training.

Skills

C++

C

Collective communication

Device drivers

Distributed systems

AI training hardware

Algorithm optimization

System architecture

Performance tuning

SDLC

Code review

Source control

Build processes

Testing

Operations

Low level programming

Education

Bachelor's degree in Computer Science or equivalent

Tools

Git

Build systems

Testing frameworks

CI/CD

Job description

Develop and optimize collective communication algorithms and low-level device drivers to scale AI compute across data centers. Collaborate with hardware teams to co-optimize software and Trainium silicon for maximum performance in LLM training.

Requirements: Requires at least 3 years of professional software development experience and 2 years of experience in system design or architecture. A bachelor's degree in computer science or equivalent is preferred.

Key Skills: C++, C, Collective Communication Patterns, Device Driver Development, Distributed Systems, AI Training Hardware, Algorithm Optimization, System Architecture, Performance Tuning, Software Development Life Cycle, Code Review, Source Control Management, Build Processes, Testing, Operations, Low Level Programming

Benefits: Sign-on payments, Restricted stock units (RSUs), Health insurance, Medical insurance, Dental insurance, Vision insurance, Prescription insurance, Basic Life & AD&D insurance, Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage, 401(k) matching, Paid time off, Parental leave