Sr. System Development Engineer, High-Performance Accelerator Servers for AI/ML

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 174,000 - 235,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Data Services, Inc. is seeking a seasoned software engineering leader for AWS Hardware Engineering to shape the next generation of server infrastructure for AI/ML workloads.

You will own complex system design, lead cross-functional teams, and drive scalable, reliable software delivery across hardware and software layers. The role emphasizes building high-performance, secure, and cost-efficient cloud infrastructure, collaborating with SDEs, hardware engineers, TPMs, and managers to deliver

Qualifications

• 4+ years of non-internship professional software development
• 4+ years deploying and operating in a Linux/Unix environment
• 3+ years programming with at least one modern language such as C++, C#, Java, Python, Golang
• 2+ years designing or architecting (design patterns, reliability and scaling) of new and existing systems
• 2+ years of systems design, software development, operations, automation, and process improvement

Responsibilities

• Lead technical solutions for complex server systems.
• Decompose big, difficult server system testability, reliability and diagnosis problems into tasks to deliver.
• Collaborate with AWS Hardware Engineering, EC2, and other AWS services.
• Drive high quality and reliability in future designs for AWS Accelerated server solutions.
• Work with diverse roles to ensure safety, security, and scalable infrastructure.

Skills

Software development

Linux/Unix

Systems development

C++, Java, Python

System design

Leadership in design

Job description

Description

Do you want to shape the future of Generative AI at AWS? Join the team building the foundation of the world’s most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale. Here, you’ll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you’re passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what’s next for AWS — and for the entire AI industry.

Description

Do you want to shape the future of Generative AI at AWS? Join the team building the foundation of the world’s most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale. Here, you’ll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you’re passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what’s next for AWS — and for the entire AI industry.

You’ll join a diverse AWS Hardware Engineering team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.

The ideal candidate for this role will be an innovative self-starter. You are knowledgeable of the full technical stack - vertically from baremetal server hardware up to the software in userland, and everything in the middle. You have tremendous interest in cloud scale and curious how systems and software decisions impact the user. You insist on highest-standards and are able to develop tactical solutions/tools to diagnose and fix issues. You are an excellent systems debugger - finding interaction issues between components on server systems. You are a leader with strong organizational, planning, and communication skills. You are a builder!

Key job responsibilities

You will be a technical leader solving complex problems. You will decompose big difficult server system testability, reliability and diagnosis problems into straightforward tasks, components or features that you will lead to deliver yourself and through others in parallel. You will use combination of hardware, software, system designs, x86 architecture, processes, diagnosis and operations knowledge.

A day in the life

Working with a variety of job roles (SDEs, SDETs, Hardware Engineers, TPMs, Managers, Principals) and groups (AWS Hardware Engineering, EC2, other AWS services) through server conception, design, test, launch, and operations. Driving high quality and reliability into future/new designs for AWS Accelerated server solutions for AWS Cloud.

About The Team

Why AWS

Diverse Experiences

Work/Life Balance

Inclusive Team Culture

Mentorship and Career Growth

Basic Qualifications

• 4+ years of non-internship professional software development experience
• 4+ years of deploying and operating in a Linux/Unix environment experience
• 4+ years of systems development in an IT or data center environment experience
• 3+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby experience
• 2+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• 2+ years of systems design, software development, operations, automation, and process improvement experience
• Experience leading the design, build and deployment of complex and performant (reliable and scalable) software solutions in production

Preferred Qualifications

• 3+ years of development/programming/scripting language (Python/Java/Bash/Perl) experience
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
• Experience debugging, integrating, and validating complex AI/ML and Cloud Computing servers.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, CA, Cupertino - 173,900.00 - 235,200.00 USD annually

USA, TX, Austin - 151,200.00 - 204,600.00 USD annually

USA, WA, Seattle - 151,200.00 - 204,600.00 USD annually

Company - Amazon Data Services, Inc.

Job ID: A10446932