Sr Hardware Development Engineer, High Performance AI & ML Servers

Amazon Web Services (AWS); Seattle (WA); On-site; USD 159,200 - 215,300; Full time

Job summary

Amazon Data Services, Inc. is seeking a hardware and systems design engineer to lead development of next-generation server systems for AWS-scale AI, ML, and HPC workloads.

You will own reliability, drive architectural solutions, and collaborate with hardware, software, and product teams to deliver scalable infrastructure at global scale. The role emphasizes design leadership, extensive experience with server hardware and x86 architectures, and strong problem-solving skills in a fast-paced

Qualifications

• Bachelor’s degree in electrical or computer engineering or equivalent
• 5+ years of design/innovation or related experience
• Experience in English-language communication, written and verbal
• In-depth expertise in server technologies such as thermal, mechanical, signal integrity
• Strong problem solving and analytical skills

Responsibilities

• Lead solutions for high-performance server and rack system design
• Own end-to-end reliability and proactively resolve deficiencies
• Design and implement large-scale system solutions
• Decompose complex server problems into deliverable tasks
• Apply hardware, software, system design, x86 expertise
• Collaborate with hardware, software, manufacturing, supply chain and PMs
• Develop diagnostic tools and monitoring for production systems
• Debug complex failures under time pressure

Skills

Server design

Electrical engineering

English communication

Education

Bachelor's degree in Electrical/Computer Engineering

Master's degree in relevant field

Tools

Linux/RHEL

Batch scripting

PowerShell

Job description

Do you want to shape the future of AI? Join the team building the foundation of the world’s most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale. Here, you’ll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you’re passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what’s next for AWS — and for the entire AI industry.

You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.

Key job responsibilities

• Lead technical solutions for complex high performance server and/or accelerator server and rack system architectural challenges
• Own end-to-end system reliability, proactively identifying and resolving deficiencies before customer impact
• Design and implement solutions to address system-level issues at large scale
• Decompose complex server system problems (testability, reliability, diagnostics) into deliverable tasks and features
• Apply expertise across hardware, software, system design, x86 architecture, processes, and operations
• Collaborate with hardware, software, manufacturing, supply chain and product management teams
• Develop and implement diagnostic tools and monitoring solutions for production systems
• Debug complex system failures in time sensitive settings

A day in the life

Your day to day responsibilities will include interfacing with our internal and external customers to understand project requirements and facilitate system development on top of your server design. You will be responsible for solving operational challenges to our existing fleet with the goal of improving the current customer experience as well as developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale.

About The Team

The team is comprised of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best specialized server fleet possible to our customers.

Basic Qualifications

• Experience in developing functional specifications, design verification plans and functional test procedures
• Experience in server technologies such as thermal, mechanical, power, and signal integrity
• Bachelor's degree or above in electrical engineering, computer engineering, or equivalent
• 5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience
• 5+ years of process development experience
• Experience in English-language communication skills, both written and verbal
• In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networking

Preferred Qualifications

• Master's degree or above in electrical engineering, computer engineering, or equivalent
• Experience working with interdisciplinary teams to execute product design from concept to production
• 10+ years of server, storage, networking, or large-scale distributed systems experience
• Experience working with engineering and product teams to define a product and bring it to market
• 5+ years of data center engineering or operations experience
• Experience in Linux/RHEL, or experience with programming/scripting (Batch, VB, PowerShell, Java, C#, Chef, Perl, Ruby and/or PHP) and experience that includes strong analytical skills, attention to detail, and effective communication abilities
• Experience with server validation and issue root causing
• Experience with leading hardware and software development engineering teams

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Salary and Locations

• USA, CA, Cupertino – 183,000.00 - 247,600.00 USD annually
• USA, TX, Austin – 159,200.00 - 215,300.00 USD annually
• USA, WA, Seattle – 159,200.00 - 215,300.00 USD annually

Company – Amazon Data Services, Inc.