Cloud Hardware Dev Engineer (AWS Generative AI & ML Servers), AWS Generative AI & ML Servers
Amazon Web Services (AWS)
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
Amazon Web Services, Inc. in Cupertino, California is seeking a Cloud Hardware Development Engineer to help design, build, and operate high-performance AI/ML server fleets at scale.
You will partner with EC2 to define architectures and translate workload requirements into concrete designs that enable efficient AI training and inference. You will lead cross-functional teams through design reviews, validation, and manufacturing, triage issues in ODMs and datacenters, and ensure reliability and
Qualifications
- 7+ years of equivalent experience in hardware engineering or related fields.
- Experience in developing functional specs, design verification plans and test procedures.
- Experience in server technologies: thermal, mechanical design, power, signal integrity.
- Bachelor's degree or above in electrical or computer engineering.
- Strong English communication skills, written and verbal.
- Experience leading process improvement and manufacturing collaboration.
Responsibilities
- Define server architectures for AI training/inference at scale with EC2 alignment.
- Drive validation from PCBA bring-up through rack integration for performance and reliability.
- Triage hardware issues at ODM facilities and data centers and implement corrective actions.
- Oversee fleet of deployed servers and drive continuous improvements.
Skills
Education
Job description
Do you want to build the backbone of Generative AI cloud at AWS? Do you want to build the future of the cloud for AI training and inference? Want to do industry leading work delivering continuous price performance improvements in the cloud for AI model training for multi billion variable LLMs? Come Join us in designing, delivering and operating AWS cloud offerings that enable high performance and scalability in AI/ML and HPC workloads.
Do you want to build the backbone of Generative AI cloud at AWS? Do you want to build the future of the cloud for AI training and inference? Want to do industry leading work delivering continuous price performance improvements in the cloud for AI model training for multi billion variable LLMs? Come Join us in designing, delivering and operating AWS cloud offerings that enable high performance and scalability in AI/ML and HPC workloads.
AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (IoT), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services.
You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.
As a Cloud Hardware Development Engineer on the AWS Generative AI & ML Servers team, you will partner with EC2 to define server architectures based on workload demand and customer requirements. You will translate these architectures into detailed supporting designs and component specifications that enable high-performance AI training and inference at scale.
You will define and drive validation strategies from PCBA bring-up through server and rack integration, ensuring designs meet performance, thermal, mechanical, power, and signal integrity requirements. Working with interdisciplinary teams of component, firmware, test, qualification, and integration engineers, you will lead design and manufacturing partners through development and production.
You will be responsible for triaging hardware issues at both ODM facilities and datacenters, conducting root cause analysis, and implementing corrective actions. After launch, you will oversee the fleet of servers you develop, monitoring quality metrics and ensuring they meet customer requirements while identifying opportunities for continuous improvement.
Your day to day responsibilities will include interfacing with internal customers to understand project requirements and facilitate system development. You will work directly with EC2 teams to align on architecture decisions and translate workload requirements into technical specifications. You will be responsible for learning operational challenges in the existing fleet with the goal of improving customer experience and developing improved systems for future designs.
You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale, driving design reviews, resolving technical issues, and ensuring quality throughout the development lifecycle.
The team is comprise of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best Accelerated Server fleet possible to our customers.
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (diversity) conferences, inspire us to never stop embracing our uniqueness.
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
- 7+ years of equivalent experience
- Experience in developing functional specifications, design verification plans and functional test procedures
- Experience in server technologies such as, thermal, mechanical, power, and signal integrity
- Bachelor's degree or above in electrical engineering, computer engineering, or equivalent
- 5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience
- Experience leading process improvement, systems development, and project management
- Experience in English-language communication skills, both written and verbal
- In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networking
- Experience working with technical and product stakeholders to define requirements, prioritize features, and influence product roadmaps
- Experience leading engineering teams as a mentor or tech lead, or experience with general troubleshooting/debugging of hardware
- 7+ years of new hardware product development experience, e.g. server, storage, networking, or large-scale distributed systems experience
- In-depth expertise in one or more server technologies: thermal/mechanical design, high-speed bus design and signal integrity, failure analysis, server components (CPU, GPU, SSDs, memory), BIOS, BMC, and networking
- Experience developing and executing test procedures for mechanical or electrical systems/components
- Experience working with ODMs/manufacturer through the product development and manufacturing lifecycle
- Experience building predictive failure detection or proactive remediation systems at fleet scale
- Experience with storage/compute/GPU/accelerator platforms including integration, diagnostics, or performance validation
- Familiarity with PCIe topology, NVLink, NVMe, and accelerator interconnects
- Experience with large-scale datacenter or cloud environments
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Cupertino - 183,000.00 - 247,600.00 USD annually
USA, WA, Seattle - 159,200.00 - 215,300.00 USD annually
Amazon Web Services, Inc.
Job ID: A10449653
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
