Software Development Engineer III, AWS AI/ML Servers

Amazon Web Services (AWS)

Seattle (WA)

On-site

USD 168,000 - 227,000

Full time

10 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health Insurance
RSUs
Paid time off

Job summary

Amazon.com Services LLC is seeking a Software Development Engineer to design and build software that runs AWS’ AI/ML accelerator fleet. You will own services from design through production, collaborating across teams and partners to deliver scalable and reliable platforms.

Located in Seattle, you will work on fleet provisioning, telemetry, and remediation control planes, and contribute to engineering standards while mentoring teammates. A strong focus on reliability and observability is expected.

Qualifications

  • 5+ years of professional software development experience.
  • 5+ years of programming in at least one language.
  • 5+ years of leading design or architecture of systems.
  • Experience as a mentor, tech lead or engineering-team lead.
  • Bachelor's degree in CS, Engineering, or related field or equivalent experience.

Responsibilities

  • Design, build, and operate scalable distributed services and control planes for fleet provisioning, health evaluation, and remediation.
  • Design APIs and data models for low-latency, available, durable, cost-efficient fleet-scale systems.
  • Own software end-to-end including testing, deployment, and operations with best practices.

Skills

Software development
Leadership
Design patterns
Mentoring

Education

Bachelor's degree in Computer Science or related field
Equivalent experience

Tools

Linux
BMC/IPMI
GPU/accelerator platforms

Job description

Description

AWS runs the world's largest fleet of AI/ML accelerator servers. When a model with billions of parameters trains across a large scale of GPUs, the software that provisions, monitors, and heals that fleet is what keeps training on track. We build the services, control planes, and data platforms that turn hundreds of thousands of servers into a reliable, self-managing system. If you want to build software at the intersection of large-scale distributed systems and the physical infrastructure powering frontier AI, this is the role.

What You Will Do

We are seeking a Software Development Engineer to design and build the software that operates our accelerated compute fleet: fleet-management services, orchestration and remediation control planes, telemetry and analytics pipelines, and the APIs and tools that engineering, operations, and partner teams depend on. You will own software from design through production, working across multiple teams and organizations to deliver scalable, reliable services.

Key job responsibilities
Service & Platform Development
  • Design, build, and operate scalable distributed services and control planes that automate fleet provisioning, health evaluation, and remediation across a large scale of servers
  • Design APIs, data models, and system architectures that balance latency, availability, durability, and cost at fleet scale
  • Own software end to end: design, implementation, testing, deployment, and production operations, following engineering best practices for code review, source control, and CI/CD
Data & Telemetry Platforms
  • Build data and telemetry pipelines that ingest, correlate, and transform signals from across the fleet into actionable insights and automated actions
  • Develop analytics and reporting services, dashboards, and alerting that give engineering and operations teams real-time visibility into fleet health
  • Apply appropriate algorithms and data structures to process high-volume telemetry efficiently and reliably
Reliability & Operational Excellence
  • Instrument services for observability; participate in post-incident reviews, identify contributing causes, and drive permanent software fixes that eliminate whole classes of risk
  • Improve the resilience, performance, and cost of the services you own, and reduce operational load through automation
  • Produce clear, maintainable documentation for services, APIs, and runbooks so others can operate and extend your work
Technical Leadership & Collaboration
  • Decompose complex problems into well-scoped components that you and other engineers can deliver in parallel
  • Partner with systems, firmware, hardware, and operations engineers to translate fleet behavior into software requirements and correct abstractions
  • Review designs and code, mentor engineers, and set engineering standards for the team

May require occasional (<10%) regional and international travel to Design and Manufacturing Partner sites.

A day in the life

You start the day reviewing a design document for a new remediation control-plane API, leaving feedback on the data model and failure handling. Mid-morning, you pair with a teammate to debug elevated latency in the telemetry ingestion service and ship a fix. In the afternoon, you review overnight metrics from a service you own, then write code for a new fleet-health scoring pipeline. You end the day in a design review with a partner team, aligning on the API contract your service will expose to their tooling.

About The Team

The Hardware Engineering AI/ML UltraServer platform team is a group of engineers and technical program managers directly responsible for launching GPU-accelerated servers into the AWS fleet. Located in Seattle, Austin, and Cupertino, we collaborate with global development teams and ODM partners to deliver next-generation AI/ML infrastructure deployed in datacenters worldwide. We move fast with small, empowered teams delivering end-to-end, from server conception through fleet-scale operations.

Basic Qualifications
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience as a mentor, tech lead or leading an engineering team
  • Bachelor's degree in Computer Science, Engineering, a related field, or equivalent experience
Preferred Qualifications
  • 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Bachelor's degree in computer science or equivalent
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
  • Experience leading the design, development and deployment of business software at scale or recent hands-on technology infrastructure, network, compute, storage, and virtualization experience
  • Experience with full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
  • Familiarity with the infrastructure the software manages, such as Linux, server hardware, BMC/IPMI, or GPU/accelerator platforms

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually

Company

Amazon.com Services LLC

Job ID: A10532241

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Development Engineer III, AWS AI/ML Servers
Software Development Engineer III, AWS AI/ML Servers

Amazon Inc. • Seattle (WA)

On-site
USD 168,000 - 227,000
Health insurance
401(k) matching
Paid time off
Sr Systems Development Engineer, AWS AI/ML Servers
Sr Systems Development Engineer, AWS AI/ML Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 151,000 - 205,000
Health insurance
401(k) matching
Paid time off
+1
Sr Systems Development Engineer, AWS AI/ML Servers
Sr Systems Development Engineer, AWS AI/ML Servers

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 151,000 - 205,000
Systems Development Engineer, AWS Generative AI & ML Servers
Systems Development Engineer, AWS Generative AI & ML Servers

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 129,000 - 175,000
Systems Development Engineer, AWS Generative AI & ML Servers
Systems Development Engineer, AWS Generative AI & ML Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 129,000 - 175,000
Sr Technical Program Manager, AWS Generative AI & ML Servers
Sr Technical Program Manager, AWS Generative AI & ML Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 149,000 - 201,000
Health insurance
RSUs
401(k) matching
Sr Technical Program Manager, AWS Generative AI & ML Servers
Sr Technical Program Manager, AWS Generative AI & ML Servers

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 171,000 - 231,000
Health insurance
401(k) matching
Paid time off
+2
Sr Systems Development Engineer, AWS AI/ML Servers
Sr Systems Development Engineer, AWS AI/ML Servers

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 174,000 - 235,000
Health insurance
401(k) matching
Paid time off
+1
Senior Hardware Development Engineer, Cloud AI/ML Server Team
Senior Hardware Development Engineer, Cloud AI/ML Server Team

Amazon Web Services (AWS) • Denver (CO)

On-site
USD 159,000 - 215,000
Software Dev Engineer II, SageMaker Compute Governance
Software Dev Engineer II, SageMaker Compute Governance

Amazon Web Services (AWS) • Santa Clara (CA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1