Software Dev Engineer II, SageMaker Compute Governance

Amazon Web Services (AWS)

Santa Clara (CA)

On-site

USD 144,000 - 194,000

Full time

45 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) matching
Paid time off
Parental leave

Job summary

Amazon Development Center U.S., Inc. is hiring a Software Development Engineer to design, build, and operate distributed backend services that pool GPU capacity across clusters for AI workloads.

You will own services end-to-end, from design through production, impacting some of the world’s largest AI compute customers. You will work on scheduling, capacity sharing, and usage reporting, with ownership of reliability, latency, and cost.

Qualifications

  • 3+ years of non-internship professional software development experience.
  • 2+ years of non-internship design or architecture of new and existing systems.
  • 1+ years of software development engineer or related occupational experience.
  • 1+ years of designing and developing large-scale distributed software applications and services using languages such as C++, Java, or C#.
  • 1+ years of Object Oriented Design experience.
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or related field.

Responsibilities

  • Design, build, and operate distributed backend services that manage and share accelerated compute across clusters and accounts.
  • Build scheduling and capacity-sharing capabilities to move compute to high-priority workloads.
  • Create usage reporting systems to show how compute is consumed at scale in near real time.
  • Own services in production: define operational metrics, respond to issues, and improve reliability and cost.
  • Produce clear design docs, participate in reviews, and raise engineering standards.
  • Collaborate with product, design, and partner teams to translate customer problems into features.
  • Mentor engineers and foster ownership, quality, and customer focus.

Skills

Distributed systems
Backend services
Scheduling
Capacity sharing
Performance optimization
Object Oriented Design
C++
Java
C#
Team collaboration

Education

Bachelor's degree in CS/Engineering

Tools

Kubernetes
Docker
Git
Cloud platforms

Job description

Description

Training and running large AI models takes enormous amounts of expensive accelerated compute, and most of it sits idle. Across the industry, a large share of GPU capacity is paid for but never does useful work because jobs cannot find it, cannot share it, or cannot see it and use it efficiently. We build the services that closes that gap.

Description

Training and running large AI models takes enormous amounts of expensive accelerated compute, and most of it sits idle. Across the industry, a large share of GPU capacity is paid for but never does useful work because jobs cannot find it, cannot share it, or cannot see it and use it efficiently. We build the services that closes that gap. We are looking for a Software Development Engineer to help build the systems that put idle or inefficiently used GPUs to work. You will design and build distributed backend services that let organizations pool capacity across many clusters and accounts, route it to the workloads that need it most, and see exactly how it is being used. This is deep systems work at the intersection of large-scale distributed systems, container orchestration, and cloud infrastructure, and it directly changes how much value customers get from every GPU they pay for. You will own services end to end, from design through launch and operation in production, and your work will ship to some of the largest AI compute customers in the world.

Key job responsibilities
  • Design, build, and operate distributed backend services that manage and share accelerated compute across multiple clusters and accounts.
  • Build scheduling and capacity-sharing capabilities that move compute to the highest-priority workloads and reclaim it when priorities change.
  • Build zero-touch usage and guidance systems that collect, aggregate, and report how compute is consumed, at scale and in near real time.
  • Own your services in production: define operational metrics, respond to issues, and continuously improve reliability, latency, and cost.
  • Write clear design documents, participate in design and code reviews, and raise the engineering bar for the team.
  • Collaborate with product, design, and partner engineering teams to turn customer problems into shipped features.
  • Mentor other engineers and contribute to a culture of ownership, quality, and customer focus.

A day in the life

Most days start with a short team stand-up, then it is mostly building. You might design a service that lets one cluster borrow idle capacity from another, then write it up for a design review where the team pokes holes in it before any code is written. Hard problems get their own deep-dive whiteboard session. Other days lean toward operations, chasing down why a workload did not get the capacity it should have. You will not be handed fully specified tasks; you will have the independence to help decide what to build, then build it.

About The Team

We help customers get the most out of the accelerated compute they pay for. Our mission is simple to say and hard to do: make sure every accelerator a customer pays for is doing useful work, and make that easy to see and control. Cost reduction is one important part of that, but the bigger idea is the engine that delivers compute to the workloads that need it most, in as little time as possible. Our customers run some of the largest AI training and inference workloads in the world, and they feel the impact of our work directly in how much they can do with their infrastructure. We care about depth, we own our work end to end, and we build in the open where we can.

Basic Qualifications
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 1+ years of software development engineer or related occupational experience
  • 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
  • 1+ years of Object Oriented Design experience
  • Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
  • Experience programming with at least one software programming language
Preferred Qualifications
  • 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, BELLEVUE - 143,700.00 - 194,400.00 USD annually

Company

Amazon Development Center U.S., Inc.

Job ID: A10532798

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Development Engineer III, AWS AI/ML Servers
Software Development Engineer III, AWS AI/ML Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Health Insurance
RSUs
Paid time off
Systems Development Engineer, GPU & AI Accelerator Servers, AWS Hardware Engineering
Systems Development Engineer, GPU & AI Accelerator Servers, AWS Hardware Engineering

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 129,000 - 175,000
Health insurance
401(k) matching
Paid time off
+1
Software Development Engineer II, AWS SageMaker AI
Software Development Engineer II, AWS SageMaker AI

Amazon Web Services (AWS) • Bellevue (WA)

On-site
USD 144,000 - 194,000
RSUs
Health insurance
401(k) matching
+1
Sr. System Development Engineer, High-Performance Accelerator Servers for AI/ML
Sr. System Development Engineer, High-Performance Accelerator Servers for AI/ML

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 174,000 - 235,000
Health insurance
401(k) matching
Paid time off
+1
Sr Systems Development Engineer, AWS AI/ML Servers
Sr Systems Development Engineer, AWS AI/ML Servers

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 151,000 - 205,000
Sr Systems Development Engineer, AWS AI/ML Servers
Sr Systems Development Engineer, AWS AI/ML Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 151,000 - 205,000
Health insurance
401(k) matching
Paid time off
+1
Systems Development Engineer, AWS Generative AI & ML Servers
Systems Development Engineer, AWS Generative AI & ML Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 129,000 - 175,000
Systems Development Engineer, AWS Generative AI & ML Servers
Systems Development Engineer, AWS Generative AI & ML Servers

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 129,000 - 175,000
Senior Software Engineer, SageMaker AI Studio
Senior Software Engineer, SageMaker AI Studio

Amazon Web Services (AWS) • Santa Clara (CA)

On-site
USD 193,000 - 262,000
RSUs
Health insurance
401(k) matching
+2
Sr. System Development Engineer, High-Performance Accelerator Servers for AI/ML
Sr. System Development Engineer, High-Performance Accelerator Servers for AI/ML

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 151,000 - 205,000
Health insurance
401(k) matching
Paid time off
+1