GPU Compute Governance Engineer

Amazon Web Services (AWS)

Santa Clara (CA)

On-site

USD 144,000 - 194,000

Full time

45 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) matching
Paid time off
Parental leave

Job summary

Amazon Development Center U.S., Inc. is hiring a Software Development Engineer to design, build, and operate distributed backend services that pool GPU capacity across clusters for AI workloads.

You will own services end-to-end, from design through production, impacting some of the world’s largest AI compute customers. You will work on scheduling, capacity sharing, and usage reporting, with ownership of reliability, latency, and cost.

Qualifications

  • 3+ years of non-internship professional software development experience.
  • 2+ years of non-internship design or architecture of new and existing systems.
  • 1+ years of software development engineer or related occupational experience.
  • 1+ years of designing and developing large-scale distributed software applications and services using languages such as C++, Java, or C#.
  • 1+ years of Object Oriented Design experience.
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or related field.

Responsibilities

  • Design, build, and operate distributed backend services that manage and share accelerated compute across clusters and accounts.
  • Build scheduling and capacity-sharing capabilities to move compute to high-priority workloads.
  • Create usage reporting systems to show how compute is consumed at scale in near real time.
  • Own services in production: define operational metrics, respond to issues, and improve reliability and cost.
  • Produce clear design docs, participate in reviews, and raise engineering standards.
  • Collaborate with product, design, and partner teams to translate customer problems into features.
  • Mentor engineers and foster ownership, quality, and customer focus.

Skills

Distributed systems
Backend services
Scheduling
Capacity sharing
Performance optimization
Object Oriented Design
C++
Java
C#
Team collaboration

Education

Bachelor's degree in CS/Engineering

Tools

Kubernetes
Docker
Git
Cloud platforms

Job description

Amazon Development Center U.S., Inc. is hiring a Software Development Engineer to design, build, and operate distributed backend services that pool GPU capacity across clusters for AI workloads.

You will own services end-to-end, from design through production, impacting some of the world’s largest AI compute customers. You will work on scheduling, capacity sharing, and usage reporting, with ownership of reliability, latency, and cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Cloud GPU Hardware Engineer for AI Training
Senior Cloud GPU Hardware Engineer for AI Training

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 159,000 - 215,000
Software Dev Engineer II, SageMaker Compute Governance
Software Dev Engineer II, SageMaker Compute Governance

Amazon Web Services (AWS) • Santa Clara (CA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Senior Cloud GPU Hardware Architect for AI Servers
Senior Cloud GPU Hardware Architect for AI Servers

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 159,000 - 215,000
Health insurance
401(k) matching
Paid time off
+1
Senior GPU Supply Chain Lead – AI Compute
Senior GPU Supply Chain Lead – AI Compute

Amazon Inc. • Seattle (WA)

On-site
USD 148,000 - 200,000
Health insurance
RSUs
401(k) matching
+1
AI Infra Systems Engineer: GPU & Accelerator Servers
AI Infra Systems Engineer: GPU & Accelerator Servers

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 129,000 - 175,000
Health insurance
401(k) matching
Paid time off
+1
Cloud GPU Server Hardware Engineer for AI/ML
Cloud GPU Server Hardware Engineer for AI/ML

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 136,000 - 184,000
Health insurance
RSUs
401(k) matching
+1
Cloud AI Hardware Architect — GPU Server Systems
Cloud AI Hardware Architect — GPU Server Systems

Amazon Web Services (AWS) • Denver (CO)

On-site
USD 159,000 - 215,000
Senior Software Engineer – GPU Cloud, Distributed Systems
Senior Software Engineer – GPU Cloud, Distributed Systems

NVIDIA AI • Santa Clara (CA)

On-site
USD 180,000 - 280,000
Equity
Health Insurance
Senior Systems Automation Engineer - AI/ML GPU Fleet
Senior Systems Automation Engineer - AI/ML GPU Fleet

Amazon Inc. • Seattle (WA)

On-site
USD 150,000 - 210,000
GPU-Accelerated AI Cloud Hardware Architect
GPU-Accelerated AI Cloud Hardware Architect

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 157,000 - 213,000
Health insurance
RSUs and competitive benefits
Paid time off