AI Infrastructure & Inference Systems Engineer

Amazon; Sunnyvale (CA); On-site; USD 165,000 - 224,000; Full time

Benefits offered by this job

Health insurance

RSUs

401(k) matching

Paid time off

Parental leave

Job summary

Amazon is seeking a Software Development Engineer to join the Alexa AI Logistics for Infrastructure, Cost, and Efficiency (ALICE) team in Sunnyvale, CA. You will design and build large-scale, distributed systems powering AI inference and cost optimization for Alexa services.

You will collaborate with senior engineers, optimize GPU fleets, and ensure production readiness through rigorous reviews and standards. Eligible for Amazon benefits and RSUs.

Qualifications

• Bachelor's degree in CS, Engineering, Math or related field.
• 3+ years non-internship software development experience.
• 2+ years design/architecture experience of large systems.

Responsibilities

• Design, develop, and maintain large-scale distributed systems and infrastructure services.
• Work on GPU fleet management and optimization for low-latency ML inference workloads at large scale.
• Collaborate with senior engineers to deliver features from design through production deployment.
• Set standards and contribute to the operational excellence of Tier-1 production services.
• Write clean, testable, maintainable code and participate in code reviews.
• Work closely with Alexa and AWS teams to deliver cross-functional projects.
• Research opportunities to improve service performance, reliability, and cost efficiency.

Skills

Distributed systems

GPU management

Code reviews

Collaboration

Education

Bachelor's degree (CS/Engineering/Math)

Tools

Python

C++

Job description

Amazon is seeking a Software Development Engineer to join the Alexa AI Logistics for Infrastructure, Cost, and Efficiency (ALICE) team in Sunnyvale, CA. You will design and build large-scale, distributed systems powering AI inference and cost optimization for Alexa services.

You will collaborate with senior engineers, optimize GPU fleets, and ensure production readiness through rigorous reviews and standards. Eligible for Amazon benefits and RSUs.