SDE - AI Tooling & GenAI Production Systems

Amazon Inc.; New York (NY); On-site; USD 158,000 - 214,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Restricted Stock Units (RSUs)

Job summary

Amazon Web Services, Inc. is seeking a Software Development Engineer for the Specialist AI Tooling team to build production-grade, agentic AI systems at AWS scale.

The role focuses on designing, implementing, and operating core AI tooling components that power the specialist ecosystem for thousands of AWS field teams and customers. You will own end-to-end features across knowledge graphs, multi-agent orchestration, and retrieval-augmented generation, delivering reliable services and low-latency

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of design or architecture experience for large systems.
• 1+ years of software development engineer or related occupational experience.
• Experience with at least one major programming language (C#, C++, Java, Perl).

Responsibilities

• Design and implement production AI systems using LLMs, knowledge graphs, and multi-agent orchestration.
• Build GenAI pipelines for summarization, ranking, and routing at scale.
• Develop prompt engineering strategies, evaluation frameworks, and guardrails for production LLMs.
• Implement embedding and retrieval for knowledge bases to optimize agent consumption.
• Design and build scalable distributed systems and APIs powering the platform for thousands of domain users.
• Own CI/CD, monitoring, alerting, on-call, and incident response for production services.
• Contribute to technical strategy and architecture decisions to improve performance and reliability.
• Collaborate with Product Management and field stakeholders to translate customer problems into technical solutions.

Skills

Software development

System design/architecture

Programming language proficiency

Distributed systems

Education

Bachelor's degree in CS or equivalent

Job description

Amazon Web Services, Inc. is seeking a Software Development Engineer for the Specialist AI Tooling team to build production-grade, agentic AI systems at AWS scale.

The role focuses on designing, implementing, and operating core AI tooling components that power the specialist ecosystem for thousands of AWS field teams and customers. You will own end-to-end features across knowledge graphs, multi-agent orchestration, and retrieval-augmented generation, delivering reliable services and low-latency