GenAI & Agentic Systems Engineer for AWS Tooling

Jobzhr; New York (NY); On-site; USD 158,000 - 214,000; Full time

Job summary

Amazon Web Services, Inc. in New York, NY is seeking a Software Development Engineer to join the Specialist AI Tooling team. You’ll design, build, and operate core AI-powered components at AWS scale, spanning knowledge graphs, RAG, and agentic systems that drive AWS field teams.

Join a high-impact role building production GenAI features, shaping architecture, and delivering intelligent matching and summarization across thousands of users daily.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of design/architecture experience for large-scale systems.
• 1+ years of software engineer experience across multi-tiered/distributed apps.
• 1+ years of designing and developing large-scale distributed software using C#, C++, Java, or Perl.
• Experience programming with at least one software programming language.

Responsibilities

• Design and implement production agentic AI systems using LLMs, knowledge graphs, RAG, and multi-agent orchestration.
• Build and optimize GenAI-powered pipelines including summarization, content ranking, skill assessment, and intelligent routing.
• Develop prompt engineering strategies, evaluation frameworks, and guardrails for production LLM systems.
• Implement embedding and retrieval strategies for a knowledge base.
• Design and build scalable distributed systems and APIs powering the TFC Hub platform.
• Drive operational excellence for production services: CI/CD, monitoring, on-call, incident response.
• Contribute to technical strategy and architecture decisions to improve performance and velocity.
• Collaborate with PM, Science, and field stakeholders to translate problems into technical solutions.

Skills

Software development

System design

LLM-based systems

Knowledge graphs

Multi-agent orchestration

Prompt engineering

Programming languages

Education

Bachelor's degree in Computer Science or equivalent

Job description

Amazon Web Services, Inc. in New York, NY is seeking a Software Development Engineer to join the Specialist AI Tooling team. You’ll design, build, and operate core AI-powered components at AWS scale, spanning knowledge graphs, RAG, and agentic systems that drive AWS field teams.

Join a high-impact role building production GenAI features, shaping architecture, and delivering intelligent matching and summarization across thousands of users daily.