Software Engineer, AI Tooling & Agentic Systems at Scale

Socket.dev; New Jersey; On-site; USD 158,000 - 214,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Job summary

AWS is seeking a Software Development Engineer to join the Specialist AI Tooling engineering team. You will design production agentic AI systems using LLMs, knowledge graphs, and multi-agent orchestration to deliver personalized learning paths and expert-matching to thousands of AWS field members daily.

You will build GenAI-powered pipelines for summarization, routing, and knowledge retrieval, while ensuring low latency, high quality results and cost efficiency at scale.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• 1+ years of software development engineer or related occupational experience.
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience.

Responsibilities

• Design and implement production agentic AI systems using LLMs, knowledge graphs, RAG, and multi-agent orchestration - delivering personalized learning paths and intelligent expert-matching to thousands of field members daily.
• Build and optimize GenAI-powered pipelines including summarization, content ranking, skill assessment, and intelligent routing - ensuring low latency, high quality, and cost efficiency at scale.
• Develop and iterate on prompt engineering strategies, evaluation frameworks, and guardrails for production LLM systems - ensuring quality, safety, and reliability.
• Implement embedding and retrieval strategies for a knowledge base optimizing how domain expertise is indexed, retrieved, and contextualized for agent consumption.
• Design and build scalable distributed systems and APIs that power the TFC Hub platform, serving thousands of community members across 46 technical domains.
• Drive operational excellence for production services - owning CI/CD, monitoring, alarming, on-call, and incident response for systems serving thousands of daily users.
• Contribute to technical strategy and architecture decisions, proactively identifying opportunities to improve system performance, reliability, and developer velocity.
• Collaborate with Product Management, Science, and field stakeholders to translate ambiguous customer problems into well-scoped technical solutions.

Skills

C#

C++

Java

Perl

Education

Bachelor's degree in computer science or equivalent

Tools

C#

C++

Java

Perl

Job description

AWS is seeking a Software Development Engineer to join the Specialist AI Tooling engineering team. You will design production agentic AI systems using LLMs, knowledge graphs, and multi-agent orchestration to deliver personalized learning paths and expert-matching to thousands of AWS field members daily.

You will build GenAI-powered pipelines for summarization, routing, and knowledge retrieval, while ensuring low latency, high quality results and cost efficiency at scale.