Production AI Engineer — AWS Bedrock AgentCore

Toptal; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

Toptal is seeking engineers to build and productionize AI systems on AWS Bedrock AgentCore. You will design, deploy, and operate conversational AI agents and RAG pipelines serving live traffic, with a focus on production-grade reliability.

Role spans AI application and platform concerns—agent orchestration, observability, security, and scalable service layers—using Python and AWS-native tools. Remote work is supported for this fast-moving, growth-focused team.

Qualifications

• Proven hands-on experience building and deploying AI agents on AWS Bedrock AgentCore in production.
• Direct experience with AWS Bedrock’s agentic tooling (AgentCore, Bedrock Agents, or equivalent Bedrock-native orchestration).
• Strong Python skills for AI application development and/or service integration.
• Working experience with AWS cloud environments; Azure experience is a plus but not the primary requirement.
• Experience with agent orchestration frameworks (LangChain, LangGraph, LlamaIndex), RAG design, or AWS production infrastructure.
• Experience with observability and monitoring for AI or distributed systems.
• Strong understanding of security, data handling, and production-readiness tradeoffs.
• Comfortable in a fast-moving, evolving technical environment with pragmatic engineering judgment.
• Nice to Have Experience with MCP servers.
• Experience with infrastructure-as-code (CDK, CloudFormation) and CI/CD pipeline design.

Responsibilities

• Design, build, and deploy conversational AI systems, chatbots, and AI agents using AWS Bedrock AgentCore Architect and ship production-grade RAG systems.
• Build and deploy LLM applications primarily on AWS Bedrock and AgentCore with Azure OpenAI as secondary context.
• Develop and orchestrate agent architectures within AgentCore using LangChain, LangGraph, or LlamaIndex where applicable.
• Build and maintain MCP server integrations to extend AgentCore capabilities.
• Design and build the production service layer around AgentCore (Lambda, API Gateway, IAM, DynamoDB, OpenSearch).
• Establish CI/CD pipelines and manage development, beta, and production environments for AgentCore-based services.
• Implement observability for AgentCore agents: tracing, dashboards, per-turn cost and latency metrics, error rates.
• Implement security controls — data leakage protection, session isolation, auth boundaries, secure prompt storage.
• Write clean, production-grade Python across AI application and platform stack.
• Monitor, evaluate, and iterate on agent, RAG, and platform performance in production.

Tools

Python

AWS Bedrock AgentCore

LangChain

LangGraph

LlamaIndex

RAG design

AWS Lambda

DynamoDB

OpenSearch

CDK

CloudFormation

Job description

Toptal is seeking engineers to build and productionize AI systems on AWS Bedrock AgentCore. You will design, deploy, and operate conversational AI agents and RAG pipelines serving live traffic, with a focus on production-grade reliability.

Role spans AI application and platform concerns—agent orchestration, observability, security, and scalable service layers—using Python and AWS-native tools. Remote work is supported for this fast-moving, growth-focused team.