Mid Level AI Developer - Remote - 3 Months - Octopus by RTG - Immediate Hir

robusta; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

robusta is seeking a MidLevel AI Developer to design, build and run production-grade agentic AI systems on AWS and Azure. You will turn business problems into reliable multi-step agent workflows using LLMs, tools and enterprise data, owning solutions from architecture to monitoring.

You will design multi-agent workflows, develop LLM applications on AWS and Azure, and build RAG pipelines with data ingestion, embeddings and vector search.

Qualifications

• Bachelor’s degree in CS or related field.
• 3+ years software engineering experience, with 1+ year GenAI production work.
• Strong Python skills and API development experience.
• Hands-on experience building agentic systems with modern frameworks.

Responsibilities

• Design and build agentic AI systems with multi-agent workflows.
• Develop LLM applications on AWS and Azure.
• Build RAG pipelines over enterprise data.
• Integrate agents with internal systems and APIs.
• Implement evaluation, safety and cost controls.

Skills

Python

LLM apps in production

AWS/Azure experience

APIs & services

LangGraph/LangChain

CI/CD

MCP / function calling

Observability

Cloud fundamentals

Education

Bachelor’s degree in Computer Science or related field

Tools

LangGraph

LangChain

Microsoft Agent Framework

Semantic Kernel

AutoGen

CrewAI

Job description

We’re looking for a MidLevel AI Developer to design, build and run production-grade agentic AI systems on AWS and Azure. You’ll turn business problems into reliable multi-step agent workflows that use LLMs, tools and enterprise data. You’ll own solutions from architecture and prototyping through deployment, evaluation and monitoring, and you’ll set engineering standards for how we build with AI.

What you will do

• Design and build agentic AI systems: single and multi-agent workflows with planning, tool use, memory and human-in-the-loop controls.
• Develop LLM applications on AWS (Amazon Bedrock, Bedrock Agents/AgentCore) and Azure (Azure OpenAI, Microsoft Foundry / Azure AI Foundry), and recommend the right platform and model for each use case.
• Build retrieval-augmented generation (RAG) pipelines, including data ingestion, chunking, embeddings, vector search and grounding over enterprise data.
• Integrate agents with internal systems, APIs and SaaS tools, using standards such as the Model Context Protocol (MCP) and function/tool calling.
• Implement evaluation frameworks for quality, accuracy, safety and cost, including regression tests, LLM-as-judge methods and human review.
• Add guardrails and responsible-AI controls: prompt-injection defences, content filtering, PII handling, access control and audit logging.
• Containerise and deploy services with CI/CD and infrastructure as code, and add observability (tracing, logging, latency and token-cost monitoring).
• Optimise performance, reliability and cost across models, prompts and infrastructure.
• Mentor engineers, run design and code reviews, and document architectures and decisions.
• Work with product owners, data teams, security and architecture to take AI use cases from idea to production.

What you need to be successful

Must have

• Bachelor’s degree in Computer Science, Engineering or a related field (or equivalent experience).
• 3+ years of software engineering experience, with 1+ years building LLM or GenAI applications in production.
• Strong Python skills, plus experience building and operating APIs and services.
• Hands-on experience building agentic systems with a modern framework (for example LangGraph, LangChain, Microsoft Agent Framework / Semantic Kernel, AutoGen, Strands Agents or CrewAI).
• Production experience on at least one of AWS or Azure AI services, and working knowledge of the other.
• Practical RAG experience with vector databases or search services (for example OpenSearch, Azure AI Search, pgvector or Pinecone).
• Experience with cloud fundamentals: containers (Docker, Kubernetes or serverless), networking and identity (IAM / Entra ID), and secrets management.
• Experience with CI/CD, Git and infrastructure as code (Terraform, Bicep or CloudFormation).
• Understanding of LLM evaluation, prompt engineering, and safety and security risks specific to AI systems.
• Strong communication skills and the ability to explain trade-offs to technical and non-technical stakeholders.

Nice to have:

• Experience with MCP servers, multi-agent protocols (for example A2A), or agent orchestration at scale.
• Fine-tuning or model customization, and experience with open-source models.
• Background in a regulated sector such as banking, healthcare or government.
• Cloud certifications (for example AWS Certified AI Practitioner or Solutions Architect, Azure AI-102 or AZ-204, AZ-400).
• Experience with data engineering (Spark, Databricks, Fabric or Glue) and data governance