Senior AI Agent Orchestration Architect

A2B2.ai; Hong Kong; Remote; HKD 900,000 - 1,300,000; Full time

Job summary

A2B2.ai is hiring a senior backend engineer to design and operate the orchestration layer for production multi-agent workflows. You will own how agents choose next steps, exchange state, call tools, recover from failure, request human approval and emit traces for explainability.

You will work across Python services, workflow state, retrieval, tool contracts, evaluation and cloud deployment. Collaborating with product, data and domain teams, you’ll ensure engineering quality of the runtime layer.

Qualifications

• 3+ years building backend or AI/ML systems in production.
• Deep Python proficiency with FastAPI or a comparable framework.
• Hands-on with LangGraph, LangChain, CrewAI, AutoGen or equivalent orchestration.
• Experience managing workflow state, retries, persistence and tool calls across APIs.
• Practical experience with LLM APIs (OpenAI, Claude, Gemini) and vector search.
• Strong system-design judgment, Git and code-review discipline, testing habits and clear communication.

Responsibilities

• Design supervisor-worker, planner-executor, hierarchical and specialist-agent workflows.
• Define agent responsibilities, inputs/outputs, state transitions and failure paths.
• Build long-running workflows with checkpoints, resumability, retries and idempotency.
• Set the boundary between deterministic code paths and model-led decisions.
• Integrate agents with databases, APIs and enterprise systems.
• Design safe tool contracts and validation around external actions.
• Build memory/context systems while avoiding data leakage.
• Work with PostgreSQL, vector search and asynchronous processing for scalable state.
• Instrument traces, telemetry and cost/latency/accuracy metrics across workflow stages.
• Develop production-ready engineering docs, runbooks and CI/CD processes.
• Maintain non-advisory boundary in code with evidence and uncertainty in outputs.

Skills

Python proficiency

FastAPI

Async patterns

LangGraph/LangChain/CrewAI

API error handling

System design

Git and code review

LLM APIs and vector search

Distributed/backend systems

Clear written communication

Tools

PostgreSQL

Redis

Docker

Kubernetes

CI/CD

Cloud (AWS/GCP/Azure)

Job description

A2B2.ai is hiring a senior backend engineer to design and operate the orchestration layer for production multi-agent workflows. You will own how agents choose next steps, exchange state, call tools, recover from failure, request human approval and emit traces for explainability.

You will work across Python services, workflow state, retrieval, tool contracts, evaluation and cloud deployment. Collaborating with product, data and domain teams, you’ll ensure engineering quality of the runtime layer.