Remote AI Agent Architect — Multi-Agent Systems Expert

Outlier; Columbus (OH); Remote; USD 57,000 - 81,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Job summary

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. You will contribute to shaping autonomous agents similar to OpenClaw, working remotely as a freelance specialist.

Roles include writing evaluation rubrics, debugging traces, and stress testing models in live environments. Flexible, contractor arrangement with weekly payments and variable project scope.

Qualifications

• 2+ years of backend engineering, AI automation, or complex systems integration.
• Experience building production-grade software with modular services for data parsing, logic processing, and reporting.
• Experience working with live systems and multi-turn interactions.

Responsibilities

• Write Eval Rubrics for agent evaluation.
• Debug Agent Traces to identify issues.
• Stress Test Agent under realistic workloads.

Skills

Backend engineering

AI automation

Complex systems integration

Production-grade software

Live, non-mocked environments

Multi-turn system interactions

Tools

Supabase

Gmail

APIs

Job description

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. You will contribute to shaping autonomous agents similar to OpenClaw, working remotely as a freelance specialist.

Roles include writing evaluation rubrics, debugging traces, and stress testing models in live environments. Flexible, contractor arrangement with weekly payments and variable project scope.