Remote AI Orchestration Engineer: Agent Builder

Outlier; San Jose (CA); Remote; USD 57,000 - 81,000; Full time

Benefits offered by this job

Free LLM access

Flexible schedule

Remote work

Job summary

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future of autonomous agents like OpenClaw?

We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.

Qualifications

• 2+ years of experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production-grade software with modular separation (data parsing, logic processing, reporting).
• Experience building for live, non-mocked environments and handling multi-turn system interactions.
• Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.

Responsibilities

• Write Eval Rubrics
• Debug Agent Traces
• Stress Test Agent

Skills

Backend engineering

AI automation

Complex systems integration

Tools

Supabase

Gmail

APIs

Memory.md

Job description

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future of autonomous agents like OpenClaw?

We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.