Remote AI Agent Builder - Freelance (Up to $50/hr)

Outlier; Geelong; Remote; AUD 59,000 - 98,000; Full time

Benefits offered by this job

Weekly payments

Free AI tools access $200+/month

Flexible schedule

Additional incentives (surge pricing)

Job summary

Outlier invites engineers to help shape autonomous agents by writing evaluation rubrics and debugging agent traces in live environments. You will stress test agents and ensure scalable, reliable performance across complex multi-turn interactions.

The role emphasizes backend engineering, AI automation, and integrating tools like Supabase, Gmail, and APIs to solve real-world problems. Remote, freelance engagement with flexible hours.

Qualifications

• 2+ years of experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production-grade software with modular separation (e.g., services for data parsing, logic processing, reporting).
• Experience building for live environments and handling multi-turn system interactions.
• Strong attention to detail and ability to provide high-density technical feedback on complex system behaviors.

Responsibilities

• Write Eval Rubrics for agent evaluation.
• Debug Agent Traces to identify issues.
• Stress Test Agent to ensure reliability.

Skills

Backend engineering

AI automation

Complex systems integration

Tools

Supabase

Gmail

APIs

Job description

Outlier invites engineers to help shape autonomous agents by writing evaluation rubrics and debugging agent traces in live environments. You will stress test agents and ensure scalable, reliable performance across complex multi-turn interactions.

The role emphasizes backend engineering, AI automation, and integrating tools like Supabase, Gmail, and APIs to solve real-world problems. Remote, freelance engagement with flexible hours.