AI Developer Trace Task Auditor

Cashback24x7; Indiana; Hybrid; USD 96,000 - 124,000; Part time

Benefits offered by this job

Referral reward

Remote work

Weekly payments

Job summary

Mercor seeks an AI Developer Trace Task Auditor to evaluate AI-assisted coding traces used to train frontier AI models. You will judge correctness, workflow soundness, and reasoning across end-to-end coding sessions, delivering rubric-based feedback.

The role is remote for US-based professionals, paid hourly, with weekly payments via Stripe or Wise, and independence as an contractor. Prior experience with AI-assisted coding tools is essential.

Qualifications

• 3+ years of professional software development experience.
• Hands-on experience with AI-assisted coding tools and agentic workflows (Cursor, GitHub Copilot, Claude Code or similar).
• Strong code-reading and debugging skills across full-stack or backend systems.
• Ability to evaluate multi-step coding trajectories for correctness and best practices.

Responsibilities

• Evaluate AI-assisted software-development traces used to train and evaluate frontier AI lab models.
• Provide rubric-based written feedback on correctness, workflow soundness and reasoning.

Skills

Software development

AI-assisted coding

Code reading & debugging

Evaluating AI-generated code

Cursor/GitHub Copilot/Claude Code

Tools

Kiro

Amazon CodeCatalyst

Job description

AI Developer Trace Task Auditor

Company: Mercor

Compensation: $70-$90 per hour

Commitment: Hourly contract

Location: Remote — United States

Referral Reward: Earn up to $1,440 per successful referral.

Referral Link: https://t.mercor.com/MpIzZ

Location requirements

United States

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.

Basic Qualifications

• 3+ years professional software development
• Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
• Strong code-reading and debugging skills across full-stack or backend systems
• Ability to evaluate multi-step coding trajectories for correctness and best practice

Preferred Qualifications

• Experience with Kiro or Amazon CodeCatalyst
• Prior work evaluating or grading AI-generated code
• Contributions to developer tooling

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

You will be engaged as an independent contractor. This is a fully remote role that can be completed on your own schedule. Projects can be extended, shortened, or concluded early depending on needs and performance. Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are weekly on Stripe or Wise based on services rendered. Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.