Remote Contract: AI Code Trace Auditor & Feedback

Visa Hunt; United States; Remote; USD 96,000 - 124,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our collaborators include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers and Jack Dorsey.

The AI Developer Trace Task Auditor role is a remote, contract position offering $70–$90 per hour. You will evaluate AI-assisted software-development traces, assess multi-step coding sessions, and provide rubric-based feedback to improve AI model outputs.

Qualifications

• 3+ years of professional software development experience.
• Hands-on experience with AI-assisted coding tools and agentic/spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar).
• Strong code-reading and debugging skills across full-stack or backend systems.
• Ability to evaluate multi-step coding trajectories for correctness and best practice.

Responsibilities

• Evaluate the quality and correctness of AI-assisted software-development traces to enhance model training and evaluation.
• Assess end-to-end coding sessions produced with AI-assisted developer tools for correctness, workflow soundness, and reasoning.
• Provide clear, rubric-based written feedback to improve AI model outputs.
• Review complex coding trajectories for alignment with best practices and correctness.
• Collaborate with AI research teams to ensure consistency and relevance in training data.
• Work independently and asynchronously to meet deadlines while enhancing AI model performance.

Skills

Software development experience

AI-assisted coding tools

Code reading / debugging

Evaluate multi-step trajectories

Tools

Cursor

GitHub Copilot

Claude Code

Job description

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our collaborators include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers and Jack Dorsey.

The AI Developer Trace Task Auditor role is a remote, contract position offering $70–$90 per hour. You will evaluate AI-assisted software-development traces, assess multi-step coding sessions, and provide rubric-based feedback to improve AI model outputs.