Remote Fullstack Code Reviewer & QA Grader

AI Trainer Jobs; United States; Remote; USD 148,000 - 210,000; Full time

Benefits offered by this job

Remote work

Job summary

AI Trainer Jobs is seeking a remote Fullstack Developer to join a contractor evaluation track that reviews production code, debugging traces, and AI outputs for real-world correctness. Reviewers reproduce failures, write unit tests, and explain fixes so the modeling team can close gaps.

You'll work with engineers to judge generated code, read debugging traces, and provide clear, concise review notes. This role is remote, US-eligible, with hourly compensation after interview.

Qualifications

• Strong day-job engineering experience and ability to read, run, and debug unfamiliar code.
• Experience writing concise unit tests for a single failure mode.
• Familiarity with a testing framework (pytest, Jest, JUnit, Go test, RSpec).
• Clear written reasoning for review notes.
• Reliable availability for at least 10 hours per week.

Responsibilities

• Run and reproduce candidate code outputs in a sandboxed environment.
• Grade full-stack engineering solutions for correctness, style, and edge-case handling.
• Write minimal failing tests that demonstrate bugs.
• Compare paired solutions and rank with a written rationale tied to the rubric.
• Triage security issues and document the patch the model should have produced.

Skills

Code review

Debugging

Unit testing

Software engineering

Full-stack engineering

Open-source contributions

Tools

pytest

Jest

JUnit

Go test

RSpec

Job description

AI Trainer Jobs is seeking a remote Fullstack Developer to join a contractor evaluation track that reviews production code, debugging traces, and AI outputs for real-world correctness. Reviewers reproduce failures, write unit tests, and explain fixes so the modeling team can close gaps.

You'll work with engineers to judge generated code, read debugging traces, and provide clear, concise review notes. This role is remote, US-eligible, with hourly compensation after interview.