Remote Python Code Reviewer & Debugger

AI Trainer Jobs; United States; Remote; USD 28,000 - 90,000; Full time

Job summary

AI Trainer Jobs is seeking a Python Expert Evaluator for a remote engineering review track. You will evaluate Python code, debug traces, and judge developer-facing AI outputs against real-world correctness standards. You will reproduce failures, write minimal failing tests, and explain fixes so the modeling team can target gaps.

You will be paired with experienced engineers and judged by a rubric. This contractor role offers remote work with US eligibility and pay ranging from $20 to $65 per

Qualifications

• Strong day-job Python experience with reading, running, and debugging unfamiliar code.
• Ability to write concise unit tests capturing a single failure mode.
• Familiarity with a testing framework (pytest, Jest, JUnit, etc.).

Responsibilities

• Run and reproduce Python code outputs in a sandboxed environment for Python Expert Evaluator assignments.
• Grade Python engineering solutions for correctness, style, and edge-case handling.
• Write minimal failing tests that demonstrate the bug a model output missed.
• Compare paired solutions and rank them with a written rationale tied to the rubric.
• Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.

Skills

Python

Debugging

Unit testing

Code review

Software engineering judgement

LeetCode

Tools

pytest

Jest

JUnit

Job description

AI Trainer Jobs is seeking a Python Expert Evaluator for a remote engineering review track. You will evaluate Python code, debug traces, and judge developer-facing AI outputs against real-world correctness standards. You will reproduce failures, write minimal failing tests, and explain fixes so the modeling team can target gaps.

You will be paired with experienced engineers and judged by a rubric. This contractor role offers remote work with US eligibility and pay ranging from $20 to $65 per