Remote Senior AI Coding Interaction Evaluator

Remote Jobs; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

Remote Jobs seeks a Senior/Staff-level software engineer to evaluate AI-assisted coding interactions without writing production code. You will judge whether responses make sense, explanations are helpful, and the interaction demonstrates strong engineering judgment.

The engagement is remote, worldwide, 10-20 hours per week, with an hourly rate of $100-$200, and projects run from two weeks to a few months. Start after a take-home and Loom walkthrough.

Qualifications

• Senior, Staff or Principal-level engineer with deep AI-assisted dev experience.
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with Codex, Claude Code or Cursor.
• Deep familiarity with modern AI-assisted development workflows.

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge whether outputs are useful, correct at a high level, and aligned with a strong engineer.
• Assess the quality of explanations and reasoning, not just the code.
• Distinguish between levels of response quality (2 vs 4).
• Provide clear, opinionated written feedback on what worked and what felt off.

Skills

TypeScript/JavaScript

Python

English (B2+)

Feedback writing

Tools

OpenAI Codex the

Claude Code

Cursor

Job description

Remote Jobs seeks a Senior/Staff-level software engineer to evaluate AI-assisted coding interactions without writing production code. You will judge whether responses make sense, explanations are helpful, and the interaction demonstrates strong engineering judgment.

The engagement is remote, worldwide, 10-20 hours per week, with an hourly rate of $100-$200, and projects run from two weeks to a few months. Start after a take-home and Loom walkthrough.