Senior AI Coding Evaluation Engineer — Remote Contract

Remote Jobs; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

Remote Jobs is seeking a Senior/Staff- or Principal-level software engineer to evaluate AI-assisted coding interactions for quality and engineering judgment. You won't write production code; you'll assess whether responses are coherent, useful, and aligned with how a great engineer would think.

You'll provide clear, opinionated feedback in writing and via Loom walkthroughs, using tools like OpenAI Codex, Claude Code or Cursor. This remote role is 10–20 hours/week, with ongoing projects worldwide.

Qualifications

• Senior, Staff or Principal-level engineer (or equivalent experience)
• Hands-on experience with TypeScript/JavaScript or Python
• Strong written and spoken English (B2 or above)
• Experience with AI-assisted development workflows
• Ability to evaluate code without executing it or reviewing every line

Responsibilities

• Evaluate AI-generated coding interactions end to end
• Judge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would think
• Assess the quality of explanations and reasoning, not just the code
• Distinguish between levels of response quality and provide clear feedback

Skills

TypeScript/JavaScript

Python

English proficiency

Critical thinking

Feedback writing

Tools

OpenAI Codex

Claude Code

Cursor

Job description

Remote Jobs is seeking a Senior/Staff- or Principal-level software engineer to evaluate AI-assisted coding interactions for quality and engineering judgment. You won't write production code; you'll assess whether responses are coherent, useful, and aligned with how a great engineer would think.

You'll provide clear, opinionated feedback in writing and via Loom walkthroughs, using tools like OpenAI Codex, Claude Code or Cursor. This remote role is 10–20 hours/week, with ongoing projects worldwide.