Senior Engineer - AI Coding Agent Evaluator (Remote)

G2i; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

G2i is seeking a highly experienced software engineer evaluator to assess how AI coding agents behave in real-world scenarios. This remote, worldwide role focuses on judging usefulness, engineering taste, and practical applicability beyond raw code.

You will provide explicit feedback, compare quality levels, and help define industry standards for working with tools like Codex, Claude Code, and Cursor. 10–20 hours per week, $100–$200/hour, flexible engagement.

Qualifications

• Senior, Staff or Principal-level engineer or equivalent experience.
• Strong background in TypeScript/JavaScript or Python.
• Excellent written and spoken English (B2 or above).

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge usefulness and high-level correctness of outputs.
• Assess explanations and reasoning quality as an experienced engineer would.
• Provide clear, opinionated written feedback on what worked and what didn’t.
• Help define what great looks like when using tools like Codex, Claude Code, Cursor.

Skills

Senior engineer

Staff engineer

Principal engineer

TypeScript/JavaScript

Python

English (B2)

Education

Experience with AI-assisted dev workflows

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i is seeking a highly experienced software engineer evaluator to assess how AI coding agents behave in real-world scenarios. This remote, worldwide role focuses on judging usefulness, engineering taste, and practical applicability beyond raw code.

You will provide explicit feedback, compare quality levels, and help define industry standards for working with tools like Codex, Claude Code, and Cursor. 10–20 hours per week, $100–$200/hour, flexible engagement.