Senior AI Interaction Evaluator (Codex/Claude)

G2i; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents reason and respond. You will critique Codex and Claude Code outputs, focusing on usefulness, correctness, and engineering judgment in real-world scenarios.

The role is a contract, paying $100–$200 per hour for ~10–20 hours per week, starting ASAP through early May with potential extension. You will provide clear, opinionated feedback and help define what great AI-assisted development looks like.

Qualifications

• Staff/Principal-level engineer or equivalent experience
• Strong background in TypeScript/JavaScript or Python
• Hands-on experience using OpenAI Codex, Claude Code, and Cursor
• Deep familiarity with modern AI-assisted dev workflows
• Able to evaluate code without fully executing or deeply reviewing every line
• Comfortable giving direct, opinionated feedback
• High bar for what good engineering looks like

Responsibilities

• Evaluate AI-generated coding interactions end-to-end
• Judge whether outputs are useful, correct, and aligned with how a strong engineer would think
• Assess the quality of explanations and reasoning, not just code
• Distinguish between different levels of response quality and provide clear feedback
• Help define what great looks like when interacting with tools like Cursor

Skills

TypeScript

JavaScript

Python

Engineering judgment

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents reason and respond. You will critique Codex and Claude Code outputs, focusing on usefulness, correctness, and engineering judgment in real-world scenarios.

The role is a contract, paying $100–$200 per hour for ~10–20 hours per week, starting ASAP through early May with potential extension. You will provide clear, opinionated feedback and help define what great AI-assisted development looks like.