Senior AI Interaction Evaluator for Coding Tools

G2i; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real-world scenarios. You will focus on whether responses are sensible, the usefulness of preambles, and whether outputs reflect strong engineering judgment.

The role emphasizes evaluating explanations and feedback quality, not writing production code. Start ASAP, ~10–20 hrs/week, contract through early May with potential extension.

Qualifications

• Staff / Principal-level engineer (or equivalent)
• Strong background in one of: TypeScript/JavaScript or Python
• Hands-on experience using OpenAI Codex, Claude Code, Cursor
• Familiarity with modern AI-assisted dev workflows

Responsibilities

• Evaluate AI-generated coding interactions end-to-end
• Judge usefulness, correctness and engineering judgment of outputs
• Assess explanations and reasoning, not just code
• Provide clear, opinionated feedback on what works and what doesn’t
• Help define what great interaction looks like with coding tools

Skills

TypeScript/JavaScript

Python

Codex

Claude Code

Cursor

AI workflows

Tools

Cursor

Job description

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real-world scenarios. You will focus on whether responses are sensible, the usefulness of preambles, and whether outputs reflect strong engineering judgment.

The role emphasizes evaluating explanations and feedback quality, not writing production code. Start ASAP, ~10–20 hrs/week, contract through early May with potential extension.