Senior AI Interaction Evaluator for Coding Agents

G2i; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real-world scenarios. You will judge whether outputs are useful, correct at a high level, and aligned with strong engineering thinking.

This contract role requires clear, opinionated feedback and a strong background in TS/JS or Python. Work is remote from the United States, ~10–20 hours per week, at a rate of $100–$200 per hour.

Qualifications

• Staff / Principal-level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript.
• Hands-on experience with OpenAI Codex, Claude Code and Cursor.
• Deep familiarity with modern AI-assisted developer workflows.
• Ability to evaluate code without fully executing or reviewing every line.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Judge usefulness, correctness, and engineering judgment.
• Assess explanations and reasoning, not just code.
• Provide clear, opinionated feedback on what worked or didn’t.
• Help define what great looks like when interacting with AI tools.

Skills

TypeScript/JavaScript

Python

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real-world scenarios. You will judge whether outputs are useful, correct at a high level, and aligned with strong engineering thinking.

This contract role requires clear, opinionated feedback and a strong background in TS/JS or Python. Work is remote from the United States, ~10–20 hours per week, at a rate of $100–$200 per hour.