Senior AI Interaction Evaluator for Coding Assistants

G2i; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real‑world development scenarios. You’ll not write production code; you’ll judge usefulness, correctness, and engineering judgment in model responses.

The role is contract-based, paying $100–$200 per hour for ~10–20 hours weekly, start ASAP through early May with possible extension. Experience at Staff/Principal level and hands-on familiarity with AI-assisted workflows are required.

Qualifications

• Staff or Principal‑level software engineer with strong coding experience.
• Background in evaluating AI-assisted development workflows.
• Ability to give direct, opinionated feedback on interactions.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Judge usefulness, correctness, and engineering reasoning.
• Assess explanations and reasoning beyond code quality.
• Provide actionable feedback on what worked or misled.
• Define what great looks like when using AI coding assistants.

Skills

Senior/Principal-level

Engineering judgment

Feedback skills

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real‑world development scenarios. You’ll not write production code; you’ll judge usefulness, correctness, and engineering judgment in model responses.

The role is contract-based, paying $100–$200 per hour for ~10–20 hours weekly, start ASAP through early May with possible extension. Experience at Staff/Principal level and hands-on familiarity with AI-assisted workflows are required.