Senior AI Coding Agent Evaluator (Remote)

G2i Inc.; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

G2i Inc. is seeking a senior-level engineer to evaluate AI coding agents in real-world scenarios. You will assess how the models think and explain their reasoning, focusing on taste, usefulness, and engineering judgment rather than production code.

The role requires strong English communication, subjective yet rigorous judgment, and the ability to articulate feedback clearly to improve AI-assisted development workflows.

Qualifications

• Senior, Staff or Principal-level engineer or equivalent experience.
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with at least one of OpenAI Codex, Claude Code or Cursor.
• Deep familiarity with modern AI-assisted dev workflows.
• Able to evaluate code without executing it or reviewing every line.
• Strong written and spoken English (B2 or above).
• Comfortable giving direct, opinionated feedback.

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge usefulness, high-level correctness, and engineering judgment.
• Assess explanations and reasoning, not just code.
• Differentiate quality levels (2 vs 4).
• Provide clear, opinionated feedback in writing and video explanations.
• Help define what great looks like with tools like Cursor, Codex and Claude Code.

Skills

TypeScript/JavaScript

Python

AI-assisted dev workflows

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i Inc. is seeking a senior-level engineer to evaluate AI coding agents in real-world scenarios. You will assess how the models think and explain their reasoning, focusing on taste, usefulness, and engineering judgment rather than production code.

The role requires strong English communication, subjective yet rigorous judgment, and the ability to articulate feedback clearly to improve AI-assisted development workflows.