Senior AI Coding Quality Evaluator (Remote)

G2i; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

G2i is seeking a Senior/Staff-level engineer to remotely evaluate AI coding interactions. The role focuses on assessing how coding agents behave in real-world scenarios, including explanation quality, engineering judgment, and the overall trust-building interaction. No production coding is required.

You will review outputs from tools like OpenAI Codex, Claude Code or Cursor, provide structured feedback, and help define what excellent AI-assisted coding looks like for experienced developers.

Qualifications

• Senior, Staff or Principal-level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with OpenAI Codex, Claude Code or Cursor.
• Deep familiarity with modern AI-assisted dev workflows.
• Able to evaluate code without executing it or reviewing every line.
• Strong written and spoken English (B2 or above).
• Comfortable giving direct, opinionated feedback.

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would think.
• Assess the quality of explanations and reasoning, not just the code.
• Distinguish between levels of response quality (what makes something a 2 vs a 4).
• Give clear, opinionated feedback in writing on what worked, what didn't, and what felt off or misleading.
• Help define what great looks like when working with tools like Cursor, Codex and Claude Code.

Skills

TypeScript/JavaScript

Python

OpenAI Codex

Claude Code

Cursor

English communication

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i is seeking a Senior/Staff-level engineer to remotely evaluate AI coding interactions. The role focuses on assessing how coding agents behave in real-world scenarios, including explanation quality, engineering judgment, and the overall trust-building interaction. No production coding is required.

You will review outputs from tools like OpenAI Codex, Claude Code or Cursor, provide structured feedback, and help define what excellent AI-assisted coding looks like for experienced developers.