Senior AI Coding Evaluator — Engineering Taste (Remote)

G2i; United States; Remote; USD 138,000 - 276,000; Full time

Job summary

G2i is seeking a Senior/Staff-level software engineer to help evaluate the quality of AI coding agents. You won't write production code; you'll assess how models like OpenAI Codex, Claude Code or Cursor think and respond in real-world tasks, focusing on taste, usefulness and engineering judgment.

You will rate end-to-end interactions, judge whether outputs are useful and correct at a high level, and provide clear, opinionated written feedback.

Qualifications

• Senior/Staff-level software engineer
• Strong background in TS/JS or Python
• Ability to provide clear, written feedback
• Comfort with subjective, rigorous judgment

Responsibilities

• Evaluate AI-generated coding interactions end to end
• Judge usefulness, high-level correctness and engineering thinking
• Assess explanations and reasoning, not just code
• Provide clear, opinionated feedback on what worked or didn’t

Skills

TypeScript/JavaScript

Python

Engineering judgment

English communication

Video feedback

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i is seeking a Senior/Staff-level software engineer to help evaluate the quality of AI coding agents. You won't write production code; you'll assess how models like OpenAI Codex, Claude Code or Cursor think and respond in real-world tasks, focusing on taste, usefulness and engineering judgment.

You will rate end-to-end interactions, judge whether outputs are useful and correct at a high level, and provide clear, opinionated written feedback.