Senior AI Coding Evaluator — Remote

G2i; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

G2i is seeking a highly experienced software engineer to participate in evaluating AI coding agents. This role is not writing production code but assessing how models think like engineers in real-world prompts. You’ll rate usefulness, reasoning quality, and engineering judgment, providing clear, opinionated feedback.

Remote, worldwide, 10-20 hrs/week with flexible start dates. Experience with TypeScript/JavaScript or Python is required; strong English communication skills are essential for

Qualifications

• Senior, Staff or Principal-level engineer
• Strong background in TypeScript/JavaScript or Python
• Hands-on experience with OpenAI Codex, Claude Code or Cursor
• Deep familiarity with modern AI-assisted dev workflows
• Able to evaluate code without executing it or reviewing every line
• Strong written and spoken English (B2 or above)

Responsibilities

• Evaluate AI-generated coding interactions end to end
• Judge whether outputs are useful and correct at a high level
• Assess the quality of explanations and reasoning
• Distinguish between levels of response quality (2 vs 4)
• Provide clear, opinionated written feedback on what worked or misled
• Help define what great looks like when using tools like Codex, Claude Code or Cursor

Skills

TypeScript

Python

Engineering judgement

Excellent English

Job description

G2i is seeking a highly experienced software engineer to participate in evaluating AI coding agents. This role is not writing production code but assessing how models think like engineers in real-world prompts. You’ll rate usefulness, reasoning quality, and engineering judgment, providing clear, opinionated feedback.

Remote, worldwide, 10-20 hrs/week with flexible start dates. Experience with TypeScript/JavaScript or Python is required; strong English communication skills are essential for