Senior AI Coding Agent Evaluator (Remote)

G2i Inc.; Oklahoma; Remote; USD 138,000 - 276,000; Part time

Job summary

G2i Inc. is seeking a Senior Software Engineer, AI Training, for remote, worldwide contract work. You''ll assess how AI coding agents behave in real-world scenarios, focusing on usefulness, reasoning quality, and engineering judgement.

This role is not traditional coding; you will write detailed feedback and deliver Loom walkthroughs. Expect 10-20 hours per week, with compensation at $100–$200 hourly, depending on experience and location.

Qualifications

• Hands-on experience with OpenAI Codex, Claude Code or Cursor.
• Deep familiarity with modern AI-assisted dev workflows.
• Strong written and spoken English (B2 or above).
• Comfortable giving direct, opinionated feedback.

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge usefulness, correctness at a high level, and alignment with how a strong engineer would think.
• Assess quality of explanations and reasoning, not just the code.
• Distinguish between levels of response quality and provide clear feedback.

Skills

English proficiency

Senior/Staff/Principal level

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i Inc. is seeking a Senior Software Engineer, AI Training, for remote, worldwide contract work. You''ll assess how AI coding agents behave in real-world scenarios, focusing on usefulness, reasoning quality, and engineering judgement.

This role is not traditional coding; you will write detailed feedback and deliver Loom walkthroughs. Expect 10-20 hours per week, with compensation at $100–$200 hourly, depending on experience and location.