Senior AI Coding Interaction Evaluator

G2i Inc.; Miami (FL); On-site; USD 138,000 - 276,000; Full time

Job summary

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess AI coding agents like Codex and Claude Code. The role focuses on evaluating interaction quality, usefulness, and engineering judgment without writing production code.

You will provide structured feedback on what works, what doesn’t, and what feels off, guiding the standards for AI-assisted developer tooling. This is a contract, part-time engagement targeting 10–20 hours weekly.

Qualifications

• Staff / Principal-level engineer (or equivalent experience)
• Strong background in TypeScript/JavaScript or Python
• Hands-on experience using OpenAI Codex, Claude Code, Cursor
• Deep familiarity with modern AI-assisted dev workflows
• Able to evaluate code without fully executing or deeply reviewing every line
• Comfortable giving direct, opinionated feedback
• High bar for what good engineering looks like

Responsibilities

• Evaluate AI-generated coding interactions end-to-end
• Judge whether outputs are useful, correct at a high level, and aligned with strong engineering thinking
• Assess the quality of explanations and reasoning, not just code
• Distinguish between levels of output quality and provide clear feedback
• Help define what great looks like when interacting with tools like Cursor

Skills

TypeScript/JavaScript

Python

Engineering judgment

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess AI coding agents like Codex and Claude Code. The role focuses on evaluating interaction quality, usefulness, and engineering judgment without writing production code.

You will provide structured feedback on what works, what doesn’t, and what feels off, guiding the standards for AI-assisted developer tooling. This is a contract, part-time engagement targeting 10–20 hours weekly.