Senior AI Interaction Evaluator (Coding Tools)

G2i Inc.; Miami (FL); On-site; USD 138,000 - 276,000; Full time

Job summary

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess AI coding agents and judge engineering-minded responses. You will focus on whether the model's outputs make sense, whether explanations are useful, and whether interactions reflect strong engineering judgment.

This contract role pays $100–$200 per hour, ~10–20 hours per week, starting ASAP through early May, with potential extension. You’ll work with Codex, Claude Code, and Cursor in real-world scenarios.

Qualifications

• Staff / Principal-level engineer (or equivalent experience).
• Hands-on experience using OpenAI Codex, Claude Code, Cursor.
• Deep familiarity with modern AI-assisted dev workflows.
• Able to evaluate code without fully executing or deeply reviewing every line.
• Comfortable giving direct, opinionated feedback.
• High bar for what “good engineering” looks like.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Provide clear, opinionated feedback on what worked and what didn’t.
• Help define what great looks like when interacting with tools like Cursor.
• Distinguish between different levels of response quality (e.g. what makes something a 2 vs 4).

Skills

TypeScript

JavaScript

Python

Engineering experience

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess AI coding agents and judge engineering-minded responses. You will focus on whether the model's outputs make sense, whether explanations are useful, and whether interactions reflect strong engineering judgment.

This contract role pays $100–$200 per hour, ~10–20 hours per week, starting ASAP through early May, with potential extension. You’ll work with Codex, Claude Code, and Cursor in real-world scenarios.