Senior AI Interaction Evaluator (Code Agents)

G2i Inc.; Canada; Hybrid; CAD 191,000 - 382,000; Full time

Job summary

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess AI coding agents like Codex and Claude Code. This contract role focuses on engineering taste rather than producing code, requiring subjective yet rigorous judgments.

You will evaluate end-to-end interactions, judge usefulness and correctness at a high level, and provide actionable feedback to define what great looks like when working with Cursor.

Qualifications

• Staff / Principal-level engineer (or equivalent experience).
• Strong background in TypeScript / JavaScript or Python.
• Hands-on experience with OpenAI Codex, Claude Code, and Cursor.
• Deep familiarity with modern AI-assisted dev workflows.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Judge whether outputs are useful, correct at a high level, and show engineering judgment.
• Assess the quality of explanations and reasoning, not just code.
• Provide clear, opinionated feedback on what worked, didn't, and what felt off.

Skills

TypeScript / JavaScript

Python

AI-assisted dev workflows

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess AI coding agents like Codex and Claude Code. This contract role focuses on engineering taste rather than producing code, requiring subjective yet rigorous judgments.

You will evaluate end-to-end interactions, judge usefulness and correctness at a high level, and provide actionable feedback to define what great looks like when working with Cursor.