Senior AI Code Interaction Evaluator

G2i; United States; Remote; USD 138.000 - 276.000; Teilzeit

Zusammenfassung

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real-world tasks. You will evaluate responses for usefulness, reasoning quality, and engineering judgment, providing actionable feedback to improve interactions.

This is not writing production code; it focuses on high-level evaluation, feedback, and best practices for AI-assisted development. Start ASAP.

Qualifikationen

• Staff / Principal-level engineer with strong TS/JS or Python.
• Hands-on with OpenAI Codex, Claude Code and Cursor.
• Deep familiarity with modern AI-assisted dev workflows.

Aufgaben

• Evaluate AI-generated coding interactions end-to-end.
• Judge usefulness, correctness at a high level, and engineering judgment.
• Provide clear, opinionated feedback on what worked or didn’t.
• Define what great looks like when interacting with coding tools.

Kenntnisse

Senior/Principal engineer

TypeScript/JavaScript

Python

AI tooling experience

Tools

OpenAI Codex

Claude Code

Cursor

Jobbeschreibung

G2i is seeking a Senior AI Interaction Evaluator to assess how coding agents like Codex and Claude Code perform in real-world tasks. You will evaluate responses for usefulness, reasoning quality, and engineering judgment, providing actionable feedback to improve interactions.

This is not writing production code; it focuses on high-level evaluation, feedback, and best practices for AI-assisted development. Start ASAP.