Senior AI Coding Evaluator (Python & JS)

Far Coder; Northern (KY); Hybrid; USD 138,000 - 276,000; Full time

Job summary

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess how AI coding agents behave in real-world scenarios. You will evaluate quality of interactions and provide insightful feedback to improve tooling and user experience.

The role emphasizes engineering judgment over syntax accuracy, focusing on meaningful, opinionated assessments for Codex/Claude Code interactions. Remote USA-based engagement with flexible hours.

Qualifications

• Staff or Principal-level engineer with senior-level experience.
• Experience evaluating AI-assisted coding tools.
• Ability to provide subjective but rigorous feedback.
• Strong judgement of engineering quality.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Assess usefulness, correctness, and explanations.
• Provide actionable feedback to improve models.
• Define what great looks like for Codex/Claude Code interactions.

Skills

TypeScript / JavaScript

Python

Engineering judgment

Tools

OpenAI Codex

Claude Code

Cursor

Job description

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess how AI coding agents behave in real-world scenarios. You will evaluate quality of interactions and provide insightful feedback to improve tooling and user experience.

The role emphasizes engineering judgment over syntax accuracy, focusing on meaningful, opinionated assessments for Codex/Claude Code interactions. Remote USA-based engagement with flexible hours.