Senior AI Interaction Evaluator

G2i Inc.; United States; On-site; USD 83,000 - 124,000; Part time

Job summary

G2i Inc. is seeking a part-time Senior AI Interaction Evaluator to assess AI-generated coding responses for usefulness, correctness, and alignment with strong engineering judgment. You will evaluate interactions end-to-end and provide clear, opinionated feedback on evaluation quality.

You will work with TypeScript, JavaScript, and Python, leveraging OpenAI Codex and Claude Code, to shape standards for AI-assisted development workflows and raise engineering quality.

Qualifications

• Staff or Principal-level engineer or equivalent experience.
• Strong background in TypeScript, JavaScript or Python.
• Hands-on experience with OpenAI Codex and Claude Code.
• Deep familiarity with modern AI-assisted development workflows.
• Comfortable giving direct, opinionated feedback on engineering quality.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end for usefulness and correctness.
• Assess the quality of explanations and reasoning provided by AI tools.
• Provide clear, opinionated feedback on effectiveness and define quality standards.

Skills

TypeScript

JavaScript

Python

Tools

OpenAI Codex

Claude Code

Job description

Evaluating the quality of interactions with modern coding agents, the part-time contract Senior AI Interaction Evaluator will assess AI-generated coding responses for usefulness, correctness, and alignment with strong engineering judgment while providing clear feedback on the evaluation process.

Key responsibilities

• Evaluate AI-generated coding interactions end-to-end for usefulness and correctness
• Assess the quality of explanations and reasoning provided by AI tools
• Provide clear, opinionated feedback on the effectiveness of interactions and define standards for quality

Required qualifications

• Staff or Principal-level engineer (or equivalent experience)
• Strong background in TypeScript, JavaScript, or Python
• Hands-on experience with OpenAI Codex and Claude Code
• Deep familiarity with modern AI-assisted development workflows

  Required qualifications

  • Staff or Principal-level engineer (or equivalent experience)
  • Strong background in TypeScript, JavaScript, or Python
  • Hands-on experience with OpenAI Codex and Claude Code
  • Deep familiarity with modern AI-assisted development workflows
  • Comfortable giving direct, opinionated feedback on engineering quality