Senior AI Coding Evaluator & Taste-Maker (Remote)

g2i

United States

Remote

USD 138,000 - 276,000

Full time

11 days ago
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

g2i is seeking a highly experienced software engineer to evaluate the quality of interactions with modern coding agents like OpenAI Codex, Claude Code and Cursor. This is not traditional production coding; you’ll judge whether the model thinks like a good engineer and whether the responses are useful.

You will assess how AI coding agents behave in real-world scenarios, focusing on accuracy, usefulness of preambles, and depth of engineering judgment, and you’ll provide clear feedback to help

Qualifications

  • Senior, Staff or Principal-level engineer with a strong TS/JS or Python background.
  • Hands-on experience with OpenAI Codex, Claude Code or Cursor.
  • Excellent written and spoken English (B2+).

Responsibilities

  • Evaluate AI-generated coding interactions end-to-end.
  • Judge usefulness, correctness at high level, and engineering judgment.
  • Assess explanations and reasoning, not just code.
  • Provide clear, opinionated written feedback on what worked and what didn’t.
  • Help define what great looks like when using AI coding tools.

Skills

TypeScript/JavaScript
Python
English communication

Tools

OpenAI Codex
Claude Code
Cursor

Job description

g2i is seeking a highly experienced software engineer to evaluate the quality of interactions with modern coding agents like OpenAI Codex, Claude Code and Cursor. This is not traditional production coding; you’ll judge whether the model thinks like a good engineer and whether the responses are useful.

You will assess how AI coding agents behave in real-world scenarios, focusing on accuracy, usefulness of preambles, and depth of engineering judgment, and you’ll provide clear feedback to help

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Engineer: AI Coding Tool Evaluator (Remote)
Senior Engineer: AI Coding Tool Evaluator (Remote)

G2i Inc. • United States

Remote
USD 138,000 - 276,000
Senior Engineer: AI Coding Interactions Evaluator (Remote)
Senior Engineer: AI Coding Interactions Evaluator (Remote)

G2i Inc. • United States

On-site
USD 138,000 - 276,000
Remote worldwide
Flexible hours
Senior AI Code Interaction Evaluator - Remote
Senior AI Code Interaction Evaluator - Remote

G2i • United States

Remote
AUD 198,000 - 396,000
Remote Senior Engineer — AI Coding Agent Evaluation
Remote Senior Engineer — AI Coding Agent Evaluation

Remote Worker LTD. • United States

Remote
USD 138,000 - 276,000
Senior Software Engineer, AI Training - US (Fully Remote)
Senior Software Engineer, AI Training - US (Fully Remote)

G2i Inc. • United States

Remote
USD 96,000 - 207,000
Remote work
Flexible hours
Senior AI Coding Evaluation Engineer — Remote Contract
Senior AI Coding Evaluation Engineer — Remote Contract

G2i • United States

Remote
USD 138,000 - 276,000
Senior AI Interaction Evaluator (Codex/Claude Code) – Contract
Senior AI Interaction Evaluator (Codex/Claude Code) – Contract

G2i • United States

Remote
USD 138,000 - 276,000
Senior AI Coding Evaluation Engineer - Remote, 10-20h/wk
Senior AI Coding Evaluation Engineer - Remote, 10-20h/wk

G2i • United States

Remote
USD 138,000 - 276,000
Senior AI Coding Tool Evaluator — Quality & Standards
Senior AI Coding Tool Evaluator — Quality & Standards

G2i Inc. • United States

Remote
USD 96,000 - 207,000
Remote work
Flexible hours
Senior AI Interaction Evaluator (Codex/Claude Code)
Senior AI Interaction Evaluator (Codex/Claude Code)

Precision Labs • Northern (KY)

Hybrid
USD 138,000 - 276,000