Senior AI Coding Interaction Evaluator

G2i Inc.

Georgia

On-site

USD 69,000 - 276,000

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess how coding agents reason and respond. You won't write production code; you'll judge whether outputs show strong engineering judgment and useful explanations.

You will evaluate end-to-end AI-generated coding interactions with Codex and Claude Code, provide clear, opinionated feedback, and help define what great looks like for AI-assisted development. This contract runs 10–20 hours per week with start ASAP.

Qualifications

  • Strong background in Python and modern AI-assisted dev workflows.
  • Experience evaluating AI interactions without executing code.
  • Ability to give direct, opinionated feedback with rigor.

Responsibilities

  • Evaluate AI-generated coding interactions end-to-end.
  • Judge usefulness, correctness, and engineering reasoning.
  • Provide clear, opinionated feedback on what worked or didn’t.
  • Define what great looks like when interacting with AI tools.

Skills

Python
OpenAI Codex
Cursor
Engineering judgment

Tools

Cursor IDE

Job description

G2i Inc. is seeking a Senior AI Interaction Evaluator to assess how coding agents reason and respond. You won't write production code; you'll judge whether outputs show strong engineering judgment and useful explanations.

You will evaluate end-to-end AI-generated coding interactions with Codex and Claude Code, provide clear, opinionated feedback, and help define what great looks like for AI-assisted development. This contract runs 10–20 hours per week with start ASAP.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Coding Interaction Evaluator
Senior AI Coding Interaction Evaluator

G2i Inc. • Puerto Rico

On-site
USD 69,000 - 276,000
Part-Time Senior AI Coding Interaction Evaluator
Part-Time Senior AI Coding Interaction Evaluator

G2i Inc. • United States

On-site
USD 83,000 - 124,000
Senior AI Coding Evaluator (Python & JS)
Senior AI Coding Evaluator (Python & JS)

Far Coder • Northern (KY)

Hybrid
USD 138,000 - 276,000
Senior AI Interaction Evaluator for Coding Agents
Senior AI Interaction Evaluator for Coding Agents

Doist • Miami (FL)

On-site
USD 138,000 - 276,000
Competitive pay rate
Flexible schedule
Possible extension
+1
Senior AI Interaction Evaluator
Senior AI Interaction Evaluator

G2i Inc. • United States

On-site
USD 83,000 - 124,000
AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

Triwill Group • United States

On-site
USD 138,000 - 276,000
Remote work
Flexible schedule
Short-term engagement
+1
Senior Engineer - AI Interaction Evaluator - US and Canada only
Senior Engineer - AI Interaction Evaluator - US and Canada only

G2i Inc. • Miami (FL)

On-site
USD 138,000 - 276,000
Competitive pay rate
Flexible schedule
Possible extension
+1
AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

G2i Inc. • Arlington (WA)

On-site
USD 138,000 - 276,000
AI Coding Agent Expert — Remote Documentation & Evaluation
AI Coding Agent Expert — Remote Documentation & Evaluation

YO AI Labs • Town of Texas (WI)

Remote
USD 83,000 - 165,000
Python Engineer, AI Code Reviewer
Python Engineer, AI Code Reviewer

Far Coder • Northern (KY)

Hybrid
USD 138,000 - 276,000