Senior AI Interaction Evaluator (Codex/Claude Code)

Precision Labs; Northern (KY); Hybrid; USD 138,000 - 276,000; Full time

Job summary

Precision Labs seeks a Senior AI Interaction Evaluator to assess how AI coding agents behave in real-world scenarios, focusing on whether responses make sense and whether explanations are useful.

You will provide clear, opinionated feedback on what works, what doesn’t, and what feels off, helping define what great engineering looks like when interacting with tools like Codex, Claude Code, and Cursor.

Qualifications

• Staff/Principal-level engineer or equivalent experience.
• Hands-on experience with Codex/Claude Code/Cursor.
• Experience with AI-assisted dev workflows.
• Able to provide subjective yet rigorous judgments.
• Comfortable giving direct feedback.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Judge usefulness, accuracy, and engineering alignment.
• Provide clear, opinionated feedback on what worked and what didn’t.
• Help define what great looks like when interacting with tools like Cursor.

Skills

TypeScript/JavaScript

Python

OpenAI Codex

Claude Code

Cursor

Engineering judgment

Job description

Precision Labs seeks a Senior AI Interaction Evaluator to assess how AI coding agents behave in real-world scenarios, focusing on whether responses make sense and whether explanations are useful.

You will provide clear, opinionated feedback on what works, what doesn’t, and what feels off, helping define what great engineering looks like when interacting with tools like Codex, Claude Code, and Cursor.