Senior AI Interaction Evaluator for Coding Agents

Precision Labs; Northern (KY); Hybrid; USD 138,000 - 276,000; Full time

Job summary

Precision Labs is seeking a Staff/Principal-level engineer to evaluate AI coding interactions in real-world scenarios, judging usefulness, high-level correctness, and engineering judgment.

You should have TypeScript/JavaScript or Python expertise and hands-on experience with Codex, Claude Code and Cursor. This contract runs ~10–20 hours/week, $100–$200/hour, starting ASAP through early May.

Qualifications

• Staff / Principal-level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with OpenAI Codex, Claude Code and Cursor.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Provide objective, opinionated feedback on usefulness and reasoning.
• Help define what great interaction looks like for developers.

Skills

Staff / Principal-level engineer

TypeScript / JavaScript

Python

Tools

OpenAI Codex

Claude Code

Cursor

Job description

Precision Labs is seeking a Staff/Principal-level engineer to evaluate AI coding interactions in real-world scenarios, judging usefulness, high-level correctness, and engineering judgment.

You should have TypeScript/JavaScript or Python expertise and hands-on experience with Codex, Claude Code and Cursor. This contract runs ~10–20 hours/week, $100–$200/hour, starting ASAP through early May.