Remote Senior Engineer — AI Coding Agent Evaluation

Remote Worker LTD.; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

Remote Worker LTD. seeks a senior‑level software engineer to evaluate AI coding assistants rather than write production code. You will judge if responses are sensible, the preamble helpful, and the output shows strong engineering judgment.

You will assess real‑world AI coding interactions, provide clear feedback, and help define what great looks like when using tools like Cursor, Codex and Claude Code. Remote, contract, 10–20 hrs/week.

Qualifications

• Senior/Staff/Principal-level engineer or equivalent experience.
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with at least one AI coding tool (Codex/Claude/Cursor).
• Deep familiarity with modern AI-assisted dev workflows.
• Ability to evaluate code without executing it.
• Excellent written and spoken English (B2+).
• Comfortable giving direct, opinionated feedback.

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge usefulness, high-level correctness, and engineering judgment.
• Assess explanations and reasoning, not just code.
• Differentiate between varying quality levels (2 vs 4).
• Provide clear, written feedback on what worked or misled.

Skills

Senior/Staff/Principal-level engineer

TypeScript/JavaScript

Python

OpenAI Codex

Claude Code

Cursor

AI-assisted dev workflows

Evaluate without execution

English communication

Direct feedback

Tools

OpenAI Codex

Claude Code

Cursor

Job description

Remote Worker LTD. seeks a senior‑level software engineer to evaluate AI coding assistants rather than write production code. You will judge if responses are sensible, the preamble helpful, and the output shows strong engineering judgment.

You will assess real‑world AI coding interactions, provide clear feedback, and help define what great looks like when using tools like Cursor, Codex and Claude Code. Remote, contract, 10–20 hrs/week.