Remote Senior AI Coding-Evaluator: Engineering Taste

Openkrill; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

Openkrill is seeking a Senior, Staff or Principal-level software engineer to join a remote, contract-based evaluation program. You will assess how AI coding agents behave in real-world scenarios, focusing on whether the responses are sensible, the reasoning is useful, and the engineering judgment is strong.

Applicants should have deep experience in TypeScript/JavaScript or Python, hands-on work with Codex/Claude Code or Cursor, and excellent written English.

Qualifications

• Senior, Staff or Principal-level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with OpenAI Codex, Claude Code or Cursor.
• Deep familiarity with modern AI-assisted dev workflows.
• Able to evaluate code without executing it or reviewing every line.
• Strong written and spoken English (B2 or above).

Responsibilities

• Evaluate AI-generated coding interactions end-to-end.
• Judge usefulness, correctness at a high level, and engineering judgment.
• Assess explanations and reasoning, not just the code.
• Define what great looks like when working with tools like Codex, Claude Code or Cursor.
• Provide clear, opinionated written feedback and Loom walkthroughs.

Skills

TypeScript/JavaScript

Python

Codex/Claude/Cursor

English communication

Tools

OpenAI Codex

Claude Code

Cursor

Job description

Openkrill is seeking a Senior, Staff or Principal-level software engineer to join a remote, contract-based evaluation program. You will assess how AI coding agents behave in real-world scenarios, focusing on whether the responses are sensible, the reasoning is useful, and the engineering judgment is strong.

Applicants should have deep experience in TypeScript/JavaScript or Python, hands-on work with Codex/Claude Code or Cursor, and excellent written English.