Senior Software Engineer — AI Coding Evaluator & Feedback

United States Digital Space LLC

United Kingdom

Remote

GBP 104,000 - 208,000

Part time

3 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

United States Digital Space LLC is seeking a senior-level software engineer to evaluate AI coding agents. This is not traditional coding work; you will assess how models think and respond like engineers.

You will provide detailed, opinionated feedback on usefulness, explanations, and engineering judgment, helping define what great looks like when using tools like Cursor, Codex and Claude Code. Remote, worldwide with 10–20 hours per week.

Qualifications

  • Senior/Staff/Principal-level engineer with strong backend/frontend expertise.
  • Fluent English (B2 or higher) for feedback and video explanations.
  • Hands-on experience with OpenAI Codex, Claude Code or Cursor.

Responsibilities

  • Evaluate AI-generated coding interactions end to end.
  • Judge usefulness, high-level accuracy, and engineering judgment.
  • Assess explanations and reasoning, not just the code.
  • Differentiate what makes a response quality level (2 vs 4).
  • Provide clear, opinionated written feedback on what worked and what didn’t.
  • Help define what great looks like with tools like Cursor, Codex and Claude Code.

Skills

TypeScript/JavaScript
Python
English proficiency

Tools

OpenAI Codex
Claude Code
Cursor

Job description

United States Digital Space LLC is seeking a senior-level software engineer to evaluate AI coding agents. This is not traditional coding work; you will assess how models think and respond like engineers.

You will provide detailed, opinionated feedback on usefulness, explanations, and engineering judgment, helping define what great looks like when using tools like Cursor, Codex and Claude Code. Remote, worldwide with 10–20 hours per week.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Coding Evaluator (Remote) — Engineering Taste
Senior AI Coding Evaluator (Remote) — Engineering Taste

Work From Anywhere • United Kingdom

Remote
GBP 104,000 - 208,000
Senior Software Engineer, AI Training - UK
Senior Software Engineer, AI Training - UK

United States Digital Space LLC • United Kingdom

Remote
GBP 104,000 - 208,000
Senior AI Engineer - Production-Ready Coding Agents
Senior AI Engineer - Production-Ready Coding Agents

United States Digital Space LLC • Greater London

On-site
GBP 90,000 - 160,000
Flexible work location
Remote work up to 30 days/year abroad
Medical insurance allowance
+6
Engineering
Engineering

Work From Anywhere • United Kingdom

Remote
GBP 104,000 - 208,000
Remote Software Engineer for AI Training & Evaluation
Remote Software Engineer for AI Training & Evaluation

AfterQuery Experts • Cambridge

Remote
GBP 52,000 - 104,000
Competitive pay ($50–$100/hr)
Remote & asynchronous
One assessment, ongoing matches
Frontier ML Engineer — AI Coding Model Evaluator (Contract)
Frontier ML Engineer — AI Coding Model Evaluator (Contract)

Obsidian • Greater London

Remote
GBP 136,000 - 204,000
Remote Software Engineer
Remote Software Engineer

turing • United Kingdom

Remote
GBP 42,000 - 99,000
Senior Software Engineering Evaluator (Remote, Hourly)
Senior Software Engineering Evaluator (Remote, Hourly)

Obsidian • Greater London

Remote
GBP 55,000 - 83,000
Java Developer
Java Developer

Turing • Greater London

On-site
GBP 55,000 - 83,000
Remote Senior Software Engineering Evaluator — AI Artifacts
Remote Senior Software Engineering Evaluator — AI Artifacts

Mercor • Greater London

Remote
GBP 55,000 - 117,000