Remote AI Code Evaluation Engineer

RemoExperts

United States

Remote

USD 90,000 - 145,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AI Trainer Jobs is seeking experienced software engineers to train and evaluate AI models on real-world programming work. You will design coding tasks, review AI-generated code, and write the reference solutions and tests used to measure models.

You will build reproducible environments with Git and Docker, write robust tests, and articulate design decisions behind reference solutions while communicating clearly in English. Remote role with international collaboration.

Qualifications

  • Degree in computer science or related field, or equivalent professional experience.
  • 3+ years of professional software engineering experience.
  • Strong Python, plus at least one of Java, C++, TypeScript, Go or Rust.
  • Proficiency with Git, Docker and automated testing.
  • Ability to read and navigate unfamiliar codebases.
  • Fluent written English and clear technical communication.
  • Reliable, detail-oriented, and able to work independently and meet deadlines in a remote setting.

Responsibilities

  • Design realistic coding tasks (bug fixes, feature implementation, refactoring, performance optimisation) with clear specifications.
  • Build reproducible environments (Git, Docker) and write automated test suites that verify solutions.
  • Write high-quality reference solutions and explain the design decisions behind them.
  • Evaluate AI-generated code for correctness, performance, security and readability.
  • Rank and compare model outputs and justify your judgments in clear written rationale.
  • Identify recurring failure patterns in model output and report them to the project team.
  • Follow project guidelines, take part in calibration and review sessions, and incorporate feedback to keep quality consistent.

Skills

Python
Java
C++
TypeScript
Go
Rust
Git
Docker
Automated testing
Technical communication

Education

CS degree or related field

Tools

Git
Docker
CI/CD

Job description

AI Trainer Jobs is seeking experienced software engineers to train and evaluate AI models on real-world programming work. You will design coding tasks, review AI-generated code, and write the reference solutions and tests used to measure models.

You will build reproducible environments with Git and Docker, write robust tests, and articulate design decisions behind reference solutions while communicating clearly in English. Remote role with international collaboration.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Game Dev Trainer & Evaluator
Remote AI Game Dev Trainer & Evaluator

RemoExperts • United States

Remote
USD 69,000 - 172,000
Remote AI Research & Code Evaluation Engineer
Remote AI Research & Code Evaluation Engineer

OpenTrain AI, Inc. • United States

Remote
USD 55,000 - 165,000
Remote AI Code Evaluation Engineer (Python)
Remote AI Code Evaluation Engineer (Python)

OpenTrain AI, Inc. • United States

Remote
USD 227,000 - 324,000
Remote AI Software Review Engineer (Code & Tests)
Remote AI Software Review Engineer (Code & Tests)

Auraone • United States

Remote
USD 55,000 - 83,000
Remote AI Coding Trainer
Remote AI Coding Trainer

Meridial • United States

Remote
USD 11,000 - 90,000
Remote AI Training & Evaluation Specialist
Remote AI Training & Evaluation Specialist

prolificacademicltd • United States

Remote
USD 28,000 - 40,000
Home-based remote work
Flexible scheduling
Hourly pay up to $25
Remote AI Hardware & Engineering Trainer
Remote AI Hardware & Engineering Trainer

OpenTrain AI, Inc. • United States

Remote
USD 83,000 - 165,000
Remote AI Trainer for Software Engineers - Flexible Hours
Remote AI Trainer for Software Engineers - Flexible Hours

Frontier AI Lab • United States

Remote
USD 83,000 - 165,000
Remote AI Training Engineer for Advanced Model Evaluation
Remote AI Training Engineer for Advanced Model Evaluation

Xperteez Technology • United States

Remote
USD 34,000 - 83,000
Remote AI Coding Evaluator – Software Quality
Remote AI Coding Evaluator – Software Quality

Turing • United States

Remote
USD 3,300 - 5,000
Fully remote
Cutting-edge AI projects