Senior Software Engineer - AI Task Design & Review (Remote)

Mercor

United States

Remote

USD 165,000 - 248,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role is for a Senior Software Engineering Expert who will design realistic tasks, review code, and assess AI-generated work within large production systems.

You will craft task proposals, include reference solutions, and articulate verification criteria to guide AI models. The ideal candidate has 4+ years of professional software engineering experience at top firms, strong proficiency in

Qualifications

  • 4+ years of professional software engineering experience at leading technology, quantitative, or financial firms.
  • Excellent written English for explaining technical decisions and trade-offs.
  • Proven ability to work in large, complex production codebases and judge code quality.

Responsibilities

  • Design realistic, challenging software engineering tasks from real-world work.
  • Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation.
  • Write clear task proposals explaining task realism, verification, and challenges for current AI models.
  • Illustrate 'what good looks like' with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope.
  • Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Take structured feedback from senior reviewers and iterate on submitted work.

Skills

Strong proficiency in Python/Java/C++/
Excellent written English
Experience with large production code
Detail-oriented
Ability to calibrate judgment against设

Education

Bachelor's degree from an English-speaking country

Tools

Git

Job description

Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role is for a Senior Software Engineering Expert who will design realistic tasks, review code, and assess AI-generated work within large production systems.

You will craft task proposals, include reference solutions, and articulate verification criteria to guide AI models. The ideal candidate has 4+ years of professional software engineering experience at top firms, strong proficiency in

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - AI/ML
Senior Software Engineer - AI/ML

Mercor • United States

Remote
USD 165,000 - 248,000
Senior Software Engineer (Contract) Remote AI & Open-Source
Senior Software Engineer (Contract) Remote AI & Open-Source

Mercor • San Francisco (CA)

Hybrid
GBP 103,000 - 147,000
Senior Sales Engineer - AI Solutions (Remote)
Senior Sales Engineer - AI Solutions (Remote)

Mercor • San Francisco (CA)

Hybrid
GBP 104,000 - 157,000
Senior Engineering & Software Domain Expert
Senior Engineering & Software Domain Expert

Mercor • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
AI Software Engineer - GenAI
AI Software Engineer - GenAI

Mercor • United States

Remote
USD 110,000 - 165,000
Remote Brand Strategist - AI Marketing & Briefing
Remote Brand Strategist - AI Marketing & Briefing

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 156,000
Software Engineer - Fully Remote | Up To $120/Hr
Software Engineer - Fully Remote | Up To $120/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 103,000 - 147,000
Remote AI HR Specialist: Task Design & Evaluation
Remote AI HR Specialist: Task Design & Evaluation

AI Work Expert • United States

Remote
USD 108,000 - 154,000
Remote Part-Time AI Software Engineer Task Designer
Remote Part-Time AI Software Engineer Task Designer

Anyone AI Inc. • United States

Remote
USD 83,000 - 165,000
Remote AI Content Quality Reviewer (Domain Expert)
Remote AI Content Quality Reviewer (Domain Expert)

Mercor • San Francisco (CA)

Hybrid
GBP 73,000 - 89,000