Remote Senior Software Engineer: AI Task Design & Review

Mercor

Auckland

Remote

NZD 299,000 - 449,000

Full time

20 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking a Senior Software Engineering Expert for a remote contract role, collaborating with AI research labs to craft and evaluate realistic engineering tasks. You will define tasks, verify realism, and create reference solutions.

Strong English writing and data-driven judgment are essential. Candidates should have 4+ years in software engineering and a Bachelor's from an English-speaking country, with proficiency in major languages such as Python, Java, C++, Go, TypeScript, or Rust.

Qualifications

  • 4+ years of professional software engineering experience.
  • Proficient in at least one major language (Python, Java, C++, Go, TypeScript, or Rust).
  • Experience with large, complex production codebases and code quality judgment.
  • Excellent written English for technical decisions and trade-offs.
  • Bachelor's degree from an English-speaking country.
  • Detail-oriented and consistent in evaluating complex work.
  • Able to receive feedback and calibrate judgment to set standards.

Responsibilities

  • Design realistic, challenging software engineering tasks from real-world work. Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation.
  • Write clear task proposals explaining task realism, verification, and challenges for current AI models.
  • Illustrate 'what good looks like' with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope.
  • Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Take structured feedback from senior reviewers and iterate on submitted work.

Skills

Python
Java
C++
Go
TypeScript
Rust

Education

Bachelor's degree from an English-speaking country

Job description

Mercor is seeking a Senior Software Engineering Expert for a remote contract role, collaborating with AI research labs to craft and evaluate realistic engineering tasks. You will define tasks, verify realism, and create reference solutions.

Strong English writing and data-driven judgment are essential. Candidates should have 4+ years in software engineering and a Bachelor's from an English-speaking country, with proficiency in major languages such as Python, Java, C++, Go, TypeScript, or Rust.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer – AI/ML (Remote, Contract)
Senior Software Engineer – AI/ML (Remote, Contract)

Mercor • Auckland

Remote
NZD 294,000 - 441,000
Software Engineering Expert - Fully Remote | Up To $180/Hr
Software Engineering Expert - Fully Remote | Up To $180/Hr

Mercor • Auckland

Remote
NZD 299,000 - 449,000
Senior Software Engineer - Ai/Ml
Senior Software Engineer - Ai/Ml

Mercor • Auckland

Remote
NZD 294,000 - 441,000
Senior Data Scientist & AI Engineer (Remote, Contract)
Senior Data Scientist & AI Engineer (Remote, Contract)

Mercor • Auckland

Remote
NZD 294,000 - 441,000
Senior Software Engineer — AI QA & Evaluation (Remote)
Senior Software Engineer — AI QA & Evaluation (Remote)

Mercor • Auckland

Remote
NZD 245,000 - 368,000
Senior Software Engineering Evaluator (Remote, Contract)
Senior Software Engineering Evaluator (Remote, Contract)

Mercor • Auckland

Remote
NZD 244,000 - 365,000
Remote Manufacturing Operations Reviewer (Contract)
Remote Manufacturing Operations Reviewer (Contract)

Mercor • Auckland

Remote
NZD 135,000 - 159,000
Software Engineering Evaluator - Expert
Software Engineering Evaluator - Expert

Mercor • Auckland

Remote
NZD 244,000 - 365,000
Software Engineer - Fully Remote | Up To $150/Hr
Software Engineer - Fully Remote | Up To $150/Hr

Mercor • Auckland

Remote
NZD 245,000 - 368,000
Remote Manufacturing Operations Auditor (Contract)
Remote Manufacturing Operations Auditor (Contract)

Mercor • Auckland

Remote
NZD 76,000 - 90,000
Top locations