Remote SWE-Bench Task Auditor (Contract)

Meridial

United States

Remote

USD 68,000 - 97,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aitrainergigs seeks experienced SWE specialists to audit SWE-Bench tasks used to train AI systems. You will verify technical accuracy, realism, solvability, and reproducibility, and provide actionable feedback on codebase issues and test failures. This is a remote freelance contract, paying $60 per hour; the rate is set after evaluating your experience and location, with equipment provided by you.

Qualifications

  • Proven expertise in software engineering and SWE-Bench standards.
  • Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.

Responsibilities

  • Audit SWE-Bench tasks for technical accuracy, realism, solvability, and reproducibility.
  • Provide actionable feedback on codebase integration issues, test failures, or logic errors.

Skills

SWE-Bench expertise
Code review
Analytical problem solving

Tools

Git
CI/CD

Job description

Aitrainergigs seeks experienced SWE specialists to audit SWE-Bench tasks used to train AI systems. You will verify technical accuracy, realism, solvability, and reproducibility, and provide actionable feedback on codebase issues and test failures. This is a remote freelance contract, paying $60 per hour; the rate is set after evaluating your experience and location, with equipment provided by you.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote SWE-Bench Task Auditor — AI Training Quality
Remote SWE-Bench Task Auditor — AI Training Quality

Agency • United States

Remote
USD 106,000 - 144,000
SWE-Bench AI Task Auditor - Freelance AI Trainer Project
SWE-Bench AI Task Auditor - Freelance AI Trainer Project

Agency • United States

Remote
USD 106,000 - 144,000
SWE-Bench AI Task Auditor
SWE-Bench AI Task Auditor

Meridial • United States

Remote
USD 68,000 - 97,000
SWE-Bench Task Auditor (Docker, Python, Java)
SWE-Bench Task Auditor (Docker, Python, Java)

Mercor • United States

Remote
USD 96,000 - 124,000
Technical Task Auditor — SWE-Bench Task Auditor
Technical Task Auditor — SWE-Bench Task Auditor

Meridial • United States

Remote
USD 83,000 - 165,000
Remote AI Trainer (SWE): Build & Benchmark Tasks
Remote AI Trainer (SWE): Build & Benchmark Tasks

Xperteez Technology • United States

Remote
USD 55,000 - 110,000
Remote AI Coding & SWE Reviewer — 3+ yrs SWE
Remote AI Coding & SWE Reviewer — 3+ yrs SWE

RealTrainAI • United States

Remote
USD 76,000 - 152,000
SWE-Bench Task Auditor
SWE-Bench Task Auditor

Parailabs • United States

Remote
USD 120,000 - 180,000
SWE-Bench Task Auditor
SWE-Bench Task Auditor

Marketframe • United States

On-site
USD 140,000 - 190,000
Remote AI-Assisted Developer Workflow Auditor
Remote AI-Assisted Developer Workflow Auditor

Meridial • United States

Remote
USD 68,000 - 97,000