AI Task Auditor for SWE-Bench - Remote QA & Debugging

Jobgether SRL

United States

Remote

USD 100,000 - 140,000

Full time

4 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Jobgether is an AI-powered job platform that curates tasks and roles for candidates and engineers. This position focuses on reviewing SWE-Bench tasks, ensuring technical realism, and troubleshooting related codebases and tests.

The role emphasizes independent work in a secure remote setup with opportunities in remote, freelance formats. Candidates should have professional software engineering experience and strong debugging skills to evaluate task solvability and align tasks with industry

Qualifications

  • Professional software engineering experience and strong debugging skills.

Responsibilities

  • Review SWE-Bench tasks for technical accuracy, realism, and reproducibility.
  • Troubleshoot codebases, tests, and integration issues.
  • Evaluate task solvability and alignment with standards.
  • Provide clear, actionable feedback to improve AI training workflows.

Skills

Software engineering experience
Strong debugging skills

Job description

Jobgether is an AI-powered job platform that curates tasks and roles for candidates and engineers. This position focuses on reviewing SWE-Bench tasks, ensuring technical realism, and troubleshooting related codebases and tests.

The role emphasizes independent work in a secure remote setup with opportunities in remote, freelance formats. Candidates should have professional software engineering experience and strong debugging skills to evaluate task solvability and align tasks with industry

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

SWE-Bench AI Task Auditor - Freelance AI Trainer Project (Fully Remote)
SWE-Bench AI Task Auditor - Freelance AI Trainer Project (Fully Remote)

Jobgether SRL • United States

Remote
USD 100,000 - 140,000
Remote SWE-Bench AI Task Auditor - Freelance
Remote SWE-Bench AI Task Auditor - Freelance

Meridial • Austin (TX)

On-site
USD 68,000 - 97,000
SWE-Bench AI Task Auditor - Freelance AI Trainer Project
SWE-Bench AI Task Auditor - Freelance AI Trainer Project

Jobgether SRL • United States

Remote
USD 68,000 - 97,000
Fully remote freelance contract
Flexible project-based work
Impact on AI training workflows
Remote Part-Time Open Source & SWE-Bench Evaluator
Remote Part-Time Open Source & SWE-Bench Evaluator

Anyone AI Inc. • United States

Remote
USD 83,000 - 165,000
Remote SWE Agent Workflow Reviewer - Code & Test Quality
Remote SWE Agent Workflow Reviewer - Code & Test Quality

AI Trainer Jobs • United States

Remote
USD 152,000 - 207,000
Remote QA/Test Engineer for AI Code Review & Debug
Remote QA/Test Engineer for AI Code Review & Debug

AI Trainer Jobs • United States

Remote
USD 83,000 - 124,000
AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project
AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project

Remote DXB • United States

Remote
USD 55,000 - 96,000
Senior Software Engineer – Open Source & SWE-Bench Evaluation (Fully Remote)
Senior Software Engineer – Open Source & SWE-Bench Evaluation (Fully Remote)

Anyone AI Inc. • United States

Remote
USD 83,000 - 165,000
Remote Fullstack Code Reviewer & QA Grader
Remote Fullstack Code Reviewer & QA Grader

AI Trainer Jobs • United States

Remote
USD 148,000 - 210,000
Remote work
Remote Technical Writer for AI Benchmark Tasks
Remote Technical Writer for AI Benchmark Tasks

YO AI Labs • Town of Texas (WI)

Remote
USD 60,000 - 90,000