Remote Freelance AI Task Auditor — SWE Benchmark Evaluator

Jobgether; Lavamünd; Vor Ort; EUR 63.000 - 89.000; Vollzeit

Benefits dieser Stelle

Remote freelance

Flexible schedule

Contract-based

Zusammenfassung

Jobgether is seeking an experienced SWE-Bench AI Task Auditor for a freelance project conducted remotely. You will audit tasks used to train AI models, validate logic, and ensure tests are reliable and reproducible, all while working independently on project-based assignments.

Ideal candidates have deep software engineering expertise, strong analytical skills, and the ability to provide precise, actionable feedback in English. Flexible schedule with international collaboration.

Qualifikationen

• Proven experience in software engineering and codebase navigation.
• Ability to evaluate tasks against SWE-Bench standards.
• Excellent written feedback for technical issues.

Aufgaben

• Evaluate tasks for technical accuracy and realism.
• Review codebases and real-world scenarios for practicality.
• Assess tests and evaluation criteria for reliability.
• Identify integration issues and logic errors.
• Provide actionable feedback to improve task quality.
• Document findings clearly for efficient remediation.

Kenntnisse

Analytical thinking

Problem solving

Technical feedback

Independent work

Tools

Code review

Jobbeschreibung

Jobgether is seeking an experienced SWE-Bench AI Task Auditor for a freelance project conducted remotely. You will audit tasks used to train AI models, validate logic, and ensure tests are reliable and reproducible, all while working independently on project-based assignments.

Ideal candidates have deep software engineering expertise, strong analytical skills, and the ability to provide precise, actionable feedback in English. Flexible schedule with international collaboration.