Freelance SWE-Bench AI Task Auditor (Remote)

Jobgether; Österreich; Vor Ort; EUR 83.000 - 119.000; Vollzeit

Benefits dieser Stelle

Remote work

Freelance contract

Flexible hours

Zusammenfassung

Jobgether partners with a company in Austria to audit SWE tasks for AI training projects. The freelance role focuses on evaluating codebases, validating task logic, and ensuring tests are reliable and reproducible.

You will provide actionable feedback to improve task quality and align with real-world software engineering standards. The role offers remote work in a freelance contract, with compensation per hour and flexibility for project-based assignments.

Qualifikationen

• Demonstrable professional experience in software engineering with real-world codebases.
• Ability to evaluate tasks against practical SWE-Bench requirements.
• Strong analytical and problem-solving skills for complex scenarios.
• Excellent written ability to provide precise technical feedback.
• Independent work on freelance project-based tasks.

Aufgaben

• Evaluate SWE tasks for technical accuracy and realism.
• Review codebases and real-world scenarios for practical alignment.
• Assess tests, criteria, and outcomes for reliability and reproducibility.
• Identify integration issues, logic errors, and test failures.
• Provide clear, actionable feedback to improve task implementation.
• Document findings to facilitate efficient task improvements.

Kenntnisse

Software engineering

Codebase navigation

Analytical skills

Technical feedback

Jobbeschreibung

Jobgether partners with a company in Austria to audit SWE tasks for AI training projects. The freelance role focuses on evaluating codebases, validating task logic, and ensuring tests are reliable and reproducible.

You will provide actionable feedback to improve task quality and align with real-world software engineering standards. The role offers remote work in a freelance contract, with compensation per hour and flexibility for project-based assignments.