Remote Freelance SWE-Bench AI Task Auditor

Jobgether; Denmark; On-site; DKK 620,000 - 886,000; Full time

Benefits offered by this job

Remote work environment

Freelance contract structure

Flexible project-based work

Job summary

Jobgether is seeking a SWE-Bench AI Task Auditor for a freelance AI Trainer Project based in Denmark. The role focuses on auditing software engineering tasks used to train and evaluate AI models, ensuring realism, technical rigor, and reproducibility.

You'll review complex codebases, validate test criteria, identify issues, and provide actionable feedback to improve task quality. This flexible project-based freelance opportunity offers remote work and independence.

Qualifications

• Demonstrated professional experience in software engineering with real-world development experience.
• Ability to evaluate tasks against practical SWE-Bench standards.
• Strong analytical and problem-solving skills for testing complex scenarios.
• Excellent written communication for precise feedback.
• Ability to work independently on freelance assignments.

Responsibilities

• Evaluate software engineering tasks for technical accuracy, realism, solvability, reproducibility, and alignment with SWE-Bench standards.
• Review codebases and real-world scenarios to assess practical engineering challenges.
• Assess reliability and completeness of tests and evaluation criteria.
• Identify integration issues, logic errors, and other inconsistencies.
• Provide actionable feedback to improve task implementation and evaluation workflows.
• Document findings clearly for efficient remediation.

Skills

Software engineering

Codebase navigation

SWE-Bench standards

Analytical skills

Feedback writing

Independent work

Job description

Jobgether is seeking a SWE-Bench AI Task Auditor for a freelance AI Trainer Project based in Denmark. The role focuses on auditing software engineering tasks used to train and evaluate AI models, ensuring realism, technical rigor, and reproducibility.

You'll review complex codebases, validate test criteria, identify issues, and provide actionable feedback to improve task quality. This flexible project-based freelance opportunity offers remote work and independence.