Freelance SWE-Bench AI Task Auditor (Remote)

Jobgether; Portugal; Presencial; EUR 83 000 - 119 000; Tempo integral

Resumo da oferta

Jobgether in Portugal seeks a SWE-Bench AI Task Auditor for a freelance AI trainer project. You will audit tasks used to train and evaluate AI models, ensuring they reflect realistic software engineering scenarios.

You'll review codebases, validate test criteria, and provide clear feedback to improve task quality. This role suits experienced software engineers who prefer project-based, independent work with flexible freelance arrangements.

Qualificações

• Demonstrable professional experience and deep technical expertise in software engineering.
• Ability to evaluate tasks against practical development standards.
• Strong analytical and problem-solving skills for complex scenarios.
• Excellent written communication for precise technical feedback.
• Ability to work independently on project-based freelance assignments.

Responsabilidades

• Evaluate software engineering tasks for technical accuracy and realism.
• Review codebases and real-world scenarios to reflect practical SWE challenges.
• Assess test reliability and evaluation criteria.
• Identify integration issues, logic errors, and test failures.
• Troubleshoot complex scenarios and provide actionable feedback.
• Document findings clearly to aid task remediation.

Conhecimentos

Software engineering

Codebase navigation

Independent work

Analytical thinking

Attention to detail

Technical feedback

Remote work readiness

Descrição da oferta de emprego

Jobgether in Portugal seeks a SWE-Bench AI Task Auditor for a freelance AI trainer project. You will audit tasks used to train and evaluate AI models, ensuring they reflect realistic software engineering scenarios.

You'll review codebases, validate test criteria, and provide clear feedback to improve task quality. This role suits experienced software engineers who prefer project-based, independent work with flexible freelance arrangements.