Remote Freelance AI Task Auditor & SWE Trainer

Lever, Inc.; France; À distance; EUR 62 000 - 84 000; Plein temps

Avantages offerts par ce poste

Fully remote freelance contract

Flexible project-based work

Contribute to AI training/evaluation

Competitive hourly rate

Résumé du poste

Lever, Inc. is seeking a SWE-Bench AI Task Auditor for a freelance AI trainer project based in France. You will review software engineering tasks used to train and evaluate AI models, ensuring technical accuracy, realism, reproducibility, and thorough testing.

The role emphasizes independent work and delivering actionable feedback to improve AI training workflows. The position offers a fully remote, project-based contract with compensation at $60/hour, determined by experience and location.

Qualifications

• Proven software engineering experience with real-world applications.
• Ability to navigate complex codebases and evaluate tasks.
• Strong analytical and problem-solving abilities for technical scenarios.

Responsabilités

• Evaluate SWE-Bench tasks for technical accuracy, realism, solvability, reproducibility, and alignment with SWE-Bench standards.
• Review task codebases, integrations, tests, and evaluation criteria to identify weaknesses.
• Rigorously test and troubleshoot complex scenarios to ensure tasks function as intended.
• Investigate codebase integration problems, test failures, logic errors, and other implementation issues.
• Provide clear, precise, actionable feedback to task creators for corrections.
• Apply professional engineering judgment to assess realism of development scenarios.
• Maintain high technical rigor across AI training and evaluation workflows.

Connaissances

Software engineering

Codebase troubleshooting

Analytical thinking

Remote work

Description du poste

Lever, Inc. is seeking a SWE-Bench AI Task Auditor for a freelance AI trainer project based in France. You will review software engineering tasks used to train and evaluate AI models, ensuring technical accuracy, realism, reproducibility, and thorough testing.

The role emphasizes independent work and delivering actionable feedback to improve AI training workflows. The position offers a fully remote, project-based contract with compensation at $60/hour, determined by experience and location.