Une candidature complète en une minute
Un CV et une lettre de motivation personnalisés, prêts à envoyer.
Parailabs is seeking a software engineering specialist to evaluate the quality and reproducibility of benchmark tasks used to train and evaluate frontier AI models. The role involves auditing reference patches, test runners, and Docker isolation, and delivering rubric-based feedback on repository-level tasks and grading integrity.
The ideal candidate has strong Python skills, open-source contributions, and experience auditing test harnesses and reward systems in AI benchmarks.
Parailabs is seeking a software engineering specialist to evaluate the quality and reproducibility of benchmark tasks used to train and evaluate frontier AI models. The role involves auditing reference patches, test runners, and Docker isolation, and delivering rubric-based feedback on repository-level tasks and grading integrity.
The ideal candidate has strong Python skills, open-source contributions, and experience auditing test harnesses and reward systems in AI benchmarks.