Remote Python Coding Annotator for AI Benchmarks

aitrainer; Paris; Hybride; EUR 20 000 - 33 000; Temps partiel

Résumé du poste

DataForce by TransPerfect is seeking a Software Engineer with Python knowledge to join as Coding Annotator, supporting AI model evaluation and benchmarking from France on a remote basis.

The role focuses on creating prompts and reference solutions, testing outputs, and contributing to RL workflows with coding environments. Part-time 25 hours per week, starting September 2026, with a remote setup across France.

Qualifications

• Strong proficiency in Python and front-end languages (JavaScript, TypeScript).
• Experience with code review and quality assurance.
• Ability to handle repetitive tasks with attention to detail.
• 3+ years of work experience in related field.
• Excellent written and verbal communication skills in English.

Responsabilités

• Create high-quality coding prompts and reference solutions aligned with industry benchmarks.
• Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
• Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
• Design and maintain coding environments used for evaluation and reinforcement learning pipelines.
• Execute coding-specific validation checks using established criteria and tools.
• Document findings, evaluation results, and insights to support model improvement and training strategies.
• Perform detailed code reviews and annotations for accuracy and compliance.
• Work with Python and front-end technologies (JavaScript, TypeScript); potentially with Java, too.
• Execute repetitive tasks with precision and maintain high standards of quality.
• Collaborate with cross-functional teams to improve code quality and documentation.

Connaissances

Python

JavaScript

TypeScript

Code review

Quality assurance

Attention to detail

English communication

Formation

Bachelor's degree in Computer Science

Software Engineering degree

Outils

Java

Description du poste

DataForce by TransPerfect is seeking a Software Engineer with Python knowledge to join as Coding Annotator, supporting AI model evaluation and benchmarking from France on a remote basis.

The role focuses on creating prompts and reference solutions, testing outputs, and contributing to RL workflows with coding environments. Part-time 25 hours per week, starting September 2026, with a remote setup across France.