Python Coding Annotator for AI Evaluation (Paris, Part-time)

TransPerfect; Paris; Sur place; EUR 25 000 - 39 000; Temps partiel

Résumé du poste

DataForce by TransPerfect in Paris, France, is seeking Software Engineers for Coding Annotator roles to support AI model evaluation. You will craft coding prompts and reference solutions, benchmark model outputs, and contribute to RL workflows, with a focus on code quality and validation.

The role requires 3+ years of experience, strong Python and frontend skills (JS/TS), and excellent English communication. Part-time, onsite engagement with flexible hours based on project needs.

Qualifications

• 3+ years of work experience in related field.
• Excellent written and verbal communication skills in English.

Responsabilités

• Create high-quality coding prompts and reference solutions aligned with industry benchmarks.
• Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
• Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
• Design and maintain coding environments used for evaluation and reinforcement learning (RL) pipelines.
• Execute coding-specific validation checks using established criteria and tools provided by other annotation teams.
• Document findings, evaluation results, and insights to support model improvement and training strategies.
• Perform detailed code reviews and annotations for accuracy and compliance.
• Work with Python and front-end technologies (JavaScript, TypeScript); potentially with Java, too.
• Execute repetitive tasks with precision and maintain high standards of quality.
• Collaborate with cross-functional teams to improve code quality and documentation.

Connaissances

Python

JavaScript/TypeScript

Code review

Attention to detail

English proficiency

Java

Formation

Bachelor's degree in CS/Software Eng

Outils

Java

Description du poste

DataForce by TransPerfect in Paris, France, is seeking Software Engineers for Coding Annotator roles to support AI model evaluation. You will craft coding prompts and reference solutions, benchmark model outputs, and contribute to RL workflows, with a focus on code quality and validation.

The role requires 3+ years of experience, strong Python and frontend skills (JS/TS), and excellent English communication. Part-time, onsite engagement with flexible hours based on project needs.