Coder with Python knowledge - Paris

TransPerfect; Paris; Hybride; EUR 25 000 - 42 000; Temps partiel

Résumé du poste

DataForce by TransPerfect in Paris, France is seeking Software Engineers to join as Coding Annotators to support AI model evaluation. You will create high-quality coding prompts and reference solutions, benchmark model performance, and identify failure cases across internal and competitor models.

The annotator will also support reinforcement learning workflows by building coding environments, validating code, and surfacing performance insights for model improvement.

Qualifications

• Strong programming in Python; experience with front-end languages is a plus.
• Experience in code review and QA processes.
• Ability to perform repetitive tasks with precision and attention to detail.

Responsabilités

• Create high-quality coding prompts and reference solutions aligned with benchmarks (SWE-Bench, Terminal-Bench).
• Develop prompts for code refactoring, generation, and problem solving.
• Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning and execution.
• Design and maintain coding environments for evaluation and RL pipelines.
• Execute coding-specific validation checks using established criteria and tools.
• Document findings and insights to support model improvement and training strategies.
• Perform detailed code reviews and annotations for accuracy and compliance.
• Collaborate with cross-functional teams to improve code quality and documentation.

Connaissances

Python

JavaScript

TypeScript

Formation

Bachelor's degree in Computer Science / Software Engineering / Computer Engineering

Outils

Java

Description du poste

Work Location:

Paris, France (onsite)

Engagement Model:

Part-time employment

Weekly Workload:

24 hours per week (can be up to 35 hours based on the project needs)

Estimated Start:

September 2026

DataForce is seeking Software Engineers skilled in Python to join our team as Coding Annotators to support the development and evaluation of advanced AI models. This role focuses on creating high-quality coding prompts and answers, benchmarking model performance, and identifying failure cases across internal and competitor models. Candidates will contribute to building realistic evaluation environments and supporting reinforcement learning workflows.

Role Summary:

The Coding Annotator will be responsible for creating programming prompts and reference solutions aligned with industry benchmarks, such as SWE-Bench and Terminal-Bench. The role involves testing model outputs to identify failures.

The annotator will also support reinforcement learning workflows by building and maintaining coding environments and executing coding-specific validation checks. This role focuses on domain-specific evaluation, benchmarking, and technical analysis to surface model limitations and performance insights.

Key Responsibilities:

• Create high-quality coding prompts and reference solutions aligned with industry benchmarks such as SWE-Bench and Terminal-Bench.
• Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
• Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
• Design and maintain coding environments used for evaluation and reinforcement learning (RL) pipelines.
• Execute coding-specific validation checks using established criteria and tools provided by other annotation teams.
• Document findings, evaluation results, and insights to support model improvement and training strategies.
• Perform detailed code reviews and annotations for accuracy and compliance.
• Work with Python and front-end technologies (JavaScript, TypeScript); potentially with Java, too.
• Execute repetitive tasks with precision and maintain high standards of quality.Collaborate with cross-functional teams to improve code quality and documentation.

Job Requirements:

• Strong proficiency in Python and front-end languages (JavaScript, TypeScript).
• Experience with Java is a plus.
• Demonstrated experience in code review and quality assurance.
• Ability to handle repetitive tasks with attention to detail.
• 3+ years of work experience in related field.
• Excellent written and verbal communication skills in English.

Education

• Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a closely related technical field is required.

DataForce by TransPerfect is part of the TransPerfect family of companies, the world's largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide.

We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching and processing data for Machine Learning in different AI domains.

To learn more about DataForce please visit us at https://www.transperfect.com/dataforce