Python Prompt Engineer: Code Quality & Evaluation

Jobtailor; Paris; Sur place; EUR 50 000 - 70 000; Plein temps

Résumé du poste

Jobtailor in Paris is seeking a skilled software QA and prompt engineer to craft high-quality coding prompts and reference solutions aligned with industry benchmarks. You will evaluate model outputs, design evaluation environments, and help improve reinforcement learning pipelines.

Ideal candidates have 3+ years of experience, strong Python and front-end skills (JavaScript/TypeScript), and a degree in Computer Science or a related field. English communication must be strong.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a closely related technical field is required.
• Excellent written and verbal communication skills in English.
• 3+ years of work experience in related field.
• Experience with Python and front-end languages (JavaScript, TypeScript).
• Demonstrated experience in code review and quality assurance.
• Experience with Java is a plus.

Responsabilités

• Create high-quality coding prompts and reference solutions aligned with industry benchmarks such as SWE-Bench and Terminal-Bench.
• Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
• Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
• Design and maintain coding environments used for evaluation and reinforcement learning pipelines.
• Execute coding-specific validation checks using established criteria and tools.
• Document findings, evaluation results, and insights to support model improvement and training strategies.
• Perform detailed code reviews and annotations for accuracy and compliance.
• Work with Python and front‑end technologies (JavaScript, TypeScript), potentially with Java.

Connaissances

Python

JavaScript

TypeScript

Code Review

Quality Assurance

Reinforcement Learning

Code Generation

Formation

Bachelor's degree in Computer Science or related field

Outils

Java

Description du poste

Jobtailor in Paris is seeking a skilled software QA and prompt engineer to craft high-quality coding prompts and reference solutions aligned with industry benchmarks. You will evaluate model outputs, design evaluation environments, and help improve reinforcement learning pipelines.

Ideal candidates have 3+ years of experience, strong Python and front-end skills (JavaScript/TypeScript), and a degree in Computer Science or a related field. English communication must be strong.