Code Data Annotation & Tools QA Specialist

Mistral AI; EE. UU.; A distancia; USD 70.000 - 110.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare coverage

Relocation support

Meal and transportation allowances

Descripción de la vacante

Mistral AI is seeking a Code Data Annotation Quality Specialist to ensure high‑quality code annotations and maintain internal tooling supporting annotators. You will validate annotations against rubrics and help refine guidelines to improve data used for AI training and evaluation.

In this in‑house role, you will collaborate with engineers and program managers, build automation for annotator workflows, and troubleshoot tooling. Strong English communication and Unix proficiency are essential.

Formación

• Degree in computer science, engineering, or a related field, or 2–5 years of professional experience in software engineering, technical support, or tool development.
• Hands‑on experience using code agents in development workflows.
• Proficiency in at least one programming language (Python, JavaScript).
• Ability to apply a rubric and identify edge cases or gaps in guidelines.
• Attention to detail for high‑volume review work.
• Comfort with Unix-like terminals and version control workflows.

Responsabilidades

• Generate and validate high‑quality data annotations based on guidelines and feedback.
• Surface systemic issues and gaps in guidelines to stakeholders.
• Produce annotations to model the expected quality bar.
• Build and maintain internal tools and automation for annotator workflows.
• Troubleshoot environment, tooling, and version control issues for annotators.
• Collaborate to refine guidelines and processes for data production.

Conocimientos

Code data review

Annotation quality

Rubrics

Python

Unix terminal

Version control

Educación

Bachelors in CS or related field

Herramientas

Git

Shell scripting

Dashboards

Descripción del empleo

Mistral AI is seeking a Code Data Annotation Quality Specialist to ensure high‑quality code annotations and maintain internal tooling supporting annotators. You will validate annotations against rubrics and help refine guidelines to improve data used for AI training and evaluation.

In this in‑house role, you will collaborate with engineers and program managers, build automation for annotator workflows, and troubleshoot tooling. Strong English communication and Unix proficiency are essential.