Research Engineer, Eval Platform — Scalable AI Evaluation

Mistral; Paris; On-site; EUR 90,000 - 130,000; Full time

Job summary

Mistral in Paris is seeking a Research Engineer for the Eval Platform to build infrastructure that measures model quality, ensuring reproducibility and speed. You will work with researchers to define evaluation metrics and deliver robust tooling.

You will run large-scale evaluations on GPU clusters (Slurm, Kubernetes, Ray), develop user-friendly APIs and dashboards, and help ensure accuracy by catching noisy results.

Qualifications

• Master's degree or PhD in ML/CS/EE required.
• 4+ years of production ML software experience.
• Experience with large-scale evaluations on GPU clusters.

Responsibilities

• Build infrastructure to measure model quality and reproducibility.
• Run large-scale evaluations on GPU clusters using Slurm/Kubernetes/Ray.
• Develop user-friendly APIs and dashboards; filter noise to ensure accuracy.

Skills

GPU-based ML production

Experimentation & evaluation metrics

API & dashboard development

Education

Master's degree or PhD in ML/CS/EE

Tools

Slurm

Kubernetes

Ray

Job description

Mistral in Paris is seeking a Research Engineer for the Eval Platform to build infrastructure that measures model quality, ensuring reproducibility and speed. You'll work with researchers to define evaluation metrics and deliver robust tooling.

You will run large-scale evaluations on GPU clusters (Slurm, Kubernetes, Ray), develop user-friendly APIs and dashboards, and help ensure accuracy by catching noisy results. A Master's or PhD and 4+ years of production ML software experience are required.