Applied AI Evaluation Engineer: LLM Benchmarks & Pipelines

Mistral; Paris; On-site; EUR 80,000 - 110,000; Full time

Job summary

Mistral is seeking an Evaluation Engineer to shape how enterprise customers measure and trust AI solutions. You will design evaluation systems at the intersection of research, engineering, and product, collaborating with clients and internal stakeholders to move projects from concept to production with clear accountability.

You will work on frameworks for LLM performance and scalable evaluation pipelines, partnering with research and product teams to deliver measurable outcomes for enterprise

Responsibilities

• Shape how enterprise customers measure and trust AI solutions.
• Design evaluation systems at the intersection of research, engineering, and product.
• Collaborate with clients and internal stakeholders to move projects from concept to production with clear accountability.

Job description

Mistral is seeking an Evaluation Engineer to shape how enterprise customers measure and trust AI solutions. You will design evaluation systems at the intersection of research, engineering, and product, collaborating with clients and internal stakeholders to move projects from concept to production with clear accountability.

You will work on frameworks for LLM performance, scalable pipelines, and custom evaluation suites, partnering with research and product teams to deliver measurable