Senior ML Engineer – AI Orchestration & LLMs

Orchestra; Paris; Hybride; EUR 110 000 - 150 000; Plein temps

Avantages offerts par ce poste

Health insurance

Flexible remote days

Lunch vouchers

Relocation support

Transport refund

Employee stock option plan

Résumé du poste

Doctolib is seeking a Senior Machine Learning Engineer to join the AI Health Assistant team. You will design and own evaluation strategies for agentic AI systems, building robust pipelines to ensure safety, reliability, and helpfulness for patients and care teams.

The role focuses on defining metrics, running experiments, and collaborating with researchers to improve model quality, with hybrid work in Levallois‑Perret and strong emphasis on ethical AI in healthcare.

Qualifications

• Hold an MSc or PhD in Computer Science, Machine Learning, Data Science, or a related field.
• 7+ years of hands‑on experience with large language models (GPT, Claude, Llama, BERT‑like).
• Experience evaluating agentic or reasoning systems (autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants).
• Strong track record in experiment design, metric definition, and evaluation automation.
• Bridge research and production, influencing modeling and product decisions.
• Excellent communication, collaboration, and English fluency.

Responsabilités

• Define and own the evaluation strategy for our AI agentic system — metrics, protocols, datasets, and tooling.
• Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations.
• Run systematic experiments to assess reasoning, factuality, robustness, and user experience.
• Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement.
• Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices.

Connaissances

Large language models

Experiment design

Evaluation automation

Cross-functional collaboration

English fluency

Formation

MSc or PhD in CS/ML/DS

Outils

Rails

TypeScript

Java

Python

Kotlin

Swift

React Native

Description du poste

Doctolib is seeking a Senior Machine Learning Engineer to join the AI Health Assistant team. You will design and own evaluation strategies for agentic AI systems, building robust pipelines to ensure safety, reliability, and helpfulness for patients and care teams.

The role focuses on defining metrics, running experiments, and collaborating with researchers to improve model quality, with hybrid work in Levallois‑Perret and strong emphasis on ethical AI in healthcare.