[Data - FR] Senior Machine Learning Engineer - Orchestration

Doctolib; Paris; Hybrid; EUR 80,000 - 100,000; Full time

Benefits offered by this job

Free health insurance for you and your children

Parent Care Program with additional leave

Free mental health services

Work from EU countries and the UK for up to 10 days per year

Lunch voucher with Swile card

Job summary

Doctolib in Paris is seeking a Senior/Staff Machine Learning Engineer to enhance AI in healthcare. Your role will involve defining evaluation strategies and ensuring robust model performance.

The ideal candidate has extensive experience with large language models and a track record in automated evaluation. The position comes with benefits like free health insurance and a flexible work-from-home policy.

Qualifications

• 7+ years of hands-on experience with large language models.
• Proven experience in evaluating reasoning systems.
• Ability to bridge research and production.

Responsibilities

• Define and own the evaluation strategy for the AI agentic system.
• Implement and maintain automated evaluation pipelines.
• Collaborate with model developers and research scientists.

Skills

Experience with large language models

Strong experiment design skills

Excellent communication skills

Collaborative mindset

Education

MSc or PhD in Computer Science, Machine Learning, Data Science, or related field

Job description

Overview

At Doctolib, we are on a mission to transform how healthcare is delivered by harnessing the power of AI. As a Senior/Staff Machine Learning Engineer you will play a key role in designing, implementing, and scaling the evaluation framework that ensures our AI Health Companion behaves safely, reliably, and helpfully for millions of patients and practitioners.

Responsibilities

• Define and own the evaluation strategy for our AI agentic system - metrics, protocols, datasets, and tooling
• Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
• Run systematic experiments to assess reasoning, factuality, robustness, and user experience
• Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
• Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices

Environment

Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to the country and healthcare specialty requirements. To address these challenges, we are modularizing our platform run in a distributed architecture through reusable components. Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.

Qualifications

• MSc or PhD in Computer Science, Machine Learning, Data Science, or related field
• 7+ years of hands‑on experience working with large language models (e.g., GPT, Claude, Llama, or BERT‑like architectures)
• Proven experience in evaluating agentic or reasoning systems (e.g., autonomous agents, tool‑using LLMs, dialogue systems, or task‑oriented assistants)
• Strong track record in experiment design, metric definition, and evaluation automation
• Ability to bridge research and production, influencing modeling and product decisions
• Excellent communication skills and a collaborative mindset

Nice to Have

• Experience in the clinical or medical domain and sensitivity to ethical or regulatory challenges in healthcare AI

Benefits

• Free health insurance for you and your children
• Parent Care Program: receive one additional month of leave on top of the legal parental leave
• Free mental health and coaching services through Moka.care
• For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
• Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
• Work Council subsidy to refund part of sport club membership or creative class
• Up to 14 days of RTT
• Lunch voucher with Swile card

Equal Opportunity Statement

At Doctolib, we are committed to improving access to healthcare for everyone. This translates into our recruitment process. We evaluate candidates based solely on qualifications and motivation, without any form of discrimination. The more diverse ideas are heard, the more our product will truly improve healthcare for all.

You are welcome to apply regardless of gender, religion, age, sexual orientation, ethnicity, and disability. To ensure equal opportunities, we invite you to exclude personal information (e.g., pictures, age) from your applications. If you require any accommodation, please let us know for support during the hiring process.

All information provided is processed by Doctolib for application management. For data processing details, please contact [e-mail] for inquiries or to exercise your rights.