Staff AI Platform Engineer — Evaluation & Tools (Healthcare)

Doctolib

Paris

Presencial

EUR 120 000 - 170 000

Tempo integral

Há 3 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Health insurance
Vacation days (25)
Mental health support
Work from abroad up to 10 days/year
Lunch vouchers
Sport club / creative class subsidy
Public transport refund
DoctoGrowth program
ParentCare program
Disability support

Resumo da oferta

Doctolib SAS is hiring a Staff AI Software Engineer to join the AI Evaluation team (EvalX). You will build evaluation tooling and work across platform engineering, applied AI, and product teams to ensure quality, reliability, and safety of AI systems.

The role combines hands-on development with collaboration to define meaningful metrics and reusable platform capabilities. You will design production-grade tools, guide improvement plans with product teams, and contribute to the evolution of

Qualificações

  • 6+ years of experience as a software engineer or machine learning engineer.
  • Significant experience with Python.
  • Built or operated evaluation for LLM-powered or agentic systems.

Responsabilidades

  • Design, ship, and operate production-grade evaluation tooling (APIs, services, CI/CD integrations).
  • Work with product teams to assess evaluation methods and improve quality.
  • Design evaluation strategies for agentic systems (deterministic checks, LLM as judge, simulations, human review).
  • Build capabilities for production sampling, dataset representativeness monitoring, distribution-shift detection, and test-case generation.
  • Help teams define quality metrics, datasets, and quality gates throughout development.
  • Turn recurring needs into reusable platform capabilities and measure adoption.

Conhecimentos

Python
Machine learning
LLM evaluation
Software engineering
Product collaboration

Ferramentas

APIs
CI/CD

Descrição da oferta de emprego

Doctolib SAS is hiring a Staff AI Software Engineer to join the AI Evaluation team (EvalX). You will build evaluation tooling and work across platform engineering, applied AI, and product teams to ensure quality, reliability, and safety of AI systems.

The role combines hands-on development with collaboration to define meaningful metrics and reusable platform capabilities. You will design production-grade tools, guide improvement plans with product teams, and contribute to the evolution of

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Staff AI Engineer — Evaluation & Quality for AI Products
Staff AI Engineer — Evaluation & Quality for AI Products

Doctolib • Paris

Presencial
EUR 90 000 - 130 000
Health insurance
Paid vacation
Mental health & coaching services
+2
Staff AI Engineer: Build Safe Healthcare AI Eval Tools
Staff AI Engineer: Build Safe Healthcare AI Eval Tools

Doctolib • Levallois-Perret

Presencial
EUR 100 000 - 160 000
Health insurance
Vacation days: 25 days + RTT
Mental health and coaching services
+7
Staff AI Engineer — Agent Evaluation Platform
Staff AI Engineer — Agent Evaluation Platform

Doctolib (France) • Paris, Levallois-Perret

Presencial
EUR 120 000 - 180 000
Health insurance
Vacation days
Lunch vouchers
+2
Staff AI Engineer: Build Production ML Evaluation Tools
Staff AI Engineer: Build Production ML Evaluation Tools

Doctolib • Paris

Presencial
EUR 90 000 - 130 000
Health insurance
Paid vacation 25 days
RTT (reduction of working time)
+7
Senior AI Engineer — Architect of Healthcare AI Assistants
Senior AI Engineer — Architect of Healthcare AI Assistants

Doctolib • Nantes

Presencial
EUR 90 000 - 130 000
Free comprehensive health insurance
ParentCare program
Mental health support
+6
Senior ML Engineer — AI Evaluation & Safe Agentic Systems
Senior ML Engineer — AI Evaluation & Safe Agentic Systems

EngineersOfAI • Paris

Híbrido
EUR 70 000 - 95 000
Free health insurance for you and your children
Parent Care Program
Free mental health services
+2
Senior AI Engineer - Health Search & Recommendations
Senior AI Engineer - Health Search & Recommendations

Doctolib • Levallois-Perret

Presencial
EUR 120 000 - 170 000
Free comprehensive health insurance
Lunch vouchers
Transit subsidy
Staff Applied AI Software Engineer (Python) – AI Evaluation (x/f/m)
Staff Applied AI Software Engineer (Python) – AI Evaluation (x/f/m)

Doctolib • Paris

Presencial
EUR 120 000 - 170 000
Health insurance
Vacation days (25)
Mental health support
+7
Staff AI Engineer - Agent Evaluation Platform (x/f/m)
Staff AI Engineer - Agent Evaluation Platform (x/f/m)

Doctolib • Paris

Presencial
EUR 90 000 - 130 000
Health insurance
Paid vacation
Mental health & coaching services
+2
Senior AI Engineer, Health Platform — Search & Recs
Senior AI Engineer, Health Platform — Search & Recs

Doctolib • Paris

Presencial
EUR 110 000 - 150 000
Health insurance
25 days paid vacation
RTT days
+7