Contract researcher (M/F): Evaluation of large language models in health

CNRS; France; Sur place; EUR 40 000 - 60 000; Plein temps

Résumé du poste

A prominent research organization in France is seeking a researcher to evaluate large language models in healthcare. The role involves designing evaluation protocols, managing partner activities, and collaborating on NLP systems. Ideal candidates will have a strong background in NLP and machine learning, experience in collaborative projects, and fluency in French and technical English. This position requires travel to partner sites and participation in various meetings.

Qualifications

• Experience of collaborative research projects.
• Mastery of NLP evaluation measures and protocols.
• Mastery of NLP and machine learning methods and tools, including neural learning.

Responsabilités

• Design and implement evaluation protocols for NLP systems.
• Manage evaluation activities of project partners.
• Draft reports, guides, and publications.

Connaissances

NLP methods

Machine learning

Team collaboration

Time management

Fluency in French

Technical English

Formation

Thesis in natural language processing

Description du poste

Organisation/Company CNRS Department Laboratoire Interdisciplinaire des Sciences du Numérique Research Field Engineering Computer science Mathematics Researcher Profile Recognised Researcher (R2) Country France Application Deadline 25 Dec 2025 - 23:59 (UTC) Type of Contract Temporary Job Status Full-time Hours Per Week 35 Offer Starting Date 1 Mar 2026 Is the job funded through the EU Research Framework Programme? Not funded by a EU programme Is the Job related to staff position within a Research Infrastructure? No

Offer Description

As part of the BPI-funded collaborative project PARTAGES, the mission of this position is to design and coordinate the evaluation of large language models in healthcare and the application of these models to seven healthcare use cases. This includes defining the constituent elements of evaluation protocols, defining model comparison dimensions, setting up an evaluation protocol for foundation models, defining evaluation protocols for each use case according to the type of case and its application framework, implementing specific protocols for the evaluation of use cases and foundation models, and monitoring the results of evaluations of algorithms for each use case and foundation model. The latter tasks will involve close interaction with the partners responsible for the development of the language models and the partners responsible for the use cases, the organization of evaluations similar to evaluation campaigns, and the organization of feedback workshops. Methods and results will be documented and published in relevant conferences and journals.

In the context of the PARTAGES project's evaluation of natural language processing (NLP) systems, mainly based on neural methods, which will be applied to the medical field:

• design and implementation of state-of-the-art methods for the evaluation of NLP systems
• managing the evaluation activities of project partners
• planning and running meetings
• participating in meetings
• creation and implementation of evaluation protocols
• analysing evaluation results
• drafting reports, guides and publications

LISN Laboratory
https://www.lisn.upsaclay.fr/
The Interdisciplinary Laboratory for Digital Sciences (LISN) is a Joint Research Unit (UMR 9015) created on January 1, 2021 through the cooperation of the LIMSI and LRI research teams. Its supervisory bodies are CNRS, Université Paris-Saclay, INRIA and CentraleSupélec. With a staff of almost 400, its research areas cover the core themes of digital and engineering sciences, as well as interdisciplinary topics such as artificial intelligence and data science, human-computer interaction, natural language and speech processing, and bioinformatics.

Research activities are organized into 5 departments, 5 cross-disciplinary actions and 16 research teams. 5 research support teams ensure the smooth running of the laboratory. The work will take place within the SEME team of the Language Sciences and Technologies department.

The PARTAGES project
https://www.health-data-hub.fr/actualites/democratiser-lia-generative-e…
The PARTAGES project, led by a consortium of some thirty partners including research laboratories (from CNRS, INRIA and various universities), healthcare facilities and deep-tech companies, is one of the winners of the France 2030 call for projects on generative AI. Coordinated by the Health Data Hub (HDH), this project aims to use generative artificial intelligence to help healthcare professionals save precious medical time.

LISN's SEME team is in charge of the project's Evaluation work package, which will be the main focus of the new recruit's work. The recruit will be working in particular with Pierre Zweigenbaum and Aurélie Névéol. Collaboration will also take place with LISN's ASARD team, in charge of the project's evaluation infrastructure, under the responsibility of Anne-Catherine Letournel.

The position is located at LISN, in Orsay. It will involve travel to partner sites, meetings and conferences.

• Thesis in natural language processing with machine learning
• Mastery of NLP and machine learning methods and tools, including neural learning
• Mastery of NLP evaluation measures and protocols
• Experience of collaborative research projects
• Taste for teamwork
• Easy contact with external teams
• Time management and punctuality in deliverables
• Fluency in French and technical English