Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Inria Gif-sur-Yvette invites an internship to systematically evaluate LLM-based agents that combine reasoning with specialized medical imaging tools for abdominal CT question answering. The role focuses on accuracy, computational efficiency, tool contributions, and faithfulness of reasoning, in collaboration with APHP.
You will work with PyTorch, distant GPU servers, and multiple foundation models. The internship involves bibliographic study, programming, experiments, and scientific reporting,
In the context of the ANR FM2AI, and in collaboration with APHP, the aim of this internship is to systematically evaluate LLM-based agents that combine reasoning with specialized medical imaging tools for abdominal CT question answering, focusing on their accuracy, computational efficiency, the contribution of individual tools, and the faithfulness of their reasoning.
Scientific context:
Foundation models for CT have multiplied: vision‐language encoders (CT‐CLIP [10], Merlin [8], Jolia [15]), generative models that answer questions about a volume (CT‐CHAT [10], MedGemma 1.5 [11]), large pretrained encoders (Pillar‐0 [12], Curia [13], FlexiCT [14]) and segmentation tools (TotalSegmentator [9]). On their own, they still fail on tasks that require localizing, measuring and then reasoning.
Hence the idea, following ReAct [16], of delegating the reasoning to an LLM that calls these models as tools. Born in chest radiography with MedRAX [7], this paradigm now reaches 3D CT: CT‐Agent [2], 3DMedAgent [5], CT‐Flow [6], INFORM‐CT [3].
The most striking result comes from RadAgent [1]: without any training, an agent orchestrating CT‐CHAT, CT‐CLIP, TotalSeg‐mentator and a general‐purpose 2D VLM (Gemma 3 [19]) outperforms CT‐CHAT on report generation. On DeepTumorVQA [4], a fine‐tuned 2D VLM even beats the best 3D model (66.3% vs. 59.8%), but without measurement tools, all models make up quantitative values.
The problem
: each system comes with its own harness (agent loop, tools, prompts), data and metrics, so it is impossible to tell what actually makes the difference. Abdominal CT, less studied than the chest, is an ideal testbed: DeepTumorVQA pro‐vides questions with verifiable answers on 9,262 public volumes, organized by level (recognition, measurement, reasoning), together with a standardized tool environment.
Research questions: