Research engineer Perspective-Grounded Spatial Reasoning in Multimodal Large Language Models

Inria; Paris; Hybrid; EUR 36,000 - 48,000; Full time

Benefits offered by this job

Partial reimbursement of transport

7 weeks annual leave + RTT

Teleworking possible

Professional equipment

Social and cultural events

Job summary

Inria in Paris invites applications for a Research Engineer position focused on Perspective-Grounded Spatial Reasoning in Multimodal Large Language Models. The role combines analysis, design and implementation to advance 3D-grounded spatial representations.

We seek graduates with a research-oriented background and programming skills; fluency in English and preferably French. The appointment offers an international research environment, generous leave, and opportunities to present at conferences.

Qualifications

• Graduate degree or equivalent required.
• Programming skills are required.
• English and possibly French.

Responsibilities

• Analyse and implement related work.
• Design novel innovative solutions.
• Write progress reports and papers.
• Present work at conferences.

Skills

Programming skills

Education

Graduate degree or equivalent

Job description

Research engineer Perspective-Grounded Spatial Reasoning in Multimodal Large Language Models

Level of qualifications required : Graduate degree or equivalent

Fonction : Temporary scientific engineer

Level of experience : Recently graduated

Assignment

Multimodal large language models (MLLMs) remain notably weak at spatial reasoning from video, particularly at
perspective-taking where the model is asked to answer questions from a viewpoint other than the camera's own (e.g.,
identifying what lies to an observer's left from an allocentric frame). Existing approaches largely rely on either naive data augmentation or opaque latent reasoning tokens whose targets are not grounded in real geometry, both of which have known failure modes. This project aims to build a diagnostic benchmark that isolates genuine perspective-taking failures from confounds (e.g., left-right mirroring, temporal-order artifacts), and to develop a spatial reasoning representation that is explicitly grounded in 3D geometric structure via alignment with a pretrained 3D foundation model, rather than relying on self-consistency alone.

Main activities

• Analyse and implement related work.
• Design novel innovative solutions.
• Write progress reports and papers.
• Present work at conferences.

Skills

Technical skills and level required : programming skills are required.

Languages : English and possibly French.

Benefits package

• Partial reimbursement of public transport costs
• Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
• Possibility of teleworking and flexible organization of working hours
• Professional equipment available (videoconferencing, loan of computer equipment, etc.)
• Social, cultural and sports events and activities
• Theme/Domain :Vision, perception and multimedia interpretation
  Statistics (Big data)(BAP E)

Instruction to apply

Defence Security :
This position is likely to be situated in a restricted area (ZRR), as defined in Decree No. 2011-1425 relating to the protection of national scientific and technical potential (PPST).Authorisation to enter an area is granted by the director of the unit, following a favourable Ministerial decision, as defined in the decree of 3 July 2012 relating to the PPST. An unfavourable Ministerial decision in respect of a position situated in a ZRR would result in the cancellation of the appointment.

Recruitment Policy :
As part of its diversity policy, all Inria positions are accessible to people with disabilities.

Essential qualities in order to fulfil this assignment are feeling at ease in an environment of scientific dynamics and wanting to learn and listen. Prior experience in research is a plus.

About Inria

Inria, the French national institute for research in digital science and technology, supports the French government in national research and innovation strategies in the digital field, acting as Digital Programs Agency. Inria leads over 300 research and innovation projects with its 3,500 scientists, engineers, and support staff, in partnership with universities and the digital ecosystem (businesses, entrepreneurs, and public stakeholders). Together, we explore strategic fields such as artificial intelligence, cybersecurity, quantum computing, cloud technologies, digital transformation in healthcare, digital twins, and digital technologies for defence. We develop practical solutions such as software, tech startups, partnerships with national companies, and cutting-edge training programmes. Our goal is to drive scientific, technological, and industrial excellence to ensure France’s digital sovereignty.