Research engineer Perspective-Grounded Spatial Reasoning in Multimodal Large Language Models

Inria; Paris; Híbrido; EUR 42.000 - 54.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Subsidized meals

Partial transport reimbursement

Leave: 7 weeks + RTT + exceptionalle"

Teleworking possible

Professional equipment available

Social, cultural and sports events

Vocational training

Social security coverage

Descripción de la vacante

Inria à Paris recherche un spécialiste pour résoudre des défis de raisonnement spatial dans des modèles linguistiques multimodaux, en s’appuyant sur une représentation 3D et une fondation 3D pré-entraînée.

Vous analyserez les travaux existants, concevrez des solutions innovantes, rédigerez des rapports et présenterez vos résultats en conférences. Des possibilités de télétravail et des mesures de soutien sont prévues.

Formación

• Compétences techniques requises : programmation.
• Langues : anglais et éventuellement le français.
• Aptitudes relationnelles : bons échanges et communication.

Responsabilidades

• Analyser et mettre en œuvre les travaux connexes.
• concevoir des solutions innovantes.
• Rédiger des rapports de progression et des articles.
• Présenter les travaux lors de conférences.

Conocimientos

Programming skills

English

French

Descripción del empleo

Mission confiée

Multimodal large language models (MLLMs) remain notably weak at spatial reasoning from video, particularly at perspective-taking where the model is asked to answer questions from a viewpoint other than the camera's own (e.g., identifying what lies to an observer's left from an allocentric frame). Existing approaches largely rely on either naive data augmentation or opaque latent reasoning tokens whose targets are not grounded in real geometry, both of which have known failure modes. This project aims to build a diagnostic benchmark that isolates genuine perspective-taking failures from confounds (e.g., left-right mirroring, temporal-order artifacts), and to develop a spatial reasoning representation that is explicitly grounded in 3D geometric structure via alignment with a pretrained 3D foundation model, rather than relying on self-consistency alone.

Principales activités

Main activities:

• Analyse and implement related work.
• Design novel innovative solutions.
• Write progress reports and papers.
• Present work at conferences.

Compétences

Technical skills and level required : programming skills are required.

Languages : English and possibly French.

Relational skills : Good communication skills.

Avantages

• Subsidized meals
• Partial reimbursement of public transport costs
• Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
• Possibility of teleworking and flexible organization of working hours
• Professional equipment available (videoconferencing, loan of computer equipment, etc.)
• Social, cultural and sports events and activities
• Access to vocational training
• Social security coverage