3D Pedestrian Visualisation and Behaviour Modelling in Road-Crossing Scenarios

Université Gustave Eiffel; Gif-sur-Yvette; Sur place; EUR 40 000 - 60 000; Plein temps

Résumé du poste

A leading research university in France is seeking a motivated M2 student for an internship in pedestrian behavior modeling within virtual reality environments. The project aims to develop a 3D behavior modeling pipeline and explore socially aware pedestrian interactions. Ideal candidates should have strong programming skills in Python, with knowledge in Unity or Unreal Engine as a plus. This internship offers a unique opportunity to contribute to advancements in automated driving systems and road safety research.

Qualifications

• Strong interest in graphics related to virtual reality.
• Motivated to explore human behavior modeling.
• Data-driven approach is essential.

Responsabilités

• Develop a 3D skeleton-based pedestrian behavior modeling pipeline.
• Extract behavior data from annotated datasets.
• Reconstruct 3D human skeletal motion from 2D data.
• Control kinematic movements of a 3D pedestrian avatar.

Connaissances

Programming experience in Python

Familiarity with Unity or Unreal Engine

Data processing and machine learning skills

Knowledge of 3D geometry and kinematics

Formation

Master’s level (M2) student

Description du poste

Description

As cities move toward increasingly smart and sustainable, particularly with integration of autonomous vehicles (AVs), ensuring the safety of vulnerable road users such as pedestrians has become a critical priority. While existing research on pedestrian simulation in virtual reality (VR) has largely focused on trajectory-based behaviour models (typically relying on position and velocity information), less attention has been given to pedestrians’ non-verbal behaviours. These include eye contact, intent-expressive gestures, and subtle postural cues when interacting with vehicles in road-crossing situations. The credibility of VR-based simulation is crucial, as the way pedestrians are modelled to express behaviour and intent directly shapes how drivers perceive and respond to different traffic situations. Enhancing the perceptual realism of virtual pedestrians—particularly in terms of their kinematic motion and intent expression—is therefore expected to lead to more natural and accurate human responses in simulated environments, closer to real-world interactions.

The objective of this internship is to develop a 3D skeleton-based pedestrian behaviour modelling pipeline that explicitly incorporates road-crossing intentions through kinematic representations of non-verbal cues. The project will focus on three main objectives:

• Extraction of pedestrian behaviour data associated with diverse road-crossing intentions (e.g., crossing, waiting, looking, gesturing) from existing annotated datasets such as JAAD and PIE.
• Reconstruction of temporally consistent 3D human skeletal motion from 2D visual data using state-of-the-art pose estimation and pose lifting techniques.
• Automatic reproduction and control of kinematic movements—including head rotation, hand gestures, and posture adjustments—by driving a 3D pedestrian avatar through scripted animation commands in a VR environment.

The outcome of this internship will provide a foundational framework for more socially aware and expressive pedestrian agents in VR-based driving simulations. The developed pipeline and insights will serve as a key stepping stone toward a subsequent PhD project focusing on socially interactive agent modelling and immersive simulation of pedestrian–vehicle interactions, with direct applications in road safety research and human-centred evaluation of automated driving systems.

Reference

Rasouli, A., Kotseruba, I. and Tsotsos, J.K., . Are they going to cross? a benchmark dataset and baseline for pedestrian crosswalk behavior. In Proceedings of the IEEE international conference on computer vision workshops (pp. -).

Rasouli, A., Kotseruba, I., Kunic, T. and Tsotsos, J.K., . Pie: A large-scale dataset and models for pedestrian intention estimation and trajectory prediction. In Proceedings of the IEEE/CVF international conference on computer vision (pp. -).

Rock, T., Himmels, C., Peintner, J., Manger, C., & Cao, H. Realistic pedestrian models integrating motion-captured gestures of real humans. In 8th Symposium Driving Simulation (pp. 11-16). Automotive Solution Center for Simulation.

Jan, Q.H., Badella, Y.S. and Berns, K., . Detailed Analysis of Pedestrian Activity Recognition in Pedestrian Zones Using 3D Skeleton Joints Using LSTM. SN Computer Science, 5, p..

Camara, F., Bellotto, N., Cosar, S., Weber, F., Nathanael, D., Althoff, M., Wu, J., Ruenz, J., Dietrich, A., Markkula, G., Schieben, A., Tango, F., Merat, N., & Fox, C. Pedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behavior. IEEE Transactions on Intelligent Transportation Systems, 22, –.

Myers C, Zane T, Van Houten R, Francisco VT. The effects of pedestrian gestures on driver yielding at crosswalks: A systematic replication. J Appl Behav Anal. Mar; 55:-. doi: 10./jaba.

Profile

We are looking for a motivated M2 (Master’s level) student with a strong interest in graphics, virtual reality, human behaviour modelling, and data-driven approaches. The ideal candidate should demonstrate:

Programming experience in Python, with additional familiarity in Unity or Unreal Engine being a strong advantage; Basic skills of data processing and machine learning; Basic knowledge of 3D geometry and kinematics.

Starting date

Dès que possible

Créer une alerte emploi pour cette recherche