Research Engineer for Statistical 3D Model of Quadrupeds (f/m/div)

Max Planck Institute for Intelligent Systems; Tübingen; Vor Ort; EUR 55.000 - 90.000; Vollzeit

Zusammenfassung

The Optics and Sensing Laboratory at the Max Planck Institute for Intelligent Systems in Tübingen invites applications for a Research Engineer to advance statistical 3D models of quadrupeds. You will contribute to building marker-less motion capture of horses, leveraging 3D data, ML, and computer vision in a collaborative, multidisciplinary setting.

Ideal candidates will have a Master’s degree and strong background in 3D parametric models, CV/DL, and software development (Python/C++, PyTorch).

Qualifikationen

• Master's degree required.
• Experience with 3D parametric body models (SMPL/MANO/ATLAS/VAREN, etc.).
• Experience in Computational Geometry, Computer Vision and Deep Learning.
• Proficiency in Python or C++, with PyTorch or similar.

Aufgaben

• Investigate, implement and evaluate model improvements (skeleton/joint paradigms, shape space encoding, pose-dependent deformations).
• Develop evaluation procedures with quantitative and qualitative metrics.
• Develop MVP pipelines, including image/video mesh recovery models and use-case applications (e.g. body conformation scoring).
• Enhance re-training and continuous learning pipelines.
• Improve robust methods for registering 3D parametric templates to cleaned scans.
• Manage project steps and directions.

Kenntnisse

3D parametric body models

Computational geometry

Computer vision

Deep learning

Python

PyTorch

OpenCV

3D rendering pipelines

Project management

English communication

Ausbildung

Master's degree

Tools

PyTorch

OpenCV

Python

3D rendering pipelines

Point-cloud libraries

Jobbeschreibung

The Optics and Sensing Laboratory at the Max Planck Institute for Intelligent Systems in Tübingen has an open position for a Research Engineer for Statistical 3D Model of Quadrupeds (f/m/div) to join the ongoing research efforts in the development of statistical 3D models of Quadrupeds.

We are creating the world’s most realistic human and animal avatars for use in research, film, virtual reality, biology and medicine. Using unique 3D & 4D capture facilities, machine learning, computer vision and advanced graphics, we are modeling every nuance of how humans and animals look and move. We develop algorithms to estimate human shape and motion in images, videos, RGB-D sequences, etc. Our approaches define the current state of the art, and we are constantly pushing these methods and systems in order to achieve a better accuracy and greater usability.

Department website: https://is.mpg.de/oslab/

The Project

Horses are one of the most beloved animals. They are beautiful in shape and motion, they have been used for carrying people, goods, for helping in farming, for racing, and also for therapy. We are interested in capturing horse motion from motion capture data, with the goal of building marker-less motion capture systems for horses. We are collaborating with the Swedish University of Agricultural Sciences and IMATI-CNR in developing a system for the markerless motion capture of horses. Our approach is based on creating a highly realistic 3D articulated model of horses from data. To this goal, we need to capture partial 3D scans of real animals and register them to a predefined horse template. Doing this enables us to model the shape of real horses and the shape variability across a range of individuals with different characteristics. In this research context, we are looking for talented research engineer to pursue the project.

Figure: a) Data capture setup, b) 3D Scan of horse, c) Model fit of scanned horse

Roles & Responsibilities

• Investigation, implementation and evaluation of potential model improvements, for example: skeleton/joint paradigms, shape space encoding variations, pose dependent deformations, etc.
• Conceptualization and development of model evaluation procedures, including quantitative and qualitative metrics.
• Development of various Minimum-Viable-Product pipelines, including image/video mesh recovery models and use-case applications (e.g. body conformation scoring from model outputs).
• Enhancement of the process for re-training and establishing a continuous learning pipeline.
• Improvement of established robust method for registering 3D parametric model templates to cleaned 3D scans.
• Project management: definition and evaluation of projects steps and directions.

Education & Experience

• Experience with 3D parametric body models (i.e. SMPL/MANO/ATLAS/VAREN/etc.)
• Experience in Computational Geometry, Computer Vision and Deep Learning
• Accepted publications in one of these fields is a big advantage
• Good programming skills in Python or C++; PyTorch (or similar) experience
• Project management experience and the ability to work independently in dynamic environments
• Experience in one or more of the following: Point-cloud libraries, OpenCV, 3D rendering pipelines and deep-learning frameworks
• Good oral and written communication skills in Englis
• Enjoyment for collaborative work and multidisciplinary projects
• A minimum of a Master’s degree is required
• Experience writing production level code is a plus

Our offer

In this working environment, you will be exposed to cutting-edge technologies related to computer vision and multi-sensor systems. The MPI for Intelligent Systems is one of the world’s leading research institutions for machine learning, computer vision and robotics, and studying the concepts of intelligence and autonomous behavior in artificial systems at different length scales. The position is ideally suited for candidates looking to extend their scientific and cultural horizons particularly in the area of 3D Motion Capture. You will be a part of a dynamic team of international scientists, engineers, and administrative staff.

The Max Planck Society is committed to increasing the number of individuals with disabilities in its workforce and therefore encourages applications from such qualified individuals. The Max Planck Society strives for gender equality and diversity. Furthermore, the Max Planck Society seeks to increase the number of women in its workforce in those areas where they are underrepresented and therefore explicitly encourages women to apply.

The position is available as of now and will be open until filled or no longer needed.

Closing date for applications

The posting is open until filled or no longer needed.