Research Scientist Intern, Human Sensing for Wearables, AR and VR (PhD)

Meta; Zürich; On-site; CHF 28,000 - 39,000; Full time

Job summary

Meta Reality Labs in Zürich is seeking exceptional interns to help build the next generation of human-centric interaction technologies for wearables, VR/AR. Join a full-stack team working on machine learning, computer vision, and multimodal models from diverse sensors.

The internship lasts 12 to 24 weeks with various start dates; candidates should be pursuing a PhD in EE/CS or related STEM and have experience in C++, Python, ML frameworks, and cross-functional collaboration.

Qualifications

• PhD in EE/CS or Applied Math or related STEM field.
• Experience with computer vision: tracking, pose estimation, action/emotion recognition.
• Experience with ML frameworks like PyTorch or TensorFlow.
• Proficient in C++ and/or Python.
• Strong communication and problem-solving skills.
• Experience with 3D ML data (meshes, point clouds, voxels).
• Experience with ML for Visual Synthesis and HCI.

Responsibilities

• Assist research teams on tracking, recognition, and generative modeling tasks.
• Collaborate across ML, CV, and graphics teams.
• Support deployment and optimization on mobile SoCs.
• Prepare publications or grants where applicable.

Skills

C++

Python

ML frameworks

Communication

Creativity

Problem solving

3D ML

Visual Synthesis

HCI

Robotics

Education

PhD in EE/CS

Job description

Reality Labs (RL) teams are looking for exceptional interns to help us create the next generation of human-centric interaction technologies for wearables, virtual and augmented reality. Join a full-stack team working on machine learning, generative modeling, multimodal-models from a high diversity of sensor types. We are accepting applications from those interested in (but not limited to) the following areas:

• Tracking of bodies, faces and hands and their interactions through machine learning, computer vision and sensor fusion
• Egocentric human action recognition and emotion recognition
• Generative models for human motion and interactions from diverse sensors and conditioning signals
• Representation modeling (e.g., implicit, appearance, geometry) of hands, bodies and objects for fast simulation and tracking
• Efficient deep learning (e.g., neural architecture search, sparsity, quantized networks)
• Interaction design for hands, bodies and objects in virtual reality and augmented reality
• Sensor fusion (e.g. of pressure, RF, EXG, IMU) with optical tracking for human centric use cases
• Efficient and generalizable detectors for predicting keypoints, segmentations, normals, and depth
• Accurate and efficient 3D representations of deformable shapes such as clothing and hair

Our internships are twelve (12) to twenty four (24) weeks long and we have various start dates throughout the year.

Currently has, or is in the process of obtaining, a PhD degree in EE/CS, Applied Math or a related STEM fieldExperience in one or more of the following: computer vision (e.g. tracking, pose estimation, action/emotion recognition), computer graphics (e.g. appearance, geometry, physically-based modeling), robotics (state estimation, optimal control), machine learning (e.g. efficient deep learning, domain adaptation, transfer learning), natural language processing, or human-computer interactionExcellent communication skillsHigh levels of creativity and problem solving capabilitiesExperience with C++ or PythonExperience with ML frameworks such as PyTorch, Tensorflow, etcMust obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, or first-authored publications at leading journals or conferences such as CVPR, ECCV/ICCV, BMVC, NeurIPS, ICML, ICLR, CHI, SIGGRAPH/SIGGRAPH Asia, ICRA, IROS, RSS, TPAMI, IJCV, etcDemonstrated software engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)Experiences working on high volume multi-sensor streaming data processing and real-time multi-sensor, in particular cameras, fusion for computer vision and machine learning systemsExperiences on optimizing and deploying deep learning models on SoC of mobile devices for high performance real time applicationsExperience with Machine Learning for 3D data (such as meshes, point clouds, gaussian splatting, and voxels)Experience with Machine Learning for Visual SynthesisExperience with Human centric machine learning tasksIntent to return to degree program after the completion of the internship/co-opExperience working and communicating cross functionally in a team environment