XR Input Perception Research Scientist – ML & Vision

Meta Platforms, Inc.; Burlingame (IL); On-site; USD 143,000 - 208,000; Full time

Job summary

Meta Platforms, Inc. Reality Labs seeks a Research Scientist to advance XR input perception through computer vision and machine learning. You will contribute to research, design interactive experiences, and prototype data collection systems, working with cross-disciplinary teams.

The role requires a PhD with publications, 3+ years in ML/CV research, and strong coding in PyTorch/TensorFlow, C/C++, Python. Base salary is $143k–$208k with bonus and equity.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related field; equivalent practical experience.
• PhD in Computer Science or related field with published work in ML, DL or CV.
• 3+ years of industry research experience in ML/CV/DL.
• 3+ years experience with PyTorch or TensorFlow.
• 3+ years experience in C/C++, Python, or similar languages.
• Experience designing data collection protocols and creating high-quality datasets.
• Knowledge across ML, optimization, Bayesian statistics and state estimation.
• Proven ability to extend research ideas to new domains; strong cross-team collaboration.

Responsibilities

• Develop and apply research advancing Meta products with novel VR/AR input tech.
• Design and prototype interactive experiences; evaluate via user research.
• Design data collection systems to accelerate ML efforts.
• Collaborate across hardware, software, data collection, and ML teams.

Skills

PyTorch

TensorFlow

C/C++

Python

C#

Machine learning

Computer vision

Bayesian statistics

State estimation

Data collection

Education

Bachelor's in CS/CE or related field

PhD in CS or related field

Tools

PyTorch

TensorFlow

Job description

At Meta Reality Labs, we’re developing the input technologies that will define the future of the virtual and augmented reality computing platforms. We are looking for a creative, skilled and motivated research scientist to join our machine perception team in advancing the state-of-the-art of human understanding, action recognition and statistical text decoding. You will work with research scientists, software engineers and hardware engineers to design technical solutions in a fast-paced multidisciplinary environment.

Research Scientist - XR Input Perception Responsibilities

• Contribute to and apply research that advances Meta products by developing novel input technologies for VR, MR and AR systems based on computer vision and machine learning.
• Design and prototype interactive experiences and evaluate them through user research.
• Design and prototype data collection systems to accelerate machine learning.
• Collaborate and work across teams to develop concepts that advance the entire product pipeline (hardware, software, data collection, machine learning, etc.).

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD in Computer Science or a related field with published projects in the fields of machine learning, deep learning and/or computer vision.
• 3+ years of industry experience performing cutting edge research and development in these domains.
• Proven development skills with 3+ years of experience working with PyTorch or TensorFlow
• 3+ years experience in developing and debugging in C/C++, Python, C#, or similar programming language.
• Proven experience in designing data collection protocols and quality control, manifested in solid contributions in constructing high quality computer vision and machine learning datasets.
• Technical knowledge across a range of topics including machine learning, optimization, Bayesian statistics and state estimation.
• Experience innovating or extending research ideas for new problem domains or for fitting new constraints.
• Interpersonal experience: cross-group and cross-culture collaboration.

Preferred Qualifications

• Experience transferring technology from research in computer vision, machine perception or machine learning into a shipping product.
• Experience with joint hardware-software development and associated rapid prototyping.
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at AI conferences such as CVPR, ECCV/ICCV, SIGGRAPH, NeurIPS, ICLR, ACL or similar.
• Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub).

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to [e-mail].

$143,000/year to $208,000/year + bonus + equity + benefits

Individual pay is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base salary, Meta offers benefits. Learn more about benefits at Meta.