Robotics ML/CV Research Scientist, Reality Labs Research

Facebook; Redmond (WA); On-site; USD 147,000 - 208,000; Full time

Job summary

An innovative company is seeking a Research Scientist to push the boundaries of multimodal machine learning and computer vision in robotics. This role involves developing cutting-edge models for dexterous manipulation and hand pose estimation, collaborating with an interdisciplinary team. You'll have access to state-of-the-art technology and resources, allowing you to conduct impactful research that shapes the future of virtual and augmented reality experiences. If you're passionate about robotics and AI, this is a unique opportunity to contribute to groundbreaking advancements in the field.

Benefits

Bonus

Equity

Benefits

Qualifications

• 5+ years in advanced ML techniques and robotics-related research.
• Experience with deep learning frameworks and Python programming.

Responsibilities

• Develop ML and CV models for robotics and dexterous manipulation.
• Design ML pipelines and experimental protocols for data collection.

Skills

Machine Learning

Computer Vision

Robotics

Deep Learning

Python Programming

Data Analysis

Gesture Recognition

Object Detection

Education

Bachelor's degree in Computer Science

Ph.D. in Artificial Intelligence or Robotics

Tools

PyTorch

TensorFlow

Job description

Summary:

At Reality Labs Research (RL-R), our goal is to explore, innovate and design novel interfaces and hardware subsystems for the next generation of virtual, augmented, and mixed reality experiences. We are looking for a Research Scientist with expertise in multimodal ML and CV and experience in robotics applications to join our team within Reality Labs Research. You will work on advancing the state of the art for hand-centric foundation models for dexterous manipulation by leveraging groundbreaking advances in tools for human and robot data collection. You will work with a broad and highly interdisciplinary team of researchers, engineers, and designers, and will have access to cutting edge technology, resources, and testing facilities.

Required Skills:

Robotics ML/CV Research Scientist, Reality Labs Research Responsibilities:

1. Develop machine learning and computer vision models for applications such as robotics, dexterous manipulation, hand pose estimation, object detection, contextual understanding, and gesture recognition.
2. Design and implement ML pipelines and systems that collect and process datasets and enable algorithm experimentation.
3. Develop experimental protocols for human-subjects research and collaborate across an interdisciplinary team to collect multimodal datasets from prototype wearable sensing systems.

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
2. Ph.D. in Artificial Intelligence, Robotics, Computer science, relevant technical field, or equivalent practical experience.
3. 5+ years experience in advanced ML techniques such as representation learning, self-supervised learning, cross-embodiment, multimodal learning, vision-language-action (VLA) models, reinforcement learning, imitation learning, LLMs, and/or robotics policy development.
4. 5+ years experience with deep learning frameworks (e.g., PyTorch, TensorFlow) and programming in Python.
5. 2+ years experience in robotics-related research areas.
6. Experience manipulating and analyzing complex, large scale, high-dimensionality multimodal data from varying sources.

Preferred Qualifications:

1. A track record of research output with work published in top conferences and journals such as Robotics (RSS, ICRA, IROS, CoRL, T-RO, IJRR), Machine Learning (NeurIPS, ICML, ICLR, AAAI, JMLR), and Computer Vision (CVPR, ICCV, ECCV, TPAMI).
2. Experience designing data collection protocols and constructing high quality machine learning datasets.
3. Experience bringing-up and debugging prototype/scientific software-hardware systems (e.g., robotics platforms, multi-camera sensing/tracking solutions, wearable sensing systems).
4. Experience working and communicating cross-functionally to collaborate across disciplines and organizations.

Public Compensation:

$147,000/year to $208,000/year + bonus + equity + benefits.

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].