AI Research Scientist - Machine Learning for Behavioral AI

Facebook; Redmond (WA); On-site; USD 147,000 - 208,000; Full time

Job summary

An established industry player is seeking an AI Research Scientist to join their innovative team. This role involves developing cutting-edge AI algorithms that infer human behavior patterns using data from wearable devices. You will collaborate with top researchers and engineers to create robust models that enhance Augmented Reality and Virtual Reality experiences. By leveraging multimodal data and state-of-the-art machine learning techniques, you will contribute to groundbreaking research that has the potential to redefine how we interact with technology. If you are passionate about pushing the boundaries of AI and making a real-world impact, this is the opportunity for you.

Benefits

Bonus

Equity

Benefits

Qualifications

• Experience with multimodal ML and behavioral AI.
• Proven track record in solving complex challenges.
• 3+ years of experience with Python and machine learning frameworks.

Responsibilities

• Develop AI algorithms to infer human behavior patterns.
• Collaborate with diverse teams to build solutions.
• Create tools and infrastructure to accelerate research.

Skills

Machine Learning

Python

Multimodal Signal Processing

Behavioral AI

Data Collection Strategies

Collaboration

Education

Bachelor's degree in Computer Science

PhD in Computer Science or related field

Tools

PyTorch

OpenCV

Unreal Engine

Unity

Job description

Summary:

Meta’s Reality Labs Research (RL-R) brings together a world-class team of researchers, developers, and engineers to create the future of Mixed Reality (MR), Augmented Reality (AR), and Wearable Artificial Intelligence (AI). Within RL-R, the ACE team solves complex challenges in behavioral inference from sparse information. We leverage multimodal, egocentric data and cutting edge machine learning to deliver robust, efficient models that serve everyone. Our research provides core building blocks to unlock intuitive and helpful Wearable AI, empowering everyone to harness the superpowers of this emerging technology in their daily lives. We are looking for an experienced AI Research Scientist to join us in this initiative. In this role, you will work closely with Research Scientists and Engineers from across RL-R to develop novel state-of-the-art AI algorithms to infer human behavior patterns, with an emphasis on those that inform attention, cognition or emotion. Examples include longitudinal gaze behaviors, gestures, or vocal cues. You will develop end-to-end wearable AI experiential validation platforms using cutting edge generative AI and language models to validate the impact of these signals. Further, you will work with system engineers to optimize these models for efficiency and latency in constrained compute platforms. You will learn constantly, dive into new areas with unfamiliar technologies, and embrace the ambiguity of AR, VR, and AI problem solving. Together, we are going to build cutting-edge prototypes, technologies, and toolsets that can define a paradigm shift in how we interact with our surroundings. We invite you to step into the adventure of a lifetime, as we make science fiction real and change the world.

Required Skills:

AI Research Scientist - Machine Learning for Behavioral AI Responsibilities:

1. Using data from wearable devices, employ state-of-the-art AI algorithms to infer human behavior patterns that inform attention, cognition or emotion. Examples include longitudinal gaze behaviors, gestures, or vocal cues.
2. Develop data collection strategies, benchmarks, and metrics to validate and improve efficiency, scalability, and stability of these models.
3. Collaborate with researchers and engineers across diverse disciplines through all stages of project development to identify gaps, build solutions, and transfer technology.
4. Contribute to research that can eventually be applied to Meta products and services and run on billions of media items every day.
5. Create tools, infrastructure, and documentation to accelerate research.
6. Perform code reviews that improve software engineering quality.
7. Learn constantly, dive into new areas with unfamiliar technologies, and embrace the ambiguity of Augmented Reality/Virtual Reality problem solving.

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
2. PhD degree in Computer Science, Human-Computer Interaction, or related field plus 2+ years of experience.
3. Proven track record of solving complex challenges with multimodal ML as demonstrated through grants, fellowships, patents, or publications at conferences like CVPR, NeurIPS, CHI, or equivalent.
4. 3+ years of experience with Python.
5. Experience with a common machine learning framework like PyTorch.
6. Experience with ML computer vision.
7. Experience with multimodal sensing platforms, data collection, multimodal signal processing and analysis, and converting raw sensor streams into robust models solving complex tasks.

Preferred Qualifications:

1. PhD degree in Computer Science or related field plus 3+ years experience.
2. First or lead author publications in computer vision, machine learning or computer graphics peer-reviewed conferences (e.g. CVPR, ECCV, ICCV, CHI, NeurIPS, ICLR, etc.).
3. Experience with biosignals, behavioral signals, or egocentric data from wearable sensors.
4. Experience with Multimodal Deep Learning approaches and research.
5. Experience with Large Language Models.
6. Experience with C++.
7. Experience with non-ML computer vision, especially with OpenCV.
8. Experience with 3D engines such as Unreal or Unity.
9. Experience working in Augmented Reality/Virtual Reality.
10. Experience developing software in a research environment.

Public Compensation:

$147,000/year to $208,000/year + bonus + equity + benefits.

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].