AI Research Scientist, SysML

Meta; Sunnyvale (CA); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta Reality Labs seeks a Research Scientist to advance AI models, hardware acceleration, and software systems for AR/VR and edge devices. You will develop novel compute-efficient training and on-device inference, collaborating with silicon and software teams.

You will push state-of-the-art in model compression, multimodal LLMs, and energy-efficient ML, while contributing to patents and publications in peer-reviewed venues.

Qualifications

• Bachelor\'s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD in Electrical Engineering, Computer Science, or equivalent experience.
• Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python.

Responsibilities

• Identify and solve multi-disciplinary ML acceleration problems spanning algorithms, model architecture, software, and hardware for AR, VR, and wearables use cases, often requiring novel approaches not yet established in the industry.
• Invent and develop state-of-the-art model compression, efficiency, and scalability techniques, including numerics, pruning, distillation, speculative decoding, and memory-efficient transformer architectures, and benchmark them across diverse network classes. Integrate proven research into production ML infrastructure for broad adoption across the organization
• Post-train and optimize foundation models to deliver Pareto-optimal multimodal LLMs and GenAI models on our target hardware under real-time latency, power, and memory constraints
• Use models and algorithm insights to co-design next-generation hardware and system architectures, partnering with research scientists and silicon teams, and drive the algorithms and software integration needed to exploit these enhancements, applying in-depth knowledge of how ML acceleration interacts with surrounding systems
• Define use cases, methodology, and benchmarks to evaluate competing approaches, and influence partners to adopt recommended solutions through data-driven analysis and clear communication of trade-offs
• Stay at the forefront of efficient on-device ML research, and contribute to patents and publications in peer-reviewed conferences and journals

Skills

ML acceleration

Model compression

On-device AI

Cross-functional collaboration

Education

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

PhD in Electrical Engineering, Computer Science, or equivalent experience

Tools

PyTorch

TensorFlow

C/C++

Python

Job description

Summary

Reality Labs (RL) focuses on delivering Meta's vision through Virtual Reality (VR), Augmented Reality (AR) and wearable devices. The compute performance and power efficiency requirements of Virtual and Augmented Reality require custom silicon. Reality Labs Silicon team is driving the state of the art forward with breakthrough work in computer vision, machine learning, mixed reality, graphics, displays, sensors, and new ways to map the human body. Our chips will enable wearable devices, where our real and virtual world will mix and merge throughout the day. We believe the only way to achieve our goals is to look at the entire stack, from transistors, through architecture, firmware, and algorithms.Meta is seeking a Research Scientist to join our Research and Development teams. This role involves working on AI models, hardware acceleration, and software systems related topics. The position will involve taking these skills and applying them to solve for some of the most crucial and exciting problems that exist in Reality Labs. The primary objective will be to develop novel solutions that enable compute and power efficient training and on-device inference of vision and language models for use cases in AR, VR, and edge devices. We are hiring in multiple locations.

Required Skills

AI Research Scientist, SysML Responsibilities:

1. Identify and solve multi-disciplinary ML acceleration problems spanning algorithms, model architecture, software, and hardware for AR, VR, and wearables use cases, often requiring novel approaches not yet established in the industry

2. Invent and develop state-of-the-art model compression, efficiency, and scalability techniques, including numerics, pruning, distillation, speculative decoding, and memory-efficient transformer architectures, and benchmark them across diverse network classes. Integrate proven research into production ML infrastructure for broad adoption across the organization

3. Post-train and optimize foundation models to deliver Pareto-optimal multimodal LLMs and GenAI models on our target hardware under real-time latency, power, and memory constraints

4. Use models and algorithm insights to co-design next-generation hardware and system architectures, partnering with research scientists and silicon teams, and drive the algorithms and software integration needed to exploit these enhancements, applying in-depth knowledge of how ML acceleration interacts with surrounding systems

5. Define use cases, methodology, and benchmarks to evaluate competing approaches, and influence partners to adopt recommended solutions through data-driven analysis and clear communication of trade-offs

6. Stay at the forefront of efficient on-device ML research, and contribute to patents and publications in peer-reviewed conferences and journals

Minimum Qualifications

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

2. PhD in Electrical Engineering, Computer Science, or equivalent experience

3. Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python

Preferred Qualifications

1. Experience working and communicating cross-functionally in a team environment

2. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

3. Experience or knowledge of architecting ML hardware accelerators and systems

4. Experience or knowledge of post-training inference of Large scale GenAI/LLM models

5. Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as ICLR, NeurIPS, CVPR, ACL, ICML, MLSys, ISCA, MICRO, DAC, ASPLOS etc

6. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

7. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

8. Experience evaluating alternative system or algorithm designs by analyzing trade-offs in performance, power, and latency to recommend a solution

9. Experience with PyTorch, TensorFlow or similar machine learning toolsets

10. Demonstrated research and engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)

11. Experience or knowledge of on-device algorithm development including hardware-aware ML models and/or optimizing ML compilers for efficient deployment on AI accelerators

Public Compensation

$184,000/year to $257,000/year + bonus + equity + benefits

Industry

Internet

Equal Opportunity

Meta is proud to be an Equal Employment Opportunity and Affi We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].