AI Research Scientist: On-Device ML & Hardware Acceleration

Meta; Sunnyvale (CA); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta Reality Labs seeks a Research Scientist to advance AI models, hardware acceleration, and software systems for AR/VR and edge devices. You will develop novel compute-efficient training and on-device inference, collaborating with silicon and software teams.

You will push state-of-the-art in model compression, multimodal LLMs, and energy-efficient ML, while contributing to patents and publications in peer-reviewed venues.

Qualifications

• Bachelor\'s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD in Electrical Engineering, Computer Science, or equivalent experience.
• Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python.

Responsibilities

• Identify and solve multi-disciplinary ML acceleration problems spanning algorithms, model architecture, software, and hardware for AR, VR, and wearables use cases, often requiring novel approaches not yet established in the industry.
• Invent and develop state-of-the-art model compression, efficiency, and scalability techniques, including numerics, pruning, distillation, speculative decoding, and memory-efficient transformer architectures, and benchmark them across diverse network classes. Integrate proven research into production ML infrastructure for broad adoption across the organization
• Post-train and optimize foundation models to deliver Pareto-optimal multimodal LLMs and GenAI models on our target hardware under real-time latency, power, and memory constraints
• Use models and algorithm insights to co-design next-generation hardware and system architectures, partnering with research scientists and silicon teams, and drive the algorithms and software integration needed to exploit these enhancements, applying in-depth knowledge of how ML acceleration interacts with surrounding systems
• Define use cases, methodology, and benchmarks to evaluate competing approaches, and influence partners to adopt recommended solutions through data-driven analysis and clear communication of trade-offs
• Stay at the forefront of efficient on-device ML research, and contribute to patents and publications in peer-reviewed conferences and journals

Skills

ML acceleration

Model compression

On-device AI

Cross-functional collaboration

Education

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

PhD in Electrical Engineering, Computer Science, or equivalent experience

Tools

PyTorch

TensorFlow

C/C++

Python

Job description

Meta Reality Labs seeks a Research Scientist to advance AI models, hardware acceleration, and software systems for AR/VR and edge devices. You will develop novel compute-efficient training and on-device inference, collaborating with silicon and software teams.

You will push state-of-the-art in model compression, multimodal LLMs, and energy-efficient ML, while contributing to patents and publications in peer-reviewed venues.