Software Engineer, AI Co-design

Meta; Sunnyvale (CA); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta’s Reality Labs seeks a Software Engineer to advance AI co-design and ML acceleration for AR/VR hardware. You will co-design algorithms, hardware and software stacks to enable training and on-device inference for vision and language models, across edge devices.

The role emphasizes collaboration with researchers, system-level optimization, and contributing to patents and publications in leading venues while aligning with Meta’s AR/VR roadmap.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience.
• PhD in Electrical Engineering, Computer Science, or equivalent experience.
• Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python.

Responsibilities

• Identify and solve multi-discipline ML acceleration problems involving algorithms, network design, hardware architecture and AR/VR use cases.
• Work across hardware and software to solve co-design problems with researchers.
• Codesign and invent novel ML accelerator and system architecture solutions.
• Develop state-of-the-art model compression and scalability techniques using Numerics, pruning, distillation, etc.
• Optimize models on hardware accelerators to meet latency and power constraints.
• Influence partners to adopt solutions through data-driven trade-off analysis.
• Define use cases and develop evaluation benchmarks for approaches.
• Apply ML acceleration knowledge to other system components.
• Attend conferences and stay updated with ML acceleration advancements.
• Contribute to patents and publications.

Skills

AI systems infra

C/C++

Python

ML acceleration

Education

Bachelor's degree in Computer Science/Engineering

PhD in Electrical Engineering or Computer Science

Tools

PyTorch

TensorFlow

C/C++

Python

Job description

Summary:

Reality Labs (RL) focuses on delivering Meta's vision through Virtual Reality (VR) and Augmented Reality (AR). The compute performance and power efficiency requirements of Virtual and Augmented Reality require custom silicon. Reality Labs Silicon team is driving the state-of-the-art forward with breakthrough work in computer vision, machine learning, mixed reality, graphics, displays, sensors, and new ways to map the human body. Our chips will enable AR & VR devices where our real and virtual world will mix and match throughout the day. We believe the only way to achieve our goals is to look at the entire stack, from transistors, through architecture, firmware, and algorithms.Meta is seeking a Software Engineer to join our Research & Development teams. This role involves working on AI models, hardware acceleration and software systems related topics. The position will involve taking these skills and applying them to solve for some of the most crucial & exciting problems that exist in Reality Labs. The primary objective will be to develop novel solutions that enable compute and power efficient training and on-device inference of vision and language models for use cases in AR, VR and edge devices. We are hiring in multiple locations.

Required Skills:

Software Engineer, AI Co-design Responsibilities:

1. Identify and solve multi-discipline ML acceleration problems involving algorithms, network design, hardware architecture and AR/VR use cases. These may involve novel approaches not yet established in the industry
2. Work across hardware and software, to solve co-design problems with other Research scientists working in this area
3. Codesign and invent novel ML accelerator and system architecture solutions, and facilitate the integration of algorithms and software to utilize these enhancements
4. Develop state-of-the-art model compression and scalability techniques using Numerics, pruning, distillation etc
5. Optimize models on hardware accelerators to achieve the best performance given various real time latency and power constraints
6. Influence partners to adopt recommended solutions through data-driven analysis and clear communication of trade-offs
7. Define use cases and develop methodology and benchmarks to evaluate different approaches
8. Apply in-depth knowledge of how the ML acceleration interacts with the other systems around it
9. Attend conferences, interpret papers, and stay updated with latest research advancements in the field of ML acceleration
10. contribute to patents and/or publications in peer-reviewed conferences and journals

Minimum Qualifications:

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
2. PhD in Electrical Engineering, Computer Science, or equivalent experience
3. Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python

Preferred Qualifications:

Preferred Qualifications:

1. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
2. Experience working and communicating cross-functionally in a team environment
3. Experience or knowledge of on-device algorithm development including hardware-aware ML models and/or optimizing ML compilers for efficient deployment on AI accelerators
4. Demonstrated research and engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)
5. Experience or knowledge of training/inference of Large scale AI models - CV and/or LLMs
6. Experience with PyTorch, TensorFlow or similar machine learning toolsets
7. Experience evaluating alternative system or algorithm designs by analyzing trade-offs in performance, power, and latency to recommend a solution
8. Experience or knowledge of architecting ML hardware accelerators and systems
9. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
10. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
11. Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as ICLR, NeurIPS, CVPR, ACL, ICML, MLSys, ISCA, MICRO, DAC, ASPLOS etc

Public Compensation:

$183,997/year to $257,000/year + bonus + equity + benefits

Industry:

Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Aff… We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].