Embedded AI - Research Engineer

Facebook; Redmond (WA); On-site; USD 147,000 - 208,000; Full time

Job summary

An innovative technology company is seeking a Research Engineer to enhance audio experiences through cutting-edge multimodal machine learning and embedded systems. This role involves collaborating with AI researchers to develop low-power, efficient models for wearable devices, optimizing AI applications for edge computing, and integrating advanced machine learning with real-time audio-visual processing. Join a dynamic team dedicated to pushing the boundaries of technology and making significant contributions to the field of audio enhancement. If you're passionate about machine learning and eager to work on impactful projects, this is the perfect opportunity for you.

Qualifications

• 2+ years of experience in developing real-time AI models on edge devices.
• Familiarity with SoC Architecture and memory management.

Responsibilities

• Design and build low-compute ML and CV for audio-visual learning.
• Optimize and benchmark ML models on accelerators.

Skills

Embedded AI

Machine Learning

Computer Vision

C++

Python

Real-time AI Models

SoC Architecture

Statistical Modeling

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science or related field

Tools

TensorFlow Lite

ExecuTorch

Job description

**Summary:**

The Audio team within RL Research is looking for a Researcher Engineer with expertise in efficient multimodal machine learning and embedded systems to join our team. You will be building technologies that improve the listener's hearing under challenging listening conditions using wearable computing. We are looking for expertise in building efficient representation models using audio, visual and speech signals; bridge and integrate AI models with conversational context and domain understanding. You will operate at the intersection of large-scale machine learning systems design and development, and egocentric audio-visual learning and computer vision, and partnering with experts in systems processing; and hardware/software co-design.

**Required Skills:**

Embedded AI - Research Engineer Responsibilities:

1. Work with AI researchers and audio/acoustics domain experts on designing and building novel low-compute, low-power ML and CV for egocentric audio-visual learning.

2. Optimize, Implement and benchmark ML model on ML accelerators.

3. Profile AI model run-time inference across various metrics, e.g. compute, memory, power and latency.

4. Support quick prototyping, proof of concept, or proof-of-experience and demonstrations via the real-time integration of ML and CV models into research & development platforms for wearables.

5. Develop and maintain technical documentation for AI model implementation and optimization.

**Minimum Qualifications:**

Minimum Qualifications:

6. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

7. Familiarity with SoC Architecture: System-level understanding of data flows and memory management, including simulation of hardware components and functions such as NPU, GPU, CPUs and DSPs.

8. 2+ years of experience in developing, implementing, and optimizing real-time AI models on edge devices.

9. Proficiency in leveraging popular AI engines such to optimize AI-driven applications for camera and SoC platforms.

10. In-depth knowledge of the architecture and programming models of popular AI engines, enabling effective utilization of their features and resources to achieve high-performance and power-efficient AI processing.

11. Familiarity with relevant tools such as ExecuTorch, TensorFlow Lite, or similar frameworks.

12. Demonstrated experience in programming skills in C++, Python, or other relevant languages.

13. Experience with cross-group and cross-discipline collaboration.

**Preferred Qualifications:**

Preferred Qualifications:

14. Master’s Degree in Computer Sciences, Computer Engineering, Deep Learning, Artificial Intelligence, Machine Learning, Robotics, Computer Vision, Computational Neuroscience, Signal Processing, Speech and Language technologies, or a related field, or equivalent practical experience.

15. 4+ years of experience in developing, implementing, and optimizing real-time AI models on edge devices.

16. 3+ years of experience working on efficient machine learning or computer vision algorithms.

17. Experience with end-to-end real-time ML pipelines, large-scale ML benchmarking, real-time statistical modeling including heuristics driven computer vision methods.

18. Experience working on evaluation and benchmarking for audio-visual ML models, or related generative AI models.

19. Experience working with datasets on preprocessing methods, dataloaders, data tooling and related software engineering platforms.

20. Experience with large-scale or distributed cluster computing for training, development and offline inference of machine learning models.

21. Experience working and communicating cross functionally in a team environment.

22. Experience solving complex problems and comparing alternative solutions, tradeoffs, and broad points of view to determine a path forward.

23. Proven track record of achieving significant results as demonstrated by project launch, research grants, fellowships, patents, as well as publications at leading workshops, journals or conferences.

**Public Compensation:**

$147,000/year to $208,000/year + bonus + equity + benefits

**Industry:** Internet

**Equal Opportunity:**

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].