Software Engineer, Sensor Fusion and Machine Learning

Meta; Burlingame (CA); On-site; USD 8,000 - 251,000; Full time

Job summary

Join a forward-thinking company at the forefront of the Metaverse, where you will innovate in sensor fusion and machine learning for AR/VR devices. This role involves developing cutting-edge tracking solutions that integrate various sensor data to enhance immersive experiences. You'll lead projects from conception to production, collaborating with talented engineers and researchers. If you're passionate about shaping the future of virtual worlds and enjoy tackling complex challenges, this opportunity offers a dynamic environment to make a significant impact on the next generation of technology.

Benefits

Equity

Comprehensive benefits

Flexible work hours

Career development opportunities

Qualifications

• Experience in coding with C++ and Python for tracking and sensor fusion.
• Familiarity with modern machine learning algorithms and frameworks.

Responsibilities

• Design and develop advanced tracking and sensor fusion algorithms.
• Collaborate with multidisciplinary teams to drive technology development.

Skills

C++

Python

Machine Learning

Sensor Fusion

Tracking Technologies

Kalman Filters

Digital Signal Processing

Education

Bachelor's degree in Computer Science

PhD in Computer Science or related field

Tools

PyTorch

Android Open Source Project

Job description

Software Engineer, Sensor Fusion and Machine Learning

Meta is building the Metaverse, the "spatial internet" where immersive virtual worlds will coexist with the real world. The Spatial AI team under Reality Labs (RL) develops cutting-edge technologies that serve as the foundation of Meta AR/VR products. From tracking & localization to context/semantic understanding, our team takes new technologies from early concept to the product level while prototyping and realizing the new experiences they open up. We are looking for software engineers who are passionate about building tracking & positioning solutions for AR/VR devices. In this role, you will be involved in novel technology development using a variety of sensors for inertial and visual motion tracking, spatial mapping & understanding, and sensor fusion for positioning and places identification. You will collaborate with other engineers and researchers in deploying such solutions in RL devices and light up the next generation experiences such as world-locked rendering, AI powered spatial recommendation, and fitness tracking.

Responsibilities

1. Lead the design and development of advanced tracking and sensor fusion algorithms that leverage visual/IMU inertial tracking with other sensor data (e.g., GPS, WiFi, magnetometer, barometer, etc.) to achieve robust and accurate device position estimation for AR/VR devices in any environment.
2. Follow the state of art tracking & localization technology and define our tech roadmap for adopting these technologies into RL devices.
3. Lead execution and collaboration with multidisciplinary engineering and research teams to drive technologies development from incubation to production.
4. Be a go-to person to escalate the most complex online/production performance issues that require in-depth knowledge.
5. Define projects for other engineers to possibly solve and achieve impact based on your direction.

Minimum Qualifications

1. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
2. Industry experience coding with C++ and Python for design and development of tracking, sensor fusion and machine learning technologies and systems.
3. Experience in designing software systems and machine learning models targeted for edge devices.
4. Demonstrated familiarity with modern machine learning algorithms and experience with modern machine learning frameworks such as PyTorch.

Preferred Qualifications

1. PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics or related technical field.
2. Experience in inertial/visual motion tracking, Kalman filters and state estimation, neural inertial fusion, visual or wireless positioning.
3. Experience in mobile optimization, DSP acceleration, Android Open Source Project.
4. Experience in handling sensors such as IMU, magnetometer, WiFi/BLE, Camera and GNSS.
5. Experience with common digital signal processing techniques such as digital filtering, Fourier transform, correlation, and modulation.

For those who live in or expect to work from California if hired for this position, please click here for additional information.

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

$85.10/hour to $251,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Equal Employment Opportunity and Affirmative Action

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to [e-mail].

Apply for this job. Take the first step toward a rewarding career at Meta. Explore jobs that match your skills and experience. Search by technology, team or location to find an opening that’s right for you.