Applied Scientist - Perception (SLAM/VIO), Fauna

Amazon; San Francisco, Northern (CA, KY); Hybrid; USD 172,000 - 223,000; Full time

Job summary

Amazon is seeking an Applied Scientist to advance Visual Inertial Odometry and sensor fusion for intelligent robots. You will own the pipeline from algorithm design to embedded deployment, ensuring real-time perception on resource‑constrained hardware and integrating learned perception with geometric methods.

The role emphasizes hands‑on work with sensors and data, collaboration across hardware, controls, and navigation teams, and leading projects from prototyping to production deployment.

Qualifications

• 3+ years of building models for applications.
• PhD, or Master’s degree and 4+ years of CS, CE, ML or related field experience.
• Experience in patents or publications at top-tier conferences or journals.
• Experience programming in Java, C++, Python or related language.
• Experience in algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high‑performance computing.
• Hands‑on experience developing and deploying Visual Inertial Odometry or visual‑inertial SLAM systems.
• Strong understanding of multi‑sensor fusion (cameras, IMUs, odometry) and state estimation.
• Experience optimizing perception algorithms for embedded or resource‑constrained hardware.
• Hands‑on experience with real sensor data, calibration, and physical robot platforms.
• Familiarity with modern ML approaches to perception (learned feature extraction, depth prediction, end‑to‑end odometry).

Responsibilities

• Design and implement Visual Inertial Odometry algorithms for robust real-time state estimation on robotic platforms like Sprout.
• Develop multi-sensor fusion pipelines integrating cameras, IMUs, and other sensing modalities for accurate pose tracking.
• Optimize perception and tracking algorithms for deployment on embedded hardware (e.g., ARM, GPU‑accelerated edge devices) under strict latency and power constraints.
• Apply modern ML‑based perception techniques (learned features, depth estimation, neural odometry) to complement and improve classical geometric approaches.
• Build and maintain calibration, evaluation, and benchmarking infrastructure for perception systems.
• Collaborate with hardware, controls, and navigation teams to integrate perception outputs into the robot’s autonomy stack.
• Lead technical projects from research prototyping through production deployment.

Skills

VIO

sensor fusion

C++

Python

state estimation

embedded hardware

ROS/ROS2

real sensor data

Education

PhD or Master's + 4+ years CS/CE/ML

Tools

NVIDIA Jetson

Qualcomm RB5

ROS/ROS2

Job description

Job ID: 10524287 | Amazon.com Services LLC

We are seeking an Applied Scientist to develop and optimize Visual Inertial Odometry (VIO) and sensor fusion systems for our intelligent robots. In this role, you will design, implement, and deploy state estimation and tracking algorithms that enable robots to understand their position and motion in real time, even in challenging and dynamic environments.

You will own the full pipeline from algorithm development through embedded deployment, ensuring that perception systems run efficiently on resource-constrained robotic hardware. You will also leverage modern machine learning approaches to push the boundaries of classical perception methods, combining learned representations with geometric techniques to achieve robust, real-time performance.

This is a deeply hands‑on role. You will work directly with sensors, hardware, and real‑world data, while prototyping, testing, and iterating in physical environments. The ideal candidate has strong foundations in VIO and sensor fusion, practical experience optimizing algorithms for embedded platforms, and familiarity with how modern deep learning is transforming perception.

Key job responsibilities

• Design and implement Visual Inertial Odometry algorithms for robust real-time state estimation on robotic platforms like Sprout
• Develop multi-sensor fusion pipelines integrating cameras, IMUs, and other sensing modalities for accurate pose tracking
• Optimize perception and tracking algorithms for deployment on embedded hardware (e.g., ARM, GPU‑accelerated edge devices) under strict latency and power constraints
• Apply modern ML‑based perception techniques (learned features, depth estimation, neural odometry) to complement and improve classical geometric approaches
• Build and maintain calibration, evaluation, and benchmarking infrastructure for perception systems
• Collaborate with hardware, controls, and navigation teams to integrate perception outputs into the robot’s autonomy stack
• Lead technical projects from research prototyping through production deployment

Basic Qualifications

• 3+ years of building models for business application experience
• PhD, or Master’s degree and 4+ years of CS, CE, ML or related field experience
• Experience in patents or publications at top‑tier peer‑reviewed conferences or journals
• Experience programming in Java, C++, Python or related language
• Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high‑performance computing
• Hands‑on experience developing and deploying Visual Inertial Odometry or visual‑inertial SLAM systems
• Strong understanding of multi‑sensor fusion (cameras, IMUs, odometry) and state estimation (EKF, factor graphs)
• Experience optimizing perception algorithms for embedded or resource‑constrained hardware
• Demonstrated hands‑on experience with real sensor data, calibration, and physical robot platforms
• Familiarity with modern ML approaches to perception (learned feature extraction, depth prediction, end‑to‑end odometry)

Preferred Qualifications

• Experience using Unix/Linux
• Experience in professional software development
• Publication record at major robotics or computer vision conferences (e.g., ICRA, IROS, RSS, CVPR, ECCV)
• Experience with real‑time systems programming and performance profiling on ARM/GPU platforms
• Experience with state estimation on legged robots
• Experience with stereo vision systems, camera‑IMU calibration, time synchronization, and sensor characterization
• Track record of shipping VIO or SLAM systems to production on physical robots at scale
• Experience with NVIDIA Jetson, Qualcomm RB5, or similar embedded AI platforms
• Familiarity with ROS/ROS2
• Experience integrating learned perception modules (e.g., neural depth, feature matching networks) into geometric estimation pipelines
• History of technical leadership and cross‑functional collaboration

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, NY, New York - 172,400.00 - 223,400.00 USD annually