Lead Robotics Evaluation Scientist

Amazon Inc.; New York (NY); On-site; USD 184,000 - 249,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

RSUs

Job summary

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks for robotic capabilities. You will design how we measure, stress-test, and improve robot behavior across real-world tasks, shaping validation policies and data generation for model development.

You will work at the intersection of robotics, machine learning, and human-in-the-loop systems, building infrastructure that connects teleoperation, evaluation, and learning.

Qualifications

• PhD or Master with 6+ years of applied research experience.
• Strong background in robotics, ML, or related fields.
• Publications or patents in top-tier venues.

Responsibilities

• Design and implement evaluation frameworks to measure robot capabilities across structured tasks and real-world scenarios.
• Develop task definitions, success criteria, and benchmarking methodologies for reproducible evaluation of policies.
• Create and refine data collection protocols that generate high-quality, task-relevant datasets.
• Build and iterate teleoperation workflows and operator interfaces for scalable data collection.
• Analyze evaluation results to identify performance gaps and data needs.
• Collaborate with engineering teams to integrate evaluation tooling and data pipelines.
• Stay current with advances in robotics and human-in-the-loop learning to improve approaches.
• Lead technical projects from conception through production deployment.
• Mentor junior scientists and engineers.

Skills

Applied research

Java

C++

Python

Publications

Education

PhD or Masters with 6+ years experience

Tools

R

scikit-learn

Spark MLlib

MxNet

TensorFlow

NumPy

SciPy

Job description

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks for robotic capabilities. You will design how we measure, stress-test, and improve robot behavior across real-world tasks, shaping validation policies and data generation for model development.

You will work at the intersection of robotics, machine learning, and human-in-the-loop systems, building infrastructure that connects teleoperation, evaluation, and learning.