Senior Robotic Evaluation Scientist

Amazon Science; New York (NY); On-site; USD 184,000 - 249,000; Full time

Job summary

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks and data collection for robotic capabilities. You will design measurement, stress-testing, and improvement of robot behavior across real-world tasks, shaping validation policies and high-quality datasets to accelerate system performance.

You will bridge robotics, machine learning, and human-in-the-loop systems, building infrastructure and methodologies that connect teleoperation, evaluation, and learning,

Qualifications

• PhD or Master’s with 6+ years of applied research experience.
• Experience programming in Java, C++, Python or related language.
• Experience in patents or publications at top-tier peer-reviewed conferences or journals.

Responsibilities

• Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios.
• Develop task definitions, success criteria, and benchmarking methodologies for consistent evaluation of policies.
• Create and refine data collection protocols that generate high-quality, task-relevant datasets.
• Build and iterate on teleoperation workflows and operator interfaces for scalable data collection.
• Analyze evaluation results to identify performance gaps and data collection opportunities.
• Collaborate with engineering teams to integrate evaluation tooling and data pipelines into the robotics stack.
• Stay current with advances in robotics and human-in-the-loop learning to improve approaches.
• Lead technical projects from conception through production deployment.
• Mentor junior scientists and engineers.

Skills

Java

C++

Python

Publications

Algorithms & data structures

Numerical optimization

Data mining

Parallel computing

Education

PhD

Master's degree

Tools

Spark

Hadoop

TensorFlow

Scikit-learn

MxNet

NumPy

Job description

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks and data collection for robotic capabilities. You will design measurement, stress-testing, and improvement of robot behavior across real-world tasks, shaping validation policies and high-quality datasets to accelerate system performance.

You will bridge robotics, machine learning, and human-in-the-loop systems, building infrastructure and methodologies that connect teleoperation, evaluation, and learning,