Senior Robotics Evaluation Scientist

Amazon Science; New York (NY); On-site; USD 184,000 - 249,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Sign-on payments

RSUs

Job summary

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks for robotic capabilities. You will design how we measure, stress-test, and improve robot behavior across real-world tasks, connecting teleoperation, evaluation, and learning.

You will build infrastructure for data collection, develop evaluation policies, and mentor junior scientists while delivering scalable, reliable systems at the intersection of robotics and machine learning.

Qualifications

• PhD, or Master’s degree and 6+ years of applied research experience.
• Experience in patents or publication at top-tier conferences
• Demonstrated expertise in deep learning and model development
• Strong experience with robotics systems, control, or embodied AI
• Experience designing evaluation methodologies, benchmarks, or experimental frameworks for large-scale ML models or robotic systems
• Familiarity with teleoperation systems, simulation environments, or human-in-the-loop data collection

Responsibilities

• Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios
• Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies
• Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs
• Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection
• Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection
• Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack
• Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches
• Lead technical projects from conception through production deployment
• Mentor junior scientists and engineers

Skills

Deep learning

Robotics systems

Teleoperation familiarity

Experimental mindset

Education

PhD or Master’s with 6+ years of applied research

Tools

Python

TensorFlow

Job description

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks for robotic capabilities. You will design how we measure, stress-test, and improve robot behavior across real-world tasks, connecting teleoperation, evaluation, and learning.

You will build infrastructure for data collection, develop evaluation policies, and mentor junior scientists while delivering scalable, reliable systems at the intersection of robotics and machine learning.