Senior Robotics Evaluation Scientist

Amazon Science

New York (NY)

On-site

USD 184,000 - 249,000

Full time

24 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) matching
Paid time off
Parental leave
Sign-on payments
RSUs

Job summary

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks for robotic capabilities. You will design how we measure, stress-test, and improve robot behavior across real-world tasks, connecting teleoperation, evaluation, and learning.

You will build infrastructure for data collection, develop evaluation policies, and mentor junior scientists while delivering scalable, reliable systems at the intersection of robotics and machine learning.

Qualifications

  • PhD, or Master’s degree and 6+ years of applied research experience.
  • Experience in patents or publication at top-tier conferences
  • Demonstrated expertise in deep learning and model development
  • Strong experience with robotics systems, control, or embodied AI
  • Experience designing evaluation methodologies, benchmarks, or experimental frameworks for large-scale ML models or robotic systems
  • Familiarity with teleoperation systems, simulation environments, or human-in-the-loop data collection

Responsibilities

  • Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios
  • Develop task definitions, success criteria, and benchmarking methodologies that enable consistent and reproducible evaluation of policies
  • Create and refine data collection protocols that generate high-quality, task-relevant datasets aligned with model development needs
  • Build and iterate on teleoperation workflows and operator interfaces to support efficient, reliable, and scalable data collection
  • Analyze evaluation results and collected data to identify performance gaps, failure modes, and opportunities for targeted data collection
  • Collaborate with engineering teams to integrate evaluation tooling, logging systems, and data pipelines into the broader robotics stack
  • Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning to continuously improve internal approaches
  • Lead technical projects from conception through production deployment
  • Mentor junior scientists and engineers

Skills

Deep learning
Robotics systems
Teleoperation familiarity
Experimental mindset

Education

PhD or Master’s with 6+ years of applied research

Tools

Python
TensorFlow

Job description

Fauna Robotics, an Amazon company, seeks an Applied Scientist to lead evaluation frameworks for robotic capabilities. You will design how we measure, stress-test, and improve robot behavior across real-world tasks, connecting teleoperation, evaluation, and learning.

You will build infrastructure for data collection, develop evaluation policies, and mentor junior scientists while delivering scalable, reliable systems at the intersection of robotics and machine learning.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Robotics Evaluation Scientist
Robotics Evaluation Scientist

Fauna Robotics • New York (NY)

On-site
USD 120,000 - 180,000
Senior Applied Scientist, Robot Capability Evaluation, Fauna
Senior Applied Scientist, Robot Capability Evaluation, Fauna

The Robot Age • Sunnyvale (CA)

Hybrid
USD 130,000 - 210,000
Senior Applied Scientist, Robotic Manipulation & Autonomy
Senior Applied Scientist, Robotic Manipulation & Autonomy

Amazon • Seattle (WA), Northern (KY)

Hybrid
USD 202,000 - 274,000
Senior Applied Scientist, Fauna
Senior Applied Scientist, Fauna

Amazon • New York (NY)

On-site
USD 183,800 - 248,700
Health insurance
401(k) matching
Paid time off
+1
Applied Scientist, Fauna
Applied Scientist, Fauna

Amazon • New York (NY)

On-site
USD 100,000 - 145,000
Senior Robotics Software Architect
Senior Robotics Software Architect

Amazon • New York (NY)

On-site
USD 185,000 - 250,000
Senior Applied Scientist, Fauna
Senior Applied Scientist, Fauna

Amazon Science • New York (NY)

On-site
USD 184,000 - 249,000
Health insurance
401(k) matching
Paid time off
+3
Senior Applied Scientist — Robotics & Real-World AI
Senior Applied Scientist — Robotics & Real-World AI

Amazon • Sunnyvale (CA)

On-site
USD 192,000 - 260,000
Health insurance
401(k) matching
Paid time off
+1
Senior Applied Scientist - Home Robotics & Perception
Senior Applied Scientist - Home Robotics & Perception

Amazon • Bellevue (WA)

On-site
USD 167,000 - 226,000
Senior Robotics Software Architect & SDK Lead
Senior Robotics Software Architect & SDK Lead

Amazon Inc. • New York (NY)

On-site
USD 185,000 - 250,000