Robotics Evaluation Scientist

Amazon Science; New York (NY); On-site; USD 157,000 - 213,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Science is seeking a Research Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. You will shape how policies are validated and how high-quality datasets are generated to accelerate system performance.

The role sits at the intersection of robotics, machine learning, and human-in-the-loop systems, building infrastructure and methodologies that connect teleoperation, evaluation, and learning.

Qualifications

• PhD, or Master's degree and 4+ years of quantitative field research experience.
• Experience applying scientific principles to business problems and products.
• Experience analyzing both experimental and observational data sets.

Responsibilities

• Design and implement evaluation frameworks to measure robot capabilities across structured tasks, edge cases, and real-world scenarios.
• Develop task definitions, success criteria, and benchmarking methodologies for consistent evaluation of policies.
• Create and refine data collection protocols that generate high-quality, task-relevant datasets.
• Build and iterate on teleoperation workflows and operator interfaces to support scalable data collection.
• Analyze evaluation results to identify performance gaps and opportunities for targeted data collection.
• Collaborate with engineering teams to integrate evaluation tooling and data pipelines into the robotics stack.
• Stay current with advances in robotics, evaluation methodologies, and human-in-the-loop learning.
• Lead technical projects from conception through production deployment.
• Mentor junior scientists and engineers.

Skills

Robotics

Machine Learning

Evaluation

Data pipelines

Education

PhD

Master's degree with 4+ years of research experience

Tools

Python

R

MATLAB

Job description

Amazon Science is seeking a Research Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. You will shape how policies are validated and how high-quality datasets are generated to accelerate system performance.

The role sits at the intersection of robotics, machine learning, and human-in-the-loop systems, building infrastructure and methodologies that connect teleoperation, evaluation, and learning.