Robotics Model Evaluation Lead

Dyna Robotics; Redwood City (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Dyna Robotics is seeking a Model Evaluation Lead to guide the team responsible for understanding how robot policies perform and whether new model versions deliver meaningful improvements. You will manage and develop the evaluation team, own evaluation planning and execution, and work closely with researchers to define tests, measure outcomes, and learn from results.

This hands-on leadership role combines people management, experimental rigor, and technical judgment to help researchers understand

Qualifications

• Experience in robotics, ML, applied research, or model evaluation with ownership of evaluation design.
• Experience managing a technical team, setting priorities, giving feedback, and building effective practices.
• Strong experimental judgment: define success, control variables, identify gaps, assess meaningful improvements.
• Technical fluency to work directly with researchers on model checkpoints, generalization, data quality, and experimental tradeoffs.
• Comfort using Python or similar tools to analyze results, inspect logs, and improve evaluation workflows.
• Clear communication and strong ownership: turn ambiguous requests into executable plans and explain findings to teams.

Responsibilities

• Lead and develop the evaluation team and manage priorities, performance, and growth.
• Collaborate with researchers to translate questions into evaluation plans, hypotheses, success criteria, and deliverables.
• Design task definitions, scoring rubrics, and test scenarios reflecting real operating conditions.
• Ensure results are repeatable and trustworthy with standardized setups, resets, and intervention rules.
• Identify regressions and communicate improvements and remaining uncertainties across model versions.
• Improve evaluation tools and workflows with data analysis, automation, and dashboards.

Skills

Robotics experience

Team leadership

Experimental judgment

Technical communication

Python scripting

Tools

Python

Job description

Dyna Robotics is seeking a Model Evaluation Lead to guide the team responsible for understanding how robot policies perform and whether new model versions deliver meaningful improvements. You will manage and develop the evaluation team, own evaluation planning and execution, and work closely with researchers to define tests, measure outcomes, and learn from results.

This hands-on leadership role combines people management, experimental rigor, and technical judgment to help researchers understand