Robotics Evaluation Specialist - Remote

YO IT Consulting; Seattle (WA); On-site; USD 55,104 - 110,208; Part time

Job summary

YO IT Consulting seeks a Robotics Evaluation Specialist to support real-world AI system training through remote video-based tasks. You will follow precise instructions, perform on-camera actions, and document findings to help improve robotics evaluation pipelines.

Candidates should have hands-on robotics experience, sharp attention to detail, and strong English communication. This role emphasizes confidentiality and collaboration with the customer’s team to refine evaluation protocols.

Qualifications

• Proven experience with robotics pipelines or related hands-on robotics projects.
• Excellent attention to detail and ability to spot subtle differences in outcomes.
• Clear English communication; native or near-native preferred.
• Ability to follow complex instructions precisely with high reliability.

Responsibilities

• Follow detailed task instructions to perform actions on camera for robotics evaluation.
• Review system responses and assess performance.
• Provide clear written feedback on evaluation accuracy.
• Document observations and edge cases consistently.
• Collaborate asynchronously to refine evaluation protocols.
• Maintain data integrity and confidentiality.
• Contribute to continuous improvement of evaluation pipelines.

Skills

Robotics experience

Attention to detail

English communication

Instruction following

Education

Robotics engineering background

Human-computer interaction background

Automation testing background

Job description

Job Title: Robotics Evaluation Specialist

Job Type: Contract

Location: Remote

Job Summary

In this role, you'll apply your expertise to help train next‑generation AI systems. Your work will shape how models learn, reason, and perform through high‑quality, real‑world input.

Key Responsibilities

• Carefully follow detailed task instructions to execute physical actions on camera for robotics evaluation.
• Review and analyze system responses to your interactions, ensuring accurate performance assessments.
• Provide clear, structured written feedback on the accuracy of robotic system evaluations.
• Document observations and potential edge cases in a consistent, organized manner.
• Collaborate asynchronously with the customer’s team to refine evaluation protocols and share insights.
• Maintain a high standard of data integrity and confidentiality throughout all evaluation activities.
• Contribute to the continuous improvement of robotics evaluation pipelines based on real‑world findings.

Required Skills And Qualifications

• Proven experience with robotics pipelines or related hands‑on robotics projects.
• Exceptional attention to detail and the ability to notice subtle differences in task outcomes.
• Clear, concise written and verbal communication skills in English; native or near‑native preferred.
• Ability to follow complex instructions precisely and reliably without deviation.
• Strong generalist mindset, comfortable handling a range of simple physical tasks on camera.
• Proficiency in documenting and reporting structured feedback.
• Reliable internet connection and suitable environment for remote video‑based tasks.

Preferred Qualifications

• Experience with paused or historical robotics evaluation pipelines.
• Background in robotics engineering, human‑computer interaction, or automation testing.
• Familiarity with providing evaluative feedback or participating in user testing cycles.