Remote Embedded Systems AI Trainer & Evaluator

DataAnnotation; San Francisco (CA); Remote; USD 55,000 - 172,000; Full time

Job summary

DataAnnotation is seeking an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the judgment from years of hardware design, debugging, and shipping, while we provide engineering problems for the models to solve.

You will design realistic engineering problems, run them through frontier AI models, and judge outputs against professional standards, critiquing derivations and component selections with clear,

Qualifications

• Fluency in English (native or bilingual level).
• Working comfort with AI tools or ability to pick them up quickly.

Responsibilities

• Design challenging, realistic engineering problems from your practice.
• Run problems through frontier AI models and judge output against professional standards.
• Compare two model versions on identical prompts and evaluate performance.
• Critique model-generated derivations, schematics, component selections, and calculations.
• Flag concrete failures with evidence and write the reasoning behind your call.

Skills

Fluency in English

Familiar with AI tools

Education

Bachelor’s degree in Electrical Engineering or related field

Job description

DataAnnotation is seeking an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the judgment from years of hardware design, debugging, and shipping, while we provide engineering problems for the models to solve.

You will design realistic engineering problems, run them through frontier AI models, and judge outputs against professional standards, critiquing derivations and component selections with clear,