Embedded Systems Engineer — AI Model Evaluator (Remote)

DataAnnotation; United States; Remote; USD 55,000 - 172,000; Full time

Benefits offered by this job

Weekly payouts

Remote work

Flexible hours

Job summary

DataAnnotation is seeking an experienced Embedded Systems Developer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the engineering judgment and your standard for what counts as a correct answer, and we provide problems the models cannot solve yet.

This role focuses on teaching AI to reason about circuits, systems, and physical constraints, with your written rationale shaping next-gen engineering tools.

Qualifications

• Fluency in English (native or bilingual level).
• 2+ years of industry experience in circuit or electronics engineering.
• Bachelor’s degree preferred but not required.

Responsibilities

• Design challenging, realistic engineering problems from your practice.
• Run those problems through frontier AI models and judge the output.
• Compare two model versions on identical prompts and call which performed better.
• Critique model-generated derivations, schematics, component selections, and calculations, and write the reasoning behind your call.
• Flag concrete failures with evidence: wrong assumptions, sign and unit errors, unphysical results, invalid topologies, fabricated datasheet values, or off-brief interpretation.

Skills

Fluent English

Circuit analysis

Design tradeoffs

AI tools familiarity

Education

Bachelor’s degree

Tools

AI tools

Job description

DataAnnotation is seeking an experienced Embedded Systems Developer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the engineering judgment and your standard for what counts as a correct answer, and we provide problems the models cannot solve yet.

This role focuses on teaching AI to reason about circuits, systems, and physical constraints, with your written rationale shaping next-gen engineering tools.