Electrical Engineer: AI Model Evaluator

DataAnnotation; Dallas (TX); Remote; USD 55,000 - 172,000; Full time

Benefits offered by this job

Flexible work arrangement

Remote project opportunities

Competitive compensation

Job summary

DataAnnotation is looking for an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the engineering judgment built over years of designing, debugging, and shipping hardware.

This role involves designing realistic problems, running them through frontier AI models, judging outputs, and critiquing model-generated derivations with clear reasoning. Flexible, remote, project-ready work.

Qualifications

• Fluency in English (native or bilingual level).
• 2+ years of industry experience in circuit or electronics engineering.
• Background in electrical engineering, electronics engineering, or a closely related discipline.
• Strong command of circuit analysis and design tradeoffs.
• Ability to articulate why an answer is wrong.
• Comfort working with AI tools.
• Bachelor’s degree preferred but not required.
• Authorized to work in Australia, Canada, Ireland, New Zealand, United Kingdom, or United States.

Responsibilities

• Design challenging, realistic engineering problems from your own practice: a circuit to specify, a control loop to stabilize, a power stage to size.
• Run those problems through frontier AI models and judge the output against your professional standard.
• Compare two model versions on identical prompts and call which performed better, and where each fell short.
• Critique model-generated derivations, schematics, component selections, and calculations, and write the reasoning behind your call.
• Flag concrete failures with evidence: wrong assumptions, sign and unit errors, unphysical results, invalid topologies, fabricated datasheet values, or off-brief interpretation.

Skills

Circuit analysis

AI tools familiarity

Critical thinking

Communication in English

Education

Bachelor's degree in Electrical Engineering or related field

Job description

DataAnnotation is looking for an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the engineering judgment built over years of designing, debugging, and shipping hardware.

This role involves designing realistic problems, running them through frontier AI models, judging outputs, and critiquing model-generated derivations with clear reasoning. Flexible, remote, project-ready work.