Remote AI Circuit Engineer — Model Evaluator

DataAnnotation; New York (NY); Remote; USD 55,000 - 172,000; Full time

Job summary

DataAnnotation is seeking an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring judgment built from years of designing, debugging, and shipping hardware while we tackle problems models cannot yet solve.

You’ll design challenging engineering problems, run them through frontier AI models, and compare versions to judge performance.

Qualifications

• Fluency in English (native or bilingual level).
• 2+ years of industry experience in circuit or electronics engineering.
• Background in electrical engineering or related discipline.
• Strong command of circuit analysis and tradeoffs, defend design choices.
• Ability to articulate why an answer is wrong, not just that it is.
• Familiarity with AI tools or quick learner.

Responsibilities

• Design challenging, realistic engineering problems from your practice.
• Run those problems through frontier AI models and judge outputs.
• Compare model versions on identical prompts and evaluate performance.
• Critique model-derived derivations, schematics, and calculations with rationale.
• Flag concrete failures with evidence and clear conclusions.

Skills

Fluent English

2+ years experience

Electrical engineering

Circuit analysis

AI tools familiarity

Defend decisions

Education

Bachelor's degree

Job description

DataAnnotation is seeking an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring judgment built from years of designing, debugging, and shipping hardware while we tackle problems models cannot yet solve.

You’ll design challenging engineering problems, run them through frontier AI models, and compare versions to judge performance.