AI-Circuit Engineer: Judge & Refine Frontier Models

DataAnnotation; Chicago (IL); Remote; USD 55,000 - 172,000; Full time

Benefits offered by this job

Remote work

Project-based work

Job summary

DataAnnotation seeks an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring judgment from years of hardware design, debugging, and shipping.

We provide engineering problems the models cannot solve on their own, focusing on circuits, systems, and physical constraints. Responsibilities include crafting challenging problems, evaluating model outputs, and critiquing derivations and calculations with clear reasoning.

Qualifications

• 2+ years of industry experience in circuit or electronics engineering.
• Bachelor’s degree in electrical engineering or related field is preferred.
• Ability to defend design tradeoffs and component-level decisions.
• Ability to articulate why an answer is wrong, not only that it is.
• Familiarity with AI tools or the ability to learn them quickly.

Responsibilities

• Design challenging, realistic engineering problems for frontier AI models.
• Run problems through AI models and judge outputs against professional standards.
• Compare two model versions on identical prompts and determine which performed better.
• Critique model-generated derivations, schematics, and calculations, and write the reasoning behind the call.
• Flag concrete failures with evidence such as wrong assumptions or unphysical results.

Skills

Circuit design

Circuit analysis

Component choices

Systems thinking

Education

Bachelor's degree in Electrical Engineering

Tools

SPICE

EDA tools

Python

Job description

DataAnnotation seeks an experienced Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring judgment from years of hardware design, debugging, and shipping.

We provide engineering problems the models cannot solve on their own, focusing on circuits, systems, and physical constraints. Responsibilities include crafting challenging problems, evaluating model outputs, and critiquing derivations and calculations with clear reasoning.