Electrical Engineering AI Model Evaluator

DataAnnotation; United States; Remote; USD 55,000 - 172,000; Full time

Benefits offered by this job

Remote work

Flexible schedule

Independent contractor

Job summary

DataAnnotation is seeking an Electrical Engineering AI Model Evaluator to assess how frontier AI models handle real electrical and electronics engineering work. You bring practical judgment from hardware design, debugging, and shipping, while we provide engineering problems that push models beyond current capabilities.

This independent contractor role offers a remote, flexible schedule with hourly pay from $40 to $125.

Qualifications

• Fluency in English (native or bilingual) required.
• 2+ years of industry experience in circuit or electronics engineering preferred.
• Bachelor’s in electrical engineering or closely related discipline preferred.

Responsibilities

• Design challenging, realistic engineering problems from your practice: circuits, control loops, power stages.
• Run problems through frontier AI models and evaluate outputs against professional standards.
• Compare model versions on identical prompts and report which performed better and why.

Skills

English fluency

Circuit design experience

Circuit analysis

AI tooling familiarity

Education

Bachelor's in EE

Tools

AI tools

Job description

DataAnnotation is looking for an Electrical Engineering AI Model Evaluator to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the judgment you have already built over years of designing, debugging, and shipping hardware. We bring engineering problems the models cannot yet solve on their own.

This is a new and growing area for our company, focused on teaching AI to reason correctly about circuits, systems, and physical constraints. Your engineering judgment, your standard for what counts as a correct answer, and the written rationale behind them become the signal that shapes the next generation of engineering tools.

Advantages of contracting with us:

• You will be able to choose which projects you want to work on and when
• You work on your own schedule, on your own computer, from the comfort of your own home
• Projects are paid hourly up to $40-$125 USD per hour, with bonus rates available on some projects

Responsibilities:

• Design challenging, realistic engineering problems from your own practice: a circuit to specify, a control loop to stabilize, a power stage to size
• Run those problems through frontier AI models and judge the output against your professional standard
• Compare two model versions on identical prompts and call which performed better, and where each fell short
• Critique model-generated derivations, schematics, component selections, and calculations, and write the reasoning behind your call
• Flag concrete failures with evidence: wrong assumptions, sign and unit errors, unphysical results, invalid topologies, fabricated datasheet values, off-brief interpretation
• Contribute across analog, RF and mixed-signal circuits, electromagnetics and antennas, control and systems, devices and materials, signal processing, photonics, and power and energy systems

Qualifications:

• Fluency in English (native or bilingual level)
• 2+ years of industry experience in circuit or electronics engineering
• Background in electrical engineering, electronics engineering, or a closely related discipline
• Strong command of circuit analysis and design tradeoffs, and the ability to defend component-level and system-level decisions
• The ability to articulate why an answer is wrong, not only that it is
• Working comfort with AI tools, or the ability to pick them up quickly
• A current, in progress, or completed Bachelor’s is preferred but not required
• Note: Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States will be considered for this role. This is an independent contractor position.