Electrical Engineering AI Model Evaluator

Sustainable World, Inc.; Australia; Remote; AUD 79,000 - 248,000; Full time

Benefits offered by this job

Flexible projects

Remote work from home

Competitive hourly rates (USD)

Job summary

DataAnnotation is seeking an Electrical Engineering AI Model Evaluator to assess frontier AI models on real electrical engineering tasks. You bring judgment from years of hardware design, debugging, and shipping, while we provide engineering problems the models cannot yet solve.

This independent contractor role emphasizes your engineering judgment, your standard for correctness, and the written rationale shaping next-gen tools.

Qualifications

• Fluency in English (native or bilingual level).
• 2+ years of industry experience in circuit or electronics engineering.
• Background in electrical or electronics engineering or closely related discipline.
• Strong command of circuit analysis and design tradeoffs, defend component-level and system-level decisions.
• Ability to articulate why an answer is wrong, not only that it is.
• Comfort with AI tools or ability to pick them up quickly.
• Bachelor’s degree preferred but not required.

Responsibilities

• Design challenging engineering problems from your practice (circuits, control loops, power stages).
• Run problems through frontier AI models and judge outputs against professional standards.
• Compare two model versions and identify which performed better and where.
• Critique model-generated derivations, schematics, component selections, and calculations with reasoning.
• Flag concrete failures with evidence (wrong assumptions, sign/units errors, unphysical results).
• Contribute across analog, RF, mixed-signal circuits, electromagnetics, control, devices and materials, and power systems.

Skills

English fluency

Circuit design

AI tooling

2+ years experience

Explain reasoning

Education

Bachelor’s degree

Job description

DataAnnotation is looking for an Electrical Engineering AI Model Evaluator to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the judgment you have already built over years of designing, debugging, and shipping hardware. We bring engineering problems the models cannot yet solve on their own.

This is a new and growing area for our company, focused on teaching AI to reason correctly about circuits, systems, and physical constraints. Your engineering judgment, your standard for what counts as a correct answer, and the written rationale behind them become the signal that shapes the next generation of engineering tools.

Advantages of contracting with us:

• You will be able to choose which projects you want to work on and when
• You work on your own schedule, on your own computer, from the comfort of your own home
• Projects are paid hourly up to $40-$125 USD per hour, with bonus rates available on some projects

Responsibilities:

• Design challenging, realistic engineering problems from your own practice: a circuit to specify, a control loop to stabilize, a power stage to size
• Run those problems through frontier AI models and judge the output against your professional standard
• Compare two model versions on identical prompts and call which performed better, and where each fell short
• Critique model-generated derivations, schematics, component selections, and calculations, and write the reasoning behind your call
• Flag concrete failures with evidence: wrong assumptions, sign and unit errors, unphysical results, invalid topologies, fabricated datasheet values, off-brief interpretation
• Contribute across analog, RF and mixed-signal circuits, electromagnetics and antennas, control and systems, devices and materials, signal processing, photonics, and power and energy systems

Qualifications:

• Fluency in English (native or bilingual level)
• 2+ years of industry experience in circuit or electronics engineering
• Background in electrical engineering, electronics engineering, or a closely related discipline
• Strong command of circuit analysis and design tradeoffs, and the ability to defend component-level and system-level decisions
• The ability to articulate why an answer is wrong, not only that it is
• Working comfort with AI tools, or the ability to pick them up quickly
• A current, in progress, or completed Bachelor’s is preferred but not required
• Note: Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States will be considered for this role. This is an independent contractor position.