Mechanical Engineering - AI Model Evaluator

AFE; Australia; Remote; AUD 78,000 - 245,000; Full time

Benefits offered by this job

Flexible projects

Remote work from home

Competitive hourly rates

Job summary

AFE is seeking a Mechanical Engineering - AI Model Evaluator to craft challenging engineering problems, derive solutions, and verify accuracy. You’ll evaluate AI systems’ reasoning against real-world engineering practice across mechanical design, structures, thermal, and controls.

Work remotely on projects, with hourly pay from 40 to 125 USD and occasional bonus rates. A bachelor’s in mechanical engineering and strong CAD/analysis tool fluency are required.

Qualifications

• 2+ years of professional mechanical engineering experience in design, product development, manufacturing, thermal, structural, automotive, aerospace, HVAC, robotics, energy, or related fields.
• Fluency with CAD/analysis tools such as SolidWorks, Fusion 360, Onshape, Creo, NX, CATIA, or Inventor.
• Strong fundamentals across mechanics of materials, dynamics, thermodynamics, heat transfer, fluid mechanics, and manufacturing processes.
• Able to write precise, unambiguous technical problems and clear worked solutions in fluent written English.
• Meticulous: checks own work and finds edge cases that break assumptions.

Responsibilities

• Write challenging, closed-ended problems from your area of expertise requiring engineering reasoning.
• Derive the correct answer, verify it, and write a worked solution showing the process.
• Test problems against AI systems and sharpen ones they get right.
• Review AI-generated engineering analyses, designs, and documentation for correctness and real-world applicability.
• Review other contributors' problems and solutions for correctness, ambiguity, and rigor.

Skills

Mechanics fundamentals

Engineering judgement

Precise English writing

Problem solving

Education

Bachelor’s degree in mechanical engineering

Tools

SolidWorks

Fusion 360

Onshape

Creo

NX

CATIA

Inventor

FEA/CFD

MATLAB/Python

Job description

We're looking for a Mechanical Engineering - AI Model Evaluator to help train AI models. You'll write hard, verifiable engineering problems drawn from your own specialty, work out the answers yourself, and show us exactly where today's AI systems still fall short of a practicing engineer.

This is a new and fast-growing area for our company, focused on teaching AI to reason like an engineer. The models can already talk fluently about mechanical engineering. What they can't yet do reliably is the actual work: size a component against a real load case, catch the failure mode a spec sheet doesn't mention, read a CAD assembly and tell you what interferes at full travel, or predict what a design change breaks downstream. Your engineering judgment becomes the benchmark those models are measured against.

Responsibilities:

• Write challenging, closed-ended problems from your area of expertise, built so that solving them requires real engineering reasoning rather than a lookup
• Derive the correct answer, verify it, and write a worked solution showing how you got there
• Test your problems against AI systems and sharpen the ones they get right until they challenge the model
• Review AI-generated engineering analysis, designs, and technical documentation for correctness and real-world applicability
• Review other contributors' problems and solutions for correctness, ambiguity, and rigor

Problems draw on whatever you know best:

• Mechanical design and CAD: geometry, clearances, tolerances, mechanisms, and the effect of design changes
• Structures and materials: stress, deflection, fatigue, buckling, material selection, and failure analysis
• Thermal and fluids: heat transfer, thermodynamics, HVAC, pumps and piping, and fluid mechanics
• Dynamics and controls: vibration, kinematics, rotating machinery, and control systems
• Manufacturing: DFM/DFA, process selection, GD&T, tolerance stack-ups, and cost and quality trade-offs

Advantages of contracting with us:

• Choose which projects you work on and when
• Work on your own schedule, on your own computer, from the comfort of your own home
• Projects are paid hourly up to $40–$125 USD per hour, with bonus rates available on some projects

Qualifications:

• 2+ years of professional mechanical engineering experience in any specialty: design, product development, manufacturing, thermal, structural, automotive, aerospace, HVAC, robotics, energy, or related fields
• Fluency in the tools of your specialty, such as CAD (SolidWorks, Fusion 360, Onshape, Creo, NX, CATIA, or Inventor), FEA/CFD, or MATLAB/Python for engineering analysis
• Strong fundamentals across mechanics of materials, dynamics, thermodynamics, heat transfer, fluid mechanics, and manufacturing processes
• Able to write a precise, unambiguous technical problem and a clear worked solution in fluent written English
• Meticulous: you check your own work and enjoy finding the edge case that breaks an assumption
• A bachelor's degree in mechanical engineering or a related field (completed or in progress)

Note:
Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in the United States, Canada, and the United Kingdom will be considered for this role. This is an independent contractor position.