Mechanical Engineering - AI Model Evaluator

Idaho Society of Professional Engineers; Australia; Remote; AUD 78,000 - 245,000; Full time

Benefits offered by this job

Choose projects and schedule

Work from home

Hourly pay with potential bonuses

Job summary

Idaho Society of Professional Engineers is seeking a Mechanical Engineering AI Model Evaluator to craft challenging, verifiable problems drawn from specialized mechanical engineering fields. You will derive, verify, and document worked solutions to train AI systems to reason like a practicing engineer.

Responsibilities include reviewing AI-generated analyses and designs for real-world applicability, and refining problems based on edge cases discovered during evaluation.

Qualifications

• 2+ years of professional mechanical engineering experience in any specialty.
• Proficiency with CAD tools such as SolidWorks, Fusion 360, Onshape, Creo, NX, CATIA or Inventor.
• Strong fundamentals across mechanics of materials, dynamics, thermodynamics, heat transfer, fluid mechanics.
• Ability to write precise, unambiguous technical problems and worked solutions in fluent written English.
• Meticulous and capable of finding edge cases that break assumptions.
• Bachelor's degree in mechanical engineering or related field (completed or in progress).

Responsibilities

• Write challenging, closed-ended problems from your area of expertise, built so that solving them requires real engineering reasoning rather than a lookup.
• Derive the correct answer, verify it, and write a worked solution showing how you got there.
• Test your problems against AI systems and sharpen the ones they get right until they challenge the model.
• Review AI-generated engineering analysis, designs, and technical documentation for correctness and real-world applicability.
• Review other contributors' problems and solutions for correctness, ambiguity, and rigor

Skills

Mechanical engineering fundamentals

Technical problem writing

Attention to detail

Education

Bachelor's degree in mechanical engineering or related field

Tools

CAD (SolidWorks, Fusion 360, Onshape, Creo, NX, CATIA, Inventor)

FEA/CFD

MATLAB/Python for engineering analysis

Job description

We're looking for a Mechanical Engineering - AI Model Evaluator to help train AI models. You'll write hard, verifiable engineering problems drawn from your own specialty, work out the answers yourself, and show us exactly where today's AI systems still fall short of a practicing engineer.

This is a new and fast-growing area for our company, focused on teaching AI to reason like an engineer. The models can already talk fluently about mechanical engineering. What they can't yet do reliably is the actual work: size a component against a real load case, catch the failure mode a spec sheet doesn't mention, read a CAD assembly and tell you what interferes at full travel, or predict what a design change breaks downstream. Your engineering judgment becomes the benchmark those models are measured against.

Responsibilities:

• Write challenging, closed-ended problems from your area of expertise, built so that solving them requires real engineering reasoning rather than a lookup
• Derive the correct answer, verify it, and write a worked solution showing how you got there
• Test your problems against AI systems and sharpen the ones they get right until they challenge the model
• Review AI-generated engineering analysis, designs, and technical documentation for correctness and real-world applicability
• Review other contributors' problems and solutions for correctness, ambiguity, and rigor

Problems draw on whatever you know best:

• Mechanical design and CAD: geometry, clearances, tolerances, mechanisms, and the effect of design changes
• Structures and materials: stress, deflection, fatigue, buckling, material selection, and failure analysis
• Thermal and fluids: heat transfer, thermodynamics, HVAC, pumps and piping, and fluid mechanics
• Dynamics and controls: vibration, kinematics, rotating machinery, and control systems
• Manufacturing: DFM/DFA, process selection, GD&T, tolerance stack-ups, and cost and quality trade-offs

Advantages of contracting with us:

• Choose which projects you work on and when
• Work on your own schedule, on your own computer, from the comfort of your own home
• Projects are paid hourly up to $40–$125 USD per hour, with bonus rates available on some projects

Qualifications:

• 2+ years of professional mechanical engineering experience in any specialty: design, product development, manufacturing, thermal, structural, automotive, aerospace, HVAC, robotics, energy, or related fields
• Fluency in the tools of your specialty, such as CAD (SolidWorks, Fusion 360, Onshape, Creo, NX, CATIA, or Inventor), FEA/CFD, or MATLAB/Python for engineering analysis
• Strong fundamentals across mechanics of materials, dynamics, thermodynamics, heat transfer, fluid mechanics, and manufacturing processes
• Able to write a precise, unambiguous technical problem and a clear worked solution in fluent written English
• Meticulous: you check your own work and enjoy finding the edge case that breaks an assumption
• A bachelor's degree in mechanical engineering or a related field (completed or in progress)

Note:
Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in the United States, Canada, and the United Kingdom will be considered for this role. This is an independent contractor position.