Mechanical Engineering AI Model Evaluator

DataAnnotation; United States; Remote; USD 55,000 - 172,000; Full time

Job summary

ASME is seeking a Mechanical Engineering AI Model Evaluator to craft challenging, closed-ended problems drawn from your mechanical specialty. You will derive, verify, and provide worked solutions, then test these problems against AI systems to push the models toward true engineering reasoning.

You will review AI-generated analyses and designs for accuracy and real-world relevance, and you will critique others' contributions for rigor and clarity.

Qualifications

• 2+ years of professional mechanical engineering experience in any specialty.
• Ability to write precise, unambiguous technical problems and worked solutions in fluent English.
• Proficiency with CAD tools and engineering analysis software.
• Strong fundamentals across mechanics of materials, dynamics, thermodynamics, heat transfer, and manufacturing processes.

Responsibilities

• Write challenging, closed-ended problems from your area of expertise that require engineering reasoning.
• Derive, verify, and provide worked solutions for each problem.
• Test problems against AI systems and refine them to elevate challenge.
• Review AI-generated analyses, designs and documentation for correctness and real-world applicability.
• Review others' problems and solutions for correctness, ambiguity and rigor.

Skills

Attention to detail

Fluent written English

Technical problem writing

Engineering judgment

Education

Bachelor's degree in mechanical engineering or related field

Tools

CAD tools

FEA/CFD

MATLAB/Python

Job description

We're looking for a Mechanical Engineering AI Model Evaluator to help train AI models. You'll write hard, verifiable engineering problems drawn from your own specialty, work out the answers yourself, and show us exactly where today's AI systems still fall short of a practicing engineer.

This is a new and fast-growing area for our company, focused on teaching AI to reason like an engineer. The models can already talk fluently about mechanical engineering. What they can't yet do reliably is the actual work: size a component against a real load case, catch the failure mode a spec sheet doesn't mention, read a CAD assembly and tell you what interferes at full travel, or predict what a design change breaks downstream. Your engineering judgment becomes the benchmark those models are measured against.

Responsibilities:

• Write challenging, closed-ended problems from your area of expertise, built so that solving them requires real engineering reasoning rather than a lookup
• Derive the correct answer, verify it, and write a worked solution showing how you got there
• Test your problems against AI systems and sharpen the ones they get right until they challenge the model
• Review AI-generated engineering analysis, designs, and technical documentation for correctness and real-world applicability
• Review other contributors' problems and solutions for correctness, ambiguity, and rigor

Problems draw on whatever you know best:

• Mechanical design and CAD: geometry, clearances, tolerances, mechanisms, and the effect of design changes
• Structures and materials: stress, deflection, fatigue, buckling, material selection, and failure analysis
• Thermal and fluids: heat transfer, thermodynamics, HVAC, pumps and piping, and fluid mechanics
• Dynamics and controls: vibration, kinematics, rotating machinery, and control systems
• Manufacturing: DFM/DFA, process selection, GD&T, tolerance stack-ups, and cost and quality trade-offs

Advantages of contracting with us:

• Choose which projects you work on and when
• Work on your own schedule, on your own computer, from the comfort of your own home
• Projects are paid hourly up to 40–125 USD per hour, with bonus rates available on some projects

Note:
Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in the United States, Canada, and the United Kingdom will be considered for this role. This is an independent contractor position.

Qualifications:

• 2+ years of professional mechanical engineering experience in any specialty: design, product development, manufacturing, thermal, structural, automotive, aerospace, HVAC, robotics, energy, or related fields
• Fluency in the tools of your specialty, such as CAD (SolidWorks, Fusion 360, Onshape, Creo, NX, CATIA, or Inventor), FEA/CFD, or MATLAB/Python for engineering analysis
• Strong fundamentals across mechanics of materials, dynamics, thermodynamics, heat transfer, fluid mechanics, and manufacturing processes
• Able to write a precise, unambiguous technical problem and a clear worked solution in fluent written English
• Meticulous: you check your own work and enjoy finding the edge case that breaks an assumption
• A bachelor's degree in mechanical engineering or a related field (completed or in progress)