Remote AI Evaluation Engineer for Simulations & Design

Benture; San Francisco (CA); Remote; USD 83,000 - 138,000; Part time

Job summary

Turing, based in San Francisco, seeks experienced AI Evaluation Engineers specializing in engineering simulation and design to author and validate complex problems that train and evaluate state-of-the-art AI agents. This high-impact contractor role operates across Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics Engineering.

Responsibilities include designing model-breaking tasks, integrating environments, analyzing trajectories, calibrating difficulty, and collaborating

Qualifications

• Master’s degree or PhD in Electrical, Mechanical, Aerospace, Control Systems, Systems Engineering, Robotics, or an applied science discipline.
• 3+ years of hands-on engineering design experience.
• Proficiency with at least one domain-relevant open-source simulation package and strong Python scripting skills.
• Hands-on experience with modern LLMs/coding agents and evaluation concepts.
• Uncompromising attention to physical plausibility, unit consistency, boundary conditions, convergence criteria, and technical documentation.
• Weekend on-call availability (part-time engagement acceptable).
• Personal desktop or laptop with a stable, high-speed internet connection.

Responsibilities

• Author original engineering design tasks with constraints, targets, reference solutions, and autograders.
• Build, run, and validate problem environments using open-source simulation tools and Python test benches.
• Evaluate agent outputs and logs to identify systemic failure modes.
• Iteratively refine problem difficulty based on performance data.
• Collaborate with AI researchers and domain experts to integrate benchmarks into evaluation pipelines.

Skills

Python scripting

Engineering design

LLM evaluation

Domain rigor

Cross-disciplinary collaboration

Education

Master’s or PhD in Electrical/Mechanical/Aerospace/Control Systems/Robotics

Tools

ngspice

PySpice

OpenFOAM

FEniCSx

CalculiX

python-control

CadQuery

OpenModelica

Cantera

Gmsh

Job description

Turing, based in San Francisco, seeks experienced AI Evaluation Engineers specializing in engineering simulation and design to author and validate complex problems that train and evaluate state-of-the-art AI agents. This high-impact contractor role operates across Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics Engineering.

Responsibilities include designing model-breaking tasks, integrating environments, analyzing trajectories, calibrating difficulty, and collaborating