LLM Evaluation & Engineering Simulation Lead (Freelance)

Zettamine Labs; United States; Remote; USD 165,000 - 276,000; Full time

Job summary

Zettamine Labs is seeking an experienced LLM Engineering Expert for freelance AI evaluation and engineering simulation work. The project focuses on creating complex simulation problems, validating outputs, and analyzing AI trajectories using open-source tools.

Strong background in engineering and Python is required for remote collaboration and rapid deployment. Ideal candidates have 10+ years in engineering design, advanced degrees, and hands-on experience with LLMs and AI evaluation.

Qualifications

• 10+ years of hands-on engineering design experience.
• Master's degree or PhD in Electrical, Mechanical, Aerospace Engineering or closely related field.
• Strong Python programming/scripting skills.
• Experience with engineering simulation/tooling platforms listed.
• Experience with LLMs, AI coding agents, or AI evaluation.

Responsibilities

• Create complex, self-contained engineering design and simulation problems for AI evaluation.
• Define technical constraints, objectives, reference solutions, and evaluation criteria.
• Build and validate engineering simulation environments using open-source tools.
• Develop Python-based scripts, test benches, and automated graders.
• Analyze AI agent outputs, trajectories, and execution logs to identify issues.
• Identify failure modes such as simulator interpretation errors, premature convergence, and tool-use mistakes.
• Refine task difficulty based on model performance and evaluation results.
• Ensure physical plausibility, unit consistency, boundary conditions, convergence, and accuracy.
• Collaborate with AI researchers and engineering teams to improve benchmarks.

Skills

Engineering design

Python programming

AI evaluation

Engineering simulation

LLMs / AI agents

Education

Master's or PhD in Electrical, Mechanical, or Aerospace Engineering

Tools

ngspice

PySpice

OpenFOAM

FEniCSx

CalculiX

python-control

CadQuery

build123d

OpenModelica

Cantera

Gmsh

Job description

Zettamine Labs is seeking an experienced LLM Engineering Expert for freelance AI evaluation and engineering simulation work. The project focuses on creating complex simulation problems, validating outputs, and analyzing AI trajectories using open-source tools.

Strong background in engineering and Python is required for remote collaboration and rapid deployment. Ideal candidates have 10+ years in engineering design, advanced degrees, and hands-on experience with LLMs and AI evaluation.