Erhalte eine Antwort von diesem Arbeitgeber — ein Lebenslauf und ein Anschreiben, die genau auf die Eigenschaften eingehen, die gesucht werden.
Mercor is seeking a domain expert to drive engineering-reasoning evaluations by writing simulations and specifications that guide AI model design. The role focuses on artifacts that satisfy complex requirements across control, electronics, or mechanical domains.
You will define prompts, thresholds, and evaluation criteria, and oversee model runs with an agentic grader to assess spec satisfaction. Collaboration in a browser-based studio and GitHub is expected.
A frontier engineering-reasoning evaluation run in collaboration with a leading AI research lab. The work measures whether state-of-the‑art models can reason from first principles in your engineering domain rather than retrieve facts from training data — and you get visibility into the model's internal reasoning on your own tasks.
Domain experts write simulations and specification sheets; the model attempts to design an artifact — controller gains, circuit parameters, geometry — that satisfies every spec.
You define the simulation, a set of specs with pass/fail thresholds, and the prompt. The model probes your simulation with a limited number of calls, then submits a final design. An agentic grader runs the simulation and scores spec satisfaction.
Onboarding calls run daily, alongside internal tooling built to help you work faster. Prior model-evaluation experience is not required.