A complete application in a minute
Tailored resume and cover letter, ready to send.
DataAnnotation is seeking a Mathematician - AI Model Evaluator to design challenging mathematical problems that current AI models still struggle with. You will judge correctness versus plausibility and build the tooling to prove it in a research-focused, remote role.
You will design, test, and validate complex tasks, ensuring accuracy as ground truth for model scoring. Strong math stats background and coding ability are essential.
DataAnnotation is looking for a Mathematician - AI Model Evaluator to design mathematical problems that today's leading AI models still get wrong. Models are fluent enough to produce an answer that looks right and a derivation that reads well. You bring the judgment to tell the difference between the two, and the tooling to prove it.
This is a new and growing area for our company, focused on teaching AI to reason correctly rather than plausibly. The work combines deep mathematical knowledge with strong coding skills: you design, test, and validate complex tasks yourself. Your task and your solution become the ground truth a model is scored against, so accuracy is the entire job.