Remote Mathematician - AI Model Evaluator & Problem Designer

SOA

United States

Remote

USD 55,000 - 172,000

Part time

11 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible project selection
Own schedule
Remote work from home
Hourly pay up to $40-$125 USD with on‑
Bonuses on high-quality work

Job summary

DataAnnotation is seeking a Mathematician - AI Model Evaluator to design challenging mathematical problems that current AI models still struggle with. You will judge correctness versus plausibility and build the tooling to prove it in a research-focused, remote role.

You will design, test, and validate complex tasks, ensuring accuracy as ground truth for model scoring. Strong math stats background and coding ability are essential.

Qualifications

  • Fluent in English, native or bilingual level.
  • Active research background in mathematics or statistics at graduate/postdoc/academic or industry level.
  • Strong coding skills; comfortable using a terminal and Python for research.

Responsibilities

  • Design complex mathematical tasks for AI evaluation.
  • Define correct answers and required standards for model evaluation.
  • Test, validate, and document tasks so others can reproduce results.
  • Write clear, step-by-step solutions that can be reviewed by researchers.
  • Identify where model reasoning breaks and flag invalid steps or unjustified conclusions.
  • Collaborate across numerical analysis, optimization, probability and statistics, and ML domains.

Skills

English fluency
Coding proficiency

Education

Active research background in mathematics or statistics

Tools

Python
Docker

Job description

DataAnnotation is seeking a Mathematician - AI Model Evaluator to design challenging mathematical problems that current AI models still struggle with. You will judge correctness versus plausibility and build the tooling to prove it in a research-focused, remote role.

You will design, test, and validate complex tasks, ensuring accuracy as ground truth for model scoring. Strong math stats background and coding ability are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Mathematical Modeler & AI Reasoning Trainer
Remote Mathematical Modeler & AI Reasoning Trainer

DataAnnotation • Town of Montana (WI)

Remote
USD 55,000 - 172,000
Flexible work
Remote work
Project-based workload
Mathematician - AI Model Evaluator
Mathematician - AI Model Evaluator

SOA • United States

Remote
USD 55,000 - 172,000
Remote Mathematician for AI Reasoning & Proof Crafting
Remote Mathematician for AI Reasoning & Proof Crafting

DataAnnotation • United States

Remote
USD 55,000 - 172,000
Flexible schedule
Remote work
Remote AI Math Referee & Problem Designer
Remote AI Math Referee & Problem Designer

DataAnnotation • Delaware

Remote
USD 138,000 - 172,000
Remote work
Mathematician - AI Model Evaluator (opens in new tab)
Mathematician - AI Model Evaluator (opens in new tab)

SOA • United States

Remote
USD 55,000 - 172,000
Flexible project selection
Own schedule
Remote work from home
+2
Remote Math Modeler & AI Proof Reviewer
Remote Math Modeler & AI Proof Reviewer

DataAnnotation • Colorado

Remote
USD 55,000 - 172,000
Flexible, remote work
Project-based engagement
Mathematician for AI Reasoning & Ground-Truth Tasks
Mathematician for AI Reasoning & Ground-Truth Tasks

DataAnnotation • United States

Remote
CAD 78,000 - 243,000
Choose projects and schedule
Work from home on your own computer
Pay per hour USD 40–125 with bonuses
AI Math Reasoner & Proof Expert (Remote)
AI Math Reasoner & Proof Expert (Remote)

DataAnnotation • Alabama

Remote
USD 55,000 - 172,000
Remote work
Flexible hours
Performance-based pay
Remote AI Math Problem Designer & Model Evaluator
Remote AI Math Problem Designer & Model Evaluator

RemoExperts • United States

Remote
USD 103,000 - 172,000
Remote AI Reasoning Mathematician & Proof Architect
Remote AI Reasoning Mathematician & Proof Architect

DataAnnotation • Idaho

Remote
USD 55,000 - 172,000
Remote work
Project-based assignments