Machine Learning Evaluator | Remote

Crossing Hurdles

La Réunion

Remote

EUR 155,000 - 220,000

Part time

33 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Crossing Hurdles is seeking Subject Matter Experts to evaluate machine learning model outputs on an hourly contract. You will rate AI responses for accuracy and relevance and provide written justifications for scores.

The work is remote and expected to require about five hours, completed asynchronously. The ideal candidate has strong analytical skills, attention to detail, and experience reading and evaluating technical research content.

Qualifications

  • Proven ability to evaluate complex technical or research content.
  • Strong analytical and critical thinking abilities are essential.
  • Detail-oriented with the ability to justify evaluation scores in writing.
  • ML PhD researchers published in top venues are encouraged to apply.

Responsibilities

  • Review ML model outputs in response to research prompts.
  • Rate AI responses for accuracy, relevance, and factual correctness using a structured system.
  • Provide clear written justifications for evaluation scores.

Skills

Critical thinking
Analytical skills
Attention to detail
Reading comprehension
ML PhD preferred

Job description

Position: Subject Matter Experts: Machine Learning Model Evaluation

Type: Hourly Contract

Compensation: $150/hr

Location: Remote

Commitment: The project involves approximately five hours of independent work, which you can complete asynchronously.

Role Responsibilities
  • Review machine learning model outputs generated in response to research prompts.
  • Rate AI-generated responses for accuracy, relevance, and factual correctness using a structured rating system.
  • Provide clear written justifications for evaluation scores.
Requirements
  • Professional or academic expertise in a specialized domain.
  • Strong critical thinking, analytical skills, and attention to detail.
  • Comfortable reading and assessing complex technical or research-focused text; experience evaluating technical content or research data is welcome.
  • ML PhD researchers published at NeurIPS, ICML, ICLR, COLM, or RLC are especially encouraged to apply.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote ML Model Evaluator - Expert Research Review
Remote ML Model Evaluator - Expert Research Review

Crossing Hurdles • La Réunion

Remote
EUR 155,000 - 220,000
Quality Evaluator – Fluent English (Europe & LATAM)
Quality Evaluator – Fluent English (Europe & LATAM)

Anyone AI • Paris

Remote
EUR 8,600 - 15,000
Machine Learning Experts - PhD - AI Training - France
Machine Learning Experts - PhD - AI Training - France

Prolific • France

Remote
EUR 147,741 - 210,419
JavaScript Developer | Remote
JavaScript Developer | Remote

Crossing Hurdles • France

Remote
EUR 152,000 - 217,000
Software Engineer (Python/C++) – Code Evaluation | Remote
Software Engineer (Python/C++) – Code Evaluation | Remote

Crossing Hurdles • France

Remote
EUR 61,000 - 184,000
Machine Learning Engineer
Machine Learning Engineer

Alignerr Corp. • France

Remote
EUR 62,000 - 87,000
Autonomy
Flexibility
Global collaboration
Remote English Quality Evaluator for AI Training
Remote English Quality Evaluator for AI Training

Anyone AI Inc. • Paris

Remote
EUR 8,600 - 15,000
Machine Learning Research Scientist
Machine Learning Research Scientist

IXO Inc. • France

Remote
EUR 127,000 - 171,000
Freelance Machine Learning Research Engineer (Python)
Freelance Machine Learning Research Engineer (Python)

Mindrift • Paris

Remote
EUR 58,180 - 67,489
Competitive pay up to $58/hour
Part-time, flexible commitment
Experience with advanced AI projects
Evaluation Engineer, Applied AI
Evaluation Engineer, Applied AI

Mistral • Paris

On-site
EUR 90,000 - 130,000
Healthcare coverage
Parental leave
Retirement plans
+3