Remote AI Research Scientist: Scientific Evaluation Expert

Jobgether; España; Remote; EUR 62,000 - 80,000; Part time

Benefits offered by this job

Fully remote opportunity

Competitive hourly compensation

Freelance/independent contractor

Part-time, project-based

Flexible hours

Job summary

Jobgether seeks an AI Research Scientist – Scientific Evaluation based in Spain for a remote freelance role. You will assess AI research papers for novelty, rigor, and validity, providing structured, evidence-based feedback.

Flexible hours and competitive hourly compensation are offered to candidates with a solid publication record and conference-review experience. Responsibilities include evaluating technical correctness, experimental design, reproducibility, and literature validity, aligning

Qualifications

• PhD in ML/AI/CS/Statistics or equivalent research expertise.
• At least three peer-reviewed publications at NeurIPS, ICML, and/or ICLR.
• Strong hands-on ML/AI research experience with novel methods.
• Ability to independently assess novelty, significance, technical soundness, and scientific validity.
• Experience reviewing research papers for leading ML conferences preferred.
• Excellent analytical and scientific writing abilities.

Responsibilities

• Evaluate AI-generated ML/AI research papers for scientific contributions, technical correctness, methodology, experimental design, and the validity of their conclusions.
• Assess the novelty and significance of proposed approaches by comparing them with existing research and state-of-the-art methods.
• Examine experimental rigor, including baseline comparisons, benchmark selection, evaluation metrics, ablation studies.
• Identify methodological flaws, unsupported claims, inconsistencies, misleading results, and other issues that could compromise scientific validity.
• Assess reproducibility and technical soundness by reviewing experimental evidence, implementation details, and accompanying code when available.
• Verify relevant academic literature, identify overlooked prior work, check citation accuracy, and challenge unsupported novelty claims.
• Determine whether research outputs meet the scientific standards associated with leading ML/AI conferences, including NeurIPS, ICML, and ICLR.
• Produce structured, evidence-based evaluations outlining research strengths, weaknesses, critical technical concerns, and overall scientific merit.
• Apply detailed assessment rubrics consistently while providing clear, concise, and well-reasoned justifications for your evaluations.
• Exercise independent expert judgment when determining whether AI-generated research represents a genuine scientific contribution and is supported by sufficient evidence.

Skills

Machine learning research

Scientific writing

Independent judgement

Analytical thinking

Education

PhD in ML/AI/CS/Statistics

Three peer‑reviewed publications at NeurIPS/ICML/ICLR

Tools

Python

PyTorch

scikit-learn

Job description

Jobgether seeks an AI Research Scientist – Scientific Evaluation based in Spain for a remote freelance role. You will assess AI research papers for novelty, rigor, and validity, providing structured, evidence-based feedback.

Flexible hours and competitive hourly compensation are offered to candidates with a solid publication record and conference-review experience. Responsibilities include evaluating technical correctness, experimental design, reproducibility, and literature validity, aligning