Remote AI Research Scientist - Scientific Evaluation (ML/AI)

Jobgether; South Africa; Remote; ZAR 1,148,000 - 1,493,000; Full time

Benefits offered by this job

Fully remote

Competitive hourly rate

Freelance/IC contract

Part-time, project-based hours

Flexible hours

Global opportunity

Job summary

Jobgether seeks an AI Research Scientist – Scientific Evaluation (ML/AI) for a remote freelance role based in South Africa. You will evaluate AI-generated papers for novelty, correctness, and experimental rigor, applying strict conference standards.

Responsibilities include assessing experimental design, reproducibility, and literature validity, with detailed, evidence-based feedback. Prior independent judgment is essential for high-quality scientific evaluation.

Qualifications

• PhD in ML/AI/CS/Statistics or equivalent.
• 3+ peer-reviewed publications at NeurIPS, ICML and/or ICLR.
• Strong hands-on ML/AI research experience developing methods and experiments.
• Ability to assess novelty, significance, and scientific validity.
• CV and links to at least three qualifying publications required.

Responsibilities

• Evaluate AI/ML research papers for contributions and experimental design.
• Assess novelty and significance against state-of-the-art methods.
• Examine experimental rigor, baselines, metrics, and ablations.
• Identify methodological flaws and unsupported claims.
• Review reproducibility and code when available.
• Verify literature and citation accuracy; challenge novelty claims.
• Determine if outputs meet standards of NeurIPS/ICML/ICLR.
• Provide structured, evidence-based evaluations with justification.
• Apply evaluation rubrics with independent scientific judgment.

Skills

ML research

Experimental design

Statistical validity

Scientific writing

Independent judgment

Code/implementation review

Education

PhD in ML/AI/CS/Statistics or related

3+ peer-reviewed publications at NeurIPS ICML ICLR

Job description

Jobgether seeks an AI Research Scientist – Scientific Evaluation (ML/AI) for a remote freelance role based in South Africa. You will evaluate AI-generated papers for novelty, correctness, and experimental rigor, applying strict conference standards.

Responsibilities include assessing experimental design, reproducibility, and literature validity, with detailed, evidence-based feedback. Prior independent judgment is essential for high-quality scientific evaluation.