Remote AI Research Scientist — Scientific Evaluation (ML/AI)

Jobgether; Australia; Remote; AUD 69,000 - 90,000; Part time

Benefits offered by this job

Fully remote opportunity

Competitive hourly compensation $50–$-

Freelance / independent contractor

Part-time, project-based work

Flexible hours

Job summary

Partner Company is seeking an AI Research Scientist – Scientific Evaluation (ML/AI) based in Australia for a fully remote, freelance role. You will evaluate AI-generated research papers for scientific rigor, novelty, and reproducibility, using structured evaluation rubrics and independent judgment.

Responsibilities include assessing methodology, validating results, and contributing evidence-based feedback to high-profile ML/AI conferences.

Qualifications

• PhD in ML/AI/CS/Statistics or equivalent.
• At least three peer-reviewed publications at NeurIPS/ICML/ICLR.
• Hands-on ML/AI research experience with published work.
• Ability to assess novelty, significance, and scientific validity.
• Experience reviewing ML/AI conference papers is a plus.

Responsibilities

• Evaluate AI-generated ML/AI research papers for contributions and rigor.
• Assess novelty and significance against state-of-the-art methods.
• Examine experimental design, baselines, metrics, and ablations.
• Identify methodological flaws and unsupported claims.
• Verify reproducibility and examine code when available.
• Check citations and prior work coverage in literature.
• Determine compliance with top ML/AI conference standards.
• Produce structured, evidence-based evaluations with justification.
• Apply rubrics consistently while maintaining independent judgment.
• Provide expert opinions on genuine scientific contributions.

Skills

Analytical skills

Scientific writing

Independent scientific judgment

Attention to detail

Rubrics and evaluation guidelines

Education

PhD in ML/AI/CS/Statistics or equivalent

3+ peer-reviewed publications (NeurIPS/ICML/ICLR)

Job description

Partner Company is seeking an AI Research Scientist – Scientific Evaluation (ML/AI) based in Australia for a fully remote, freelance role. You will evaluate AI-generated research papers for scientific rigor, novelty, and reproducibility, using structured evaluation rubrics and independent judgment.

Responsibilities include assessing methodology, validating results, and contributing evidence-based feedback to high-profile ML/AI conferences.