AI Research Evaluator: Scientific Rigor (Remote)

Jobgether; Italia; Remote; EUR 62.000 - 80.000; Vollzeit

Benefits dieser Stelle

Fully remote

Contract-based freelance

Flexible hours

Competitive hourly rate

Work on frontier AI research

Worldwide applicants welcome

Zusammenfassung

Jobgether is seeking an AI Research Scientist – Scientific Evaluation to remotely evaluate AI research papers with rigorous rubrics. You will assess novelty, methodology, reproducibility, and scientific validity for top-tier conferences, working independently as part of a freelance project.

The role offers flexible hours, international collaboration, and competitive hourly compensation, with emphasis on high-quality, evidence-based feedback and independent scientific judgment.

Qualifikationen

• PhD in ML/AI, CS, stats or related field.
• At least three peer-reviewed papers at NeurIPS/ICML/ICLR.
• Experience reviewing ML/AI conference papers is preferred.
• Strong analytical and scientific writing skills.
• Ability to work independently with evaluation rubrics.
• CV and links to at least three qualifying publications required.

Aufgaben

• Critically evaluate AI-generated ML/AI research papers for contributions and validity.
• Assess novelty, significance, and relation to state-of-the-art methods.
• Examine experimental design, baselines, metrics, and reproducibility.
• Identify flaws, unsupported claims, and methodological gaps.
• Review evidence, implementation details, and code when available.
• Compare against literature and benchmark benchmarks.
• Provide structured, evidence-based evaluations with clear justifications.
• Apply rubrics consistently while maintaining independent judgment.

Kenntnisse

Analytical thinking

Academic writing

Critical evaluation

Independent judgment

Peer-review familiarity

English proficiency

Ausbildung

PhD in ML/AI or related field

Jobbeschreibung

Jobgether is seeking an AI Research Scientist – Scientific Evaluation to remotely evaluate AI research papers with rigorous rubrics. You will assess novelty, methodology, reproducibility, and scientific validity for top-tier conferences, working independently as part of a freelance project.

The role offers flexible hours, international collaboration, and competitive hourly compensation, with emphasis on high-quality, evidence-based feedback and independent scientific judgment.