ML/AI Research Evaluator - Top Conference Quality (Remote)

Lightly; United States; Remote; USD 83,000 - 152,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Job summary

Lightly AG, a Zurich-based AI company, is looking for experienced ML/AI researchers with top-tier publication records to support an advanced AI research evaluation project.

You’ll critically assess AI-generated ML/AI research papers, evaluate their scientific validity, novelty, and experimental rigor against NeurIPS/ICML/ICLR standards. This remote, project-based contractor role offers flexible hours.

Qualifications

• PhD in ML/AI/CS or related field.
• 3+ peer-reviewed papers at NeurIPS/ICML/ICLR.
• Hands-on ML/AI research experience with method development and experiments.
• Strong understanding of scientific methodology, baselines, statistics, ablations, reproducibility.
• Ability to assess novelty and technical soundness independently.
• Experience reviewing papers for top conferences is preferred.
• Familiarity with state-of-the-art ML/AI research and benchmarks.
• Strong analytical and scientific writing skills.
• Ability to apply evaluation guidelines and provide evidence-based feedback.
• Attention to detail in identifying flaws and inconsistencies.

Responsibilities

• Critically evaluate AI-generated ML/AI research papers for contributions and rigor.
• Assess novelty, significance, and relation to state-of-the-art.
• Evaluate experimental design, baselines, metrics, ablations.
• Identify methodological flaws and unsupported claims.
• Verify reproducibility and availability of code/details.
• Review relevant literature and citations for accuracy.
• Judge whether research meets top-tier conference standards.
• Provide structured, evidence-based feedback with clear justifications.

Skills

Peer-reviewed publications (3+) at Ne

Hands-on ML/AI research experience

Experimental design and analysis

Reproducibility and scientific rigor

Scientific writing

Experience reviewing papers for top

Knowledge of state-of-the-art ML/AI

Independent expert judgment

Attention to detail

Education

PhD in Machine Learning / AI / CS / Statistics

Job description

Lightly AG, a Zurich-based AI company, is looking for experienced ML/AI researchers with top-tier publication records to support an advanced AI research evaluation project.

You’ll critically assess AI-generated ML/AI research papers, evaluate their scientific validity, novelty, and experimental rigor against NeurIPS/ICML/ICLR standards. This remote, project-based contractor role offers flexible hours.