AI Science Document Evaluator - Remote Contract

mercor; San Francisco (CA); Hybrid; CAD 29,000 - 39,000; Part time

Job summary

Mercor is seeking a contract specialist in Applied Sciences for Visual Document Understanding. You will evaluate AI-generated content in Physics, Chemistry and Biology, focusing on accuracy, depth, and rigorous reasoning, while working remotely for 15–20 hours per week.

Collaborate with AI research teams to develop evaluation rubrics, provide structured feedback, and help improve training data quality and downstream model performance.

Qualifications

• Expertise in Physics, Chemistry, or Biology.
• Experience in AI model evaluation.
• Strong analytical and problem-solving skills.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content in Physics, Chemistry, and Biology to strengthen reasoning and rigor in model outputs.
• Review complex scientific documents for alignment with domain principles and methodologies.
• Provide clear, structured feedback to AI research teams to improve training data quality and downstream performance.
• Develop evaluation rubrics and benchmarks for assessing AI-generated scientific tasks and solutions.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Physics

Chemistry

Biology

Job description

Mercor is seeking a contract specialist in Applied Sciences for Visual Document Understanding. You will evaluate AI-generated content in Physics, Chemistry and Biology, focusing on accuracy, depth, and rigorous reasoning, while working remotely for 15–20 hours per week.

Collaborate with AI research teams to develop evaluation rubrics, provide structured feedback, and help improve training data quality and downstream model performance.