Biology AI Evaluation Specialist - Remote

Mercor; San Francisco (CA); Remote; USD 96,000 - 145,000; Full time

Job summary

Mercor, headquartered in San Francisco, connects elite creative and technical talent with AI research labs. We seek a Biology Expert contractor to evaluate AI-generated biology content and assess experimental designs for rigor and accuracy.

You will provide structured feedback to AI teams, help develop evaluation rubrics, and collaborate with domain experts to ensure data quality and coverage, while working independently to meet deadlines.

Qualifications

• Graduate degree in Biology or related life science with research experience.
• Clear written communication skills.
• Comfort with ambiguous tasks and willingness to flag unclear instructions.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content in Biology to strengthen reasoning and rigor in model outputs.
• Review model-written experimental designs and interpretations for alignment with domain principles and methodologies.
• Provide clear, structured feedback to AI research teams to improve training data quality and downstream performance.
• Develop evaluation rubrics and benchmarks for assessing AI-generated biological tasks and solutions.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Clear written communication

Comfort with ambiguity

Independent work

Education

Graduate degree in Biology or life science

Job description

Mercor, headquartered in San Francisco, connects elite creative and technical talent with AI research labs. We seek a Biology Expert contractor to evaluate AI-generated biology content and assess experimental designs for rigor and accuracy.

You will provide structured feedback to AI teams, help develop evaluation rubrics, and collaborate with domain experts to ensure data quality and coverage, while working independently to meet deadlines.