Remote AI Research Consultant — Evaluation (Contract)

mercor; United States; Remote; USD 55,000 - 96,000; Full time

Job summary

Mercor, headquartered in San Francisco, seeks a Generalist Search Expert for a remote contract role. You will evaluate AI-generated content to strengthen reasoning and rigor in model outputs, review complex material for alignment with domain principles, and provide structured feedback to AI research teams.

Additionally, you will develop evaluation rubrics and benchmarks, collaborate with subject matter experts to ensure coverage across datasets, and work independently to meet deadlines while

Qualifications

• Strong research background in any domain.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content to strengthen reasoning and rigor in model outputs.
• Review complex content for alignment with domain principles and methodologies.
• Provide clear, structured feedback to AI research teams to improve training data quality and downstream performance.
• Develop evaluation rubrics and benchmarks for assessing AI-generated tasks and solutions.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Strong research background

Job description

Mercor, headquartered in San Francisco, seeks a Generalist Search Expert for a remote contract role. You will evaluate AI-generated content to strengthen reasoning and rigor in model outputs, review complex material for alignment with domain principles, and provide structured feedback to AI research teams.

Additionally, you will develop evaluation rubrics and benchmarks, collaborate with subject matter experts to ensure coverage across datasets, and work independently to meet deadlines while