Remote Contract: AI Evaluation Specialist - Domain Expert

Mercor; San Francisco (CA); Hybrid; GBP 41,000 - 72,000; Full time

Job summary

Mercor is seeking a Generalist Search Expert on a remote contract basis to evaluate AI-generated content for accuracy and depth, strengthening the reasoning and rigor of model outputs.

You will review complex material across domains, provide structured feedback to AI research teams, and develop evaluation rubrics. This role requires independent, asynchronous work to meet deadlines while improving AI model performance.

Qualifications

• Strong research background in any domain.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content to strengthen reasoning and rigor in model outputs.
• Review complex content for alignment with domain principles and methodologies.
• Provide clear, structured feedback to AI research teams to improve training data quality and downstream performance.
• Develop evaluation rubrics and benchmarks for assessing AI-generated tasks and solutions.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Research background

Job description

Mercor is seeking a Generalist Search Expert on a remote contract basis to evaluate AI-generated content for accuracy and depth, strengthening the reasoning and rigor of model outputs.

You will review complex material across domains, provide structured feedback to AI research teams, and develop evaluation rubrics. This role requires independent, asynchronous work to meet deadlines while improving AI model performance.