Sales Engineering Evaluation Lead

Obsidian; San Francisco (CA); On-site; USD 120,000 - 170,000; Full time

Job summary

Mercor partners with a leading AI research organization to create a role focused on evaluating real-world pre-sales and solutions engineering work. You will define grading criteria and score samples with rigorous written justifications, shaping how excellent technical work is judged.

You will apply consistent, evidence-based judgment, iterating with senior reviewers and providing structured feedback to ensure reproducibility and defensibility of every score.

Qualifications

• 4+ years of relevant experience as a Sales Engineer, Solutions Engineer, or similar.
• Deep fluency in pre-sales: discovery, product solutions, demos, and proofs of concept.
• Experience with complex B2B SaaS, cloud, cybersecurity, data platforms or enterprise apps.
• Exceptional written communication able to justify technical judgments.
• Detail-oriented with peer-review calibration experience is a plus.

Responsibilities

• Design precise, task-specific grading criteria for real-world pre-sales deliverables.
• Score AI-generated and human work samples with detailed written justifications.
• Apply consistent, evidence-based judgment so scores are reproducible.
• Incorporate structured feedback from senior reviewers and iterate quickly.

Skills

Sales engineering

Pre-sales

Technical discovery

Demos

Written communication

Job description

Mercor partners with a leading AI research organization to create a role focused on evaluating real-world pre-sales and solutions engineering work. You will define grading criteria and score samples with rigorous written justifications, shaping how excellent technical work is judged.

You will apply consistent, evidence-based judgment, iterating with senior reviewers and providing structured feedback to ensure reproducibility and defensibility of every score.