Sales Engineering Quality Architect

Mercor; San Francisco (CA); Remote; USD 90,000 - 150,000; Full time

Job summary

Mercor is partnering with a leading AI research organization to evaluate how well AI systems perform real-world technical sales work. You will define what excellent work looks like: creating grading criteria and scoring samples with rigorous written justifications.

This role emphasizes objective, evidence‑based scoring and iteration based on feedback from senior reviewers to ensure reproducible results.

Qualifications

• 4+ years of relevant experience in sales engineering or pre‑sales roles.
• Deep fluency in pre‑sales: discovery, translating requirements into solutions, tailored demos.
• Experience with technically complex B2B SaaS/cloud/cybersecurity/data platforms/tools.
• Excellent written communication with ability to justify technical/business outcomes.

Responsibilities

• Design precise, task‑specific grading criteria for real‑world pre‑sales and solutions‑engineering deliverables.
• Score AI‑generated and human work samples with detailed written justifications for every score.
• Apply consistent, evidence‑based judgment so scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

Skills

Sales engineering

Technical sales

Written communication

Job description

Mercor is partnering with a leading AI research organization to evaluate how well AI systems perform real-world technical sales work. You will define what excellent work looks like: creating grading criteria and scoring samples with rigorous written justifications.

This role emphasizes objective, evidence‑based scoring and iteration based on feedback from senior reviewers to ensure reproducible results.