Remote Study Domain Expert - Judge Calibration (Sales Ops)

AI Trainer Jobs; United States; Remote; USD 102,000 - 146,000; Full time

Job summary

AI Trainer Jobs is seeking a Study Domain Expert — Judge Calibration — Sales for a remote contractor role. Review AI outputs across sales operations workflows, grade tone, escalation logic, and stakeholder fit, and document the next steps to inform model training.

Responsibilities include flagging policy-adherence gaps, analyzing rubrics, and adjudicating disputes against firm guidance. Flexible, async availability is valued.

Qualifications

• Direct working experience in sales operations on real teams.
• Clear written reasoning naming the policy or workflow applied.
• Ability to apply multi-page rubrics consistently.

Responsibilities

• Review AI outputs against sales operations workflows, playbooks, and firm policy.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.

Job description

AI Trainer Jobs is seeking a Study Domain Expert — Judge Calibration — Sales for a remote contractor role. Review AI outputs across sales operations workflows, grade tone, escalation logic, and stakeholder fit, and document the next steps to inform model training.

Responsibilities include flagging policy-adherence gaps, analyzing rubrics, and adjudicating disputes against firm guidance. Flexible, async availability is valued.