Senior HR Reviewer for AI-Driven Assessments

Mercor

United States

Remote

USD 108,000 - 154,000

Part time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking experienced HR professionals to build and review evaluation tasks for AI agents in a realistic simulated company environment. You will ensure prompts read like authentic HR requests, verify reference answers against source records, and craft precise grading rubrics for pass/fail criteria with clear judgment calls.

The role spans talent acquisition, onboarding, performance management, compensation, benefits and leave, employee relations, investigations, and compliance, requiring

Qualifications

  • 3+ years of HR experience.
  • Bachelor's degree in human resources, business or related field.
  • Experience with employment law (Title VII, FLSA, ADA) or equivalents.
  • SHRM-SCP / SPHR preferred.

Responsibilities

  • Refine AI-drafted task prompts so they read like a real request from an HR director or manager, without giving the answer away.
  • Check the reference answer against the world's files and app records, and correct what is wrong.
  • Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss.
  • Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
  • Work across talent acquisition and onboarding, performance management and succession, compensation, benefits and leave, employee relations and workplace investigations, separations, HR policy and employment‑law compliance, people analytics, and organization design.

Skills

HR experience
Leadership experience
Talent programs ownership

Education

Bachelor's degree in HR or related field

Job description

Mercor is seeking experienced HR professionals to build and review evaluation tasks for AI agents in a realistic simulated company environment. You will ensure prompts read like authentic HR requests, verify reference answers against source records, and craft precise grading rubrics for pass/fail criteria with clear judgment calls.

The role spans talent acquisition, onboarding, performance management, compensation, benefits and leave, employee relations, investigations, and compliance, requiring

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior HR Evaluations Architect (AI Tasks)
Senior HR Evaluations Architect (AI Tasks)

Tech Faculty • United States

Remote
USD 108,000 - 154,000
Remote AI HR Specialist: Task Design & Evaluation
Remote AI HR Specialist: Task Design & Evaluation

AI Work Expert • United States

Remote
USD 108,000 - 154,000
HR Expert
HR Expert

Tech Faculty • United States

Remote
USD 108,000 - 154,000
HR Expert
HR Expert

Mercor • United States

Remote
USD 108,000 - 154,000
Senior AI Task Auditor & Accounting Reviewer
Senior AI Task Auditor & Accounting Reviewer

Tech Faculty • United States

Remote
USD 108,000 - 154,000
HR Specialist – AI Evaluation & Task Design (Remote)
HR Specialist – AI Evaluation & Task Design (Remote)

Synthires • United States

Remote
USD 108,000 - 154,000
Short onboarding session
Paid skills assessment
Growth opportunities to reviewer/world
HR Expert
HR Expert

AI Work Expert • United States

Remote
USD 108,000 - 154,000
People Ops & AI Quality Evaluator (Remote Contract)
People Ops & AI Quality Evaluator (Remote Contract)

Mercor • San Francisco (CA)

Hybrid
GBP 83,000 - 125,000
Hr Leader - Fully Remote | Upto $80/Hr
Hr Leader - Fully Remote | Upto $80/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 72,000 - 82,000
Recruiting Evaluator - Fully Remote | Upto $120/Hr
Recruiting Evaluator - Fully Remote | Upto $120/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 82,000 - 123,000