Senior HR Evaluations Architect (AI Tasks)

Tech Faculty

United States

Remote

USD 108,000 - 154,000

Full time

18 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is seeking experienced HR professionals to build and review evaluation tasks for AI agents in a realistic simulated company environment. You will refine prompts, verify references, and craft precise rubrics to ensure fair, defensible grading aligned with HR standards.

Ideal candidates have 3+ years in HR, a related bachelor’s degree, and solid knowledge of employment law; SHRM-SCP/SPHR preferred. Onboarding includes a paid skills assessment, with progression to reviewer and world lead

Qualifications

  • 3+ years of HR experience in a leadership context.
  • Bachelor’s degree in HR, business or related field.
  • Knowledge of employment law (Title VII, FLSA, ADA or UK/EU equivalents).
  • SHRM-SCP, SPHR or international equivalent preferred.
  • Mercor RL project experience is a plus.

Responsibilities

  • Refine AI-drafted task prompts to read like a real request from an HR director or manager.
  • Check the reference answer against source records and correct errors.
  • Write and tighten grading rubrics with exact criteria and judgment calls.
  • Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
  • Collaborate across talent acquisition, onboarding, performance management, compensation, benefits and leave, employee relations and workplace investigations.

Skills

HR experience
Leadership
Employment law knowledge

Education

Bachelor's degree in HR or related field

Job description

Mercor is seeking experienced HR professionals to build and review evaluation tasks for AI agents in a realistic simulated company environment. You will refine prompts, verify references, and craft precise rubrics to ensure fair, defensible grading aligned with HR standards.

Ideal candidates have 3+ years in HR, a related bachelor’s degree, and solid knowledge of employment law; SHRM-SCP/SPHR preferred. Onboarding includes a paid skills assessment, with progression to reviewer and world lead

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior HR Reviewer for AI-Driven Assessments
Senior HR Reviewer for AI-Driven Assessments

Mercor • United States

Remote
USD 108,000 - 154,000
Remote AI HR Specialist: Task Design & Evaluation
Remote AI HR Specialist: Task Design & Evaluation

AI Work Expert • United States

Remote
USD 108,000 - 154,000
HR Expert
HR Expert

Tech Faculty • United States

Remote
USD 108,000 - 154,000
HR Expert
HR Expert

Mercor • United States

Remote
USD 108,000 - 154,000
HR Specialist – AI Evaluation & Task Design (Remote)
HR Specialist – AI Evaluation & Task Design (Remote)

Synthires • United States

Remote
USD 108,000 - 154,000
Short onboarding session
Paid skills assessment
Growth opportunities to reviewer/world
Human Resources Specialist (Remote | $95/hr)
Human Resources Specialist (Remote | $95/hr)

Synthires • United States

Remote
USD 108,000 - 154,000
Short onboarding session
Paid skills assessment
Growth opportunities to reviewer/world
Remote HR & People Ops Expert for AI Evaluation Projects
Remote HR & People Ops Expert for AI Evaluation Projects

Elitebrain • Florida

Remote
USD 62,000 - 124,000
HR & AI Evaluation Specialist (Remote, Part-Time)
HR & AI Evaluation Specialist (Remote, Part-Time)

OpenTrain AI, Inc. • United States

Remote
USD 85,000 - 121,000
Remote HR & People Ops Expert for AI Evaluation Projects
Remote HR & People Ops Expert for AI Evaluation Projects

Undisclosed • United States

Remote
USD 62,000 - 124,000
Remote work
AI HR Evaluator & Training Scenarios (Remote, Flexible)
AI HR Evaluator & Training Scenarios (Remote, Flexible)

Prolific • United States

Remote
USD 57,000 - 81,000
PayPal payments
Flexible remote work