HR Expert: AI Knowledge Quality Auditor

Mercor; New York (NY); Remote; USD 110,000 - 170,000; Full time

Job summary

Mercor is seeking experienced HR practitioners at technology companies to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks. You will grade how well these tools answer HR questions, judging source grounding, permission handling, content freshness, and root causes of failures.

You will evaluate answers from enterprise search tools, cite sources, ensure user access controls, and identify stale content across knowledge sources.

Qualifications

• 5+ years of active HR practice with demonstrated expertise in a specific HR domain.
• Currently in an HR, People Ops, Payroll, or HR Systems role at a technology company (software/SaaS, internet, hardware, semiconductors, or similar).
• Regular hands-on use of at least one enterprise search or workplace AI assistant (e.g., Glean, Workday Assistant, Sana, Microsoft 365 Copilot / SharePoint search, Guru, Coveo, Moveworks, ServiceNow AI Search).
• Hands-on experience using Workday HCM as an end user (not configuration-only training).
• Not primarily a power user or administrator of only Sana or only Glean.

Responsibilities

• Evaluate answers from enterprise search / workplace AI tools on HR topics within your area of expertise.
• Judge whether answers are tied to sources and cite them correctly.
• Assess whether results respect each user's access permissions.
• Identify stale or conflicting content across knowledge sources.
• Distinguish retrieval misses from reasoning errors.

Skills

HR practitioner

Workday HCM

HR systems

Enterprise search

AI tools

Tools

Glean

Workday Assistant

Sana

Microsoft 365 Copilot

ServiceNow KB

Job description

Mercor is seeking experienced HR practitioners at technology companies to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks. You will grade how well these tools answer HR questions, judging source grounding, permission handling, content freshness, and root causes of failures.

You will evaluate answers from enterprise search tools, cite sources, ensure user access controls, and identify stale content across knowledge sources.