HR Knowledge Quality Analyst - AI Tools Evaluator

Mercor Enterprise

United States

Remote

USD 90,000 - 130,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor Enterprise is seeking an experienced HR practitioner to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks. You will judge source grounding, permission handling, content freshness, and root causes of failures.

The role requires hands-on work with Workday HCM as an end user and regular use of an enterprise search/AI tool. Ideal candidates operate in a tech environment and have verified HR expertise beyond consulting.

Qualifications

5+ years of active HR practice with demonstrated expertise in a specific HR domain.
Currently in an HR, People Ops, Payroll, or HR Systems role at a technology company (software/SaaS, internet, hardware, semiconductors, or similar).
Regular hands-on use of at least one enterprise search or workplace AI assistant (e.g., Glean, Workday Assistant, Sana, Microsoft 365 Copilot / SharePoint search, Guru, Coveo, Moveworks, ServiceNow AI Search).
Hands-on experience using Workday HCM as an end user (not configuration-only training).
Not primarily a power user or administrator of only Sana or only Glean.

Responsibilities

Evaluate answers from enterprise search / workplace AI tools on HR topics within your area of expertise.
Judge whether answers are tied to sources and cite them correctly.
Assess whether results respect each user's access permissions.
Identify stale or conflicting content across knowledge sources.
Distinguish retrieval misses from reasoning errors.