Knowledge Management Expert
Remote · Contract · $70-90/hr
Is Mercor legit? Read our evidence-based Mercor review.
Many AI evaluation platforms screen applicants with a qualification test or interview. Module 1 of our AI Evaluator Certification is a free introduction to the judgment those screens look for.
Start the free modulePosted by Mercor Enterprise. Annotation Academy is not the employer; apply on Mercor's site.
About the role
Mercor is seeking experienced HR practitioners at technology companies to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks. You will grade how well these tools answer real HR questions—judging source grounding, permission handling, content freshness, and the root cause of failures.
What you'll do
Evaluate answers from enterprise search / workplace AI tools on HR topics within your area of expertise
Judge whether answers are tied to sources and cite them correctly
Assess whether results respect each user's access permissions
Identify stale or conflicting content across knowledge sources
Distinguish retrieval misses from reasoning errors
Requirements
5+ years of active HR practice with demonstrated expertise in a specific HR domain
Currently in an HR, People Ops, Payroll, or HR Systems role at a technology company (software/SaaS, internet, hardware, semiconductors, or similar)
Regular hands-on use of at least one enterprise search or workplace AI assistant (e.g., Glean, Workday Assistant, Sana, Microsoft 365 Copilot / SharePoint search, Guru, Coveo, Moveworks, ServiceNow AI Search)
Hands-on experience using Workday HCM as an end user (not configuration-only training)
Not primarily a power user or administrator of only Sana or only Glean
Preferred qualifications
Experience owning or curating HR knowledge content (policy pages, HR help-center articles, FAQ libraries) in Confluence, ServiceNow KB, Workday Help, or similar
Currently an active HR practitioner rather than consultant-only
SHRM-CP, SHRM-SCP, PHR, or SPHR certification
Workday Pro certifications in relevant modules
Listing sourced from Mercor. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.