Mercor Enterprise · via Mercor

Knowledge Management Expert

Remote · Contract · $70-90/hr

Many AI evaluation platforms screen applicants with a qualification test or interview. Module 1 of our AI Evaluator Certification is a free introduction to the judgment those screens look for.

Start the free module

Posted by Mercor Enterprise. Annotation Academy is not the employer; apply on Mercor's site.

About the role

Mercor is seeking experienced HR practitioners at technology companies to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks. You will grade how well these tools answer real HR questions—judging source grounding, permission handling, content freshness, and the root cause of failures.

What you'll do

  • Evaluate answers from enterprise search / workplace AI tools on HR topics within your area of expertise

  • Judge whether answers are tied to sources and cite them correctly

  • Assess whether results respect each user's access permissions

  • Identify stale or conflicting content across knowledge sources

  • Distinguish retrieval misses from reasoning errors

Requirements

  • 5+ years of active HR practice with demonstrated expertise in a specific HR domain

  • Currently in an HR, People Ops, Payroll, or HR Systems role at a technology company (software/SaaS, internet, hardware, semiconductors, or similar)

  • Regular hands-on use of at least one enterprise search or workplace AI assistant (e.g., Glean, Workday Assistant, Sana, Microsoft 365 Copilot / SharePoint search, Guru, Coveo, Moveworks, ServiceNow AI Search)

  • Hands-on experience using Workday HCM as an end user (not configuration-only training)

  • Not primarily a power user or administrator of only Sana or only Glean

Preferred qualifications

  • Experience owning or curating HR knowledge content (policy pages, HR help-center articles, FAQ libraries) in Confluence, ServiceNow KB, Workday Help, or similar

  • Currently an active HR practitioner rather than consultant-only

  • SHRM-CP, SHRM-SCP, PHR, or SPHR certification

  • Workday Pro certifications in relevant modules

Listing sourced from Mercor. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.