Corpshore AI · via Corpshore AI

RLHF Preference Annotator

Remote, Philippines · Contract · Posted Jul 1, 2026 · Still listed Nov 20, 2026 · $7-14/hr

Many AI evaluation platforms screen applicants with a qualification test or interview. Module 1 of our AI Evaluator Certification is a free introduction to the judgment those screens look for.

Start the free module

Posted by Corpshore AI. Annotation Academy is not the employer; apply on Corpshore AI's site.

Compare and rank model outputs against a rubric to produce preference data for LLM alignment.

  • Rank model responses to a rubric
  • Write rationale for preferences
  • Participate in calibration rounds

Listing sourced from Corpshore AI. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.