Corpshore AI · via Corpshore AI
RLHF Preference Annotator
Remote, Philippines · Contract · Posted Jul 1, 2026 · Still listed Nov 20, 2026 · $7-14/hr
Many AI evaluation platforms screen applicants with a qualification test or interview. Module 1 of our AI Evaluator Certification is a free introduction to the judgment those screens look for.
Start the free modulePosted by Corpshore AI. Annotation Academy is not the employer; apply on Corpshore AI's site.
Compare and rank model outputs against a rubric to produce preference data for LLM alignment.
- Rank model responses to a rubric
- Write rationale for preferences
- Participate in calibration rounds
Listing sourced from Corpshore AI. Annotation Academy is independent of these platforms and does not guarantee work or pay. See our disclosures.