What You'll Learn

The skills the work actually rewards

These are the core skills an AI evaluator uses every day, taught from the ground up. No coding, no AI background, and no jargon to get started.

Companies hiring800+rolesView all
MercorDermatologist, U.S. Licensed$270/hrMicro1Litigation Associate Attorney (BigLaw Firms)$140-400/hrMercorGeneralist$80-160/hrMercorPhysician Talent Network$110-250/hrMicro1Data Scientist$245-280/hrMercorMachine Learning Engineer Talent Network$70-250/hrMicro1Senior Journalist / Writer$245-280/hrMercorConsultant / Advisor$80-160/hrMercorSenior Design Expert - Paid AI Design Research Study$150-250/hrMicro1PhD & Academic Expert$245-280/hrMercorPharma Commercial Forecasting Expert — Launch Curves$130-210/hrMicro1Management Consultant$245-280/hrMercorJob Seeker - New Grad$80-160/hrMercorPayer & Market Access Expert — Gross-to-Net & Formulary Strategy$175-200/hrMicro1Investment & Finance Expert$245-280/hrMercorUK-Based MBB and Top-Tier Strategy Consulting Experts$140-200/hrMicro1QA Engineer$90-175/hrMercorMS Excel / Google Sheets Evaluator$80-150/hrMercorUK-Based Sales Experts$140-200/hrMicro1UI / Visual Designer Specialist$90-140/hrMercorUK-Based Data Engineering Experts$140-200/hrMicro1Computer Systems Analyst$60-120/hrMercorDocument/deck production QA Evaluator$80-120/hrMercorTherapeutic Area & Clinical Survey Expert$200/hrMicro1Hospitalist Physician$70-100/hrMercorMultilingual Primary Care Physician (MD) — Clinical Documentation & AI Evaluation$170-190/hrMicro1Creative & Design Specialist$30-100/hrMercorUser/customer research and feedback synthesis Evaluator$80-120/hrMercorFinancial Analyst Talent Network$60-180/hrMicro1Humanities Evaluation Specialist$40-90/hrMercorPro Bono Counsel (Access to Justice Expert)$170/hrMicro1Music & Sound Annotation Expert$30-45/hrMicro1Generalist$50-90/hrMercorBiostatistician$120-170/hrMercorMultilingual Inpatient Hospitalist (MD) — Clinical Documentation & AI Evaluation$170/hrMercorGeneralist Expert (UK/Europe)$50-70/hrMercorDermatologist, U.S. Licensed$270/hrMicro1Litigation Associate Attorney (BigLaw Firms)$140-400/hrMercorGeneralist$80-160/hrMercorPhysician Talent Network$110-250/hrMicro1Data Scientist$245-280/hrMercorMachine Learning Engineer Talent Network$70-250/hrMicro1Senior Journalist / Writer$245-280/hrMercorConsultant / Advisor$80-160/hrMercorSenior Design Expert - Paid AI Design Research Study$150-250/hrMicro1PhD & Academic Expert$245-280/hrMercorPharma Commercial Forecasting Expert — Launch Curves$130-210/hrMicro1Management Consultant$245-280/hrMercorJob Seeker - New Grad$80-160/hrMercorPayer & Market Access Expert — Gross-to-Net & Formulary Strategy$175-200/hrMicro1Investment & Finance Expert$245-280/hrMercorUK-Based MBB and Top-Tier Strategy Consulting Experts$140-200/hrMicro1QA Engineer$90-175/hrMercorMS Excel / Google Sheets Evaluator$80-150/hrMercorUK-Based Sales Experts$140-200/hrMicro1UI / Visual Designer Specialist$90-140/hrMercorUK-Based Data Engineering Experts$140-200/hrMicro1Computer Systems Analyst$60-120/hrMercorDocument/deck production QA Evaluator$80-120/hrMercorTherapeutic Area & Clinical Survey Expert$200/hrMicro1Hospitalist Physician$70-100/hrMercorMultilingual Primary Care Physician (MD) — Clinical Documentation & AI Evaluation$170-190/hrMicro1Creative & Design Specialist$30-100/hrMercorUser/customer research and feedback synthesis Evaluator$80-120/hrMercorFinancial Analyst Talent Network$60-180/hrMicro1Humanities Evaluation Specialist$40-90/hrMercorPro Bono Counsel (Access to Justice Expert)$170/hrMicro1Music & Sound Annotation Expert$30-45/hrMicro1Generalist$50-90/hrMercorBiostatistician$120-170/hrMercorMultilingual Inpatient Hospitalist (MD) — Clinical Documentation & AI Evaluation$170/hrMercorGeneralist Expert (UK/Europe)$50-70/hr

Third-party listings. Independent, no guaranteed work or pay.

Core Skills

Six skills you build first

Pulled straight from the curriculum, focused on what the work actually asks of you. No prerequisites to start.

01

Designing evaluation rubrics

Write atomic, objective scoring criteria from scratch, the way the platforms expect. The skill behind the most demanding evaluation work.

02

Defining the ideal response

Describe exactly what a perfect answer looks like for a prompt, the starting point for rating and ranking anything an AI produces.

03

Comparing and ranking responses

Apply a clear method to decide which of two answers is better, and defend the call. The core of how models learn from human feedback.

04

Spotting errors and hallucinations

Judge accuracy and instruction-following, and catch the confident mistakes models make, across text, code, and images.

05

Writing defensible justifications

Explain every rating with evidence so a reviewer can follow exactly why you scored what you did. Expected on every platform.

06

Fact-checking and citations

Verify claims quickly and tell strong sources from weak ones, the difference between a passing and a failing evaluation.

Want the full picture?

These six are the foundation. The full certification runs to 24 modules across rubric design, response evaluation, safety, citations, and platform readiness.

See the full curriculum
Enroll

One price, lifetime access

Start your first module free. Pay once, keep access for life.

Start Here

AI Evaluator Certification

$249.00

One-time payment, lifetime access

Start Your First Module Free

Your first module is free. No credit card required to start.

What's included
  • 24 modules of core evaluation skills
  • 30+ hours, self-paced, no prerequisites
  • Kappa, your AI study partner, on every module
  • Proctored final exam with ID verification
  • A verifiable certificate employers can check
  • Lifetime access, including future updates
Start Free

Learn the first skill today