What You'll Learn

The skills the work actually rewards

These are the core skills an AI evaluator uses every day, taught from the ground up. No coding, no AI background, and no jargon to get started.

Companies hiring600+rolesView all
MercorUS & UK-Based Labor & Employment Lawyers$225-250/hrMicro1AI Strategy & Business Operations Expert$100-200/hrMercorMCP & Plug In Connectors Expert$50-190/hrMercorPhysician Talent Network$110-250/hrMicro1General Counsel$100-200/hrAppenMachine Translation Evaluation – English <> Swedish; Project Vistula$60-80/hrMercorMachine Learning Engineer Talent Network$70-250/hrMicro1Physics Expert (Professor / Principal Investigator)$80-160/hrMicro1Generalist for Data Annotation$30-80/hrMercorManagement Consulting Expert$150-220/hrMicro1Senior Software Engineer$50-150/hrMercorUK-Based Accounting Specialists$150-200/hrMicro1Mechanical Engineering Professor$60-130/hrMercorBasque Audio Generalist Evaluator Expert$50/hrMercorUK-Based Video Producers & Editors$150-200/hrMicro1Agentic AI Expert$70-126/hrMercorJSON-fluent & Rubrics Expert$50-175/hrMicro1Financial Advisor (CFA or CFP)$80-110/hrMercorEnglish (New Zealand) Audio Generalist Evaluator Expert$50/hrMercorRTL Design Engineers$100-175/hrMicro1Fitness Expert$50-101/hrMercorResearch Physics Expert$80-135/hrMicro1InfoSec Expert$60-100/hrMercorHindi Audio Generalist Evaluator Expert (San Francisco Bay Area)$50/hrMercorAI Rater Guidelines Writer (Linguist / Instructional Designer)$45-65/hrMicro1Tongan Bilingual Expert$45-95/hrMercorElementary School Teacher (Except Special Education) — ONET Occupation Study$30/hrMicro1Mental-Health Crisis Prevention Expert$50-90/hrMicro1English Speaking Generalist$20-30/hrMicro1Child & Online Safety Expert$50-90/hrMicro1AI Trainer$40-80/hrMicro1AI Data Annotation Expert$40-80/hrMicro1Logistics & Supply Chain Management Specialist$40-50/hrMercorUS & UK-Based Labor & Employment Lawyers$225-250/hrMicro1AI Strategy & Business Operations Expert$100-200/hrMercorMCP & Plug In Connectors Expert$50-190/hrMercorPhysician Talent Network$110-250/hrMicro1General Counsel$100-200/hrAppenMachine Translation Evaluation – English <> Swedish; Project Vistula$60-80/hrMercorMachine Learning Engineer Talent Network$70-250/hrMicro1Physics Expert (Professor / Principal Investigator)$80-160/hrMicro1Generalist for Data Annotation$30-80/hrMercorManagement Consulting Expert$150-220/hrMicro1Senior Software Engineer$50-150/hrMercorUK-Based Accounting Specialists$150-200/hrMicro1Mechanical Engineering Professor$60-130/hrMercorBasque Audio Generalist Evaluator Expert$50/hrMercorUK-Based Video Producers & Editors$150-200/hrMicro1Agentic AI Expert$70-126/hrMercorJSON-fluent & Rubrics Expert$50-175/hrMicro1Financial Advisor (CFA or CFP)$80-110/hrMercorEnglish (New Zealand) Audio Generalist Evaluator Expert$50/hrMercorRTL Design Engineers$100-175/hrMicro1Fitness Expert$50-101/hrMercorResearch Physics Expert$80-135/hrMicro1InfoSec Expert$60-100/hrMercorHindi Audio Generalist Evaluator Expert (San Francisco Bay Area)$50/hrMercorAI Rater Guidelines Writer (Linguist / Instructional Designer)$45-65/hrMicro1Tongan Bilingual Expert$45-95/hrMercorElementary School Teacher (Except Special Education) — ONET Occupation Study$30/hrMicro1Mental-Health Crisis Prevention Expert$50-90/hrMicro1English Speaking Generalist$20-30/hrMicro1Child & Online Safety Expert$50-90/hrMicro1AI Trainer$40-80/hrMicro1AI Data Annotation Expert$40-80/hrMicro1Logistics & Supply Chain Management Specialist$40-50/hr

Third-party listings. Independent, no guaranteed work or pay.

Core Skills

Six skills you build first

Pulled straight from the curriculum, focused on what the work actually asks of you. No prerequisites to start.

01

Designing evaluation rubrics

Write atomic, objective scoring criteria from scratch, the way the platforms expect. The skill behind the most demanding evaluation work.

02

Defining the ideal response

Describe exactly what a perfect answer looks like for a prompt, the starting point for rating and ranking anything an AI produces.

03

Comparing and ranking responses

Apply a clear method to decide which of two answers is better, and defend the call. The core of how models learn from human feedback.

04

Spotting errors and hallucinations

Judge accuracy and instruction-following, and catch the confident mistakes models make, across text, code, and images.

05

Writing defensible justifications

Explain every rating with evidence so a reviewer can follow exactly why you scored what you did. Expected on every platform.

06

Fact-checking and citations

Verify claims quickly and tell strong sources from weak ones, the difference between a passing and a failing evaluation.

Want the full picture?

These six are the foundation. The full certification runs to 24 modules across rubric design, response evaluation, safety, citations, and platform readiness.

See the full curriculum
Enroll

One price, lifetime access

Start your first module free. Pay once, keep access for life.

Start Here

AI Evaluator Certification

$249.00

One-time payment, lifetime access

Start Your First Module Free

Your first module is free. No credit card required to start.

What's included
  • 24 modules of core evaluation skills
  • 30+ hours, self-paced, no prerequisites
  • Kappa, your AI study partner, on every module
  • Proctored final exam with ID verification
  • A verifiable certificate employers can check
  • Lifetime access, including future updates
Start Free

Learn the first skill today