Methodology

How we review AI work platforms

Every platform review on this site follows the same method we teach: claims need sources, evidence beats anecdote, and mixed evidence gets shown as mixed. Here is exactly how it works.

The method

Five rules every review follows

Primary sources only

Every factual claim in a review traces to something we can point at: the platform's own published pages, its job listings, or dated, attributed first-hand reports from people doing the work. If we cannot source a claim, it does not appear.

Both sides of mixed evidence

Real platforms produce mixed experiences. When community reports conflict, we show the conflict rather than picking the story that makes a better headline. A review that only carries complaints, or only carries praise, is not a review.

Pay figures are never ours

We do not estimate, average, or invent pay numbers. When a figure appears, it is the platform's own published number for a specific listing, shown with its date. Advertised rates change and individual results vary.

Independence

Annotation Academy is not affiliated with, endorsed by, or paid by any platform we review. We sell one thing: a certification that trains evaluation skills. That is the whole business model, and it does not depend on any review's verdict.

Corrections

When a platform changes or a reader shows us an error with evidence, we update the page and say so. Reviews carry their last-verified date.

FAQ

Fair questions

Do platforms pay to be reviewed or listed?

No. No platform has paid for a review, a ranking, or a listing on our job board. The board pulls from platforms' public listings and feeds.

Why should I trust a certification company's platform reviews?

Check our work instead of trusting us: every claim in a review links to its source, so you can verify each one yourself. Our incentive is accuracy. The reviews exist because people searching for platform information are the same people who benefit from evaluation training, and misleading them would be a poor way to earn a student.

How often are reviews updated?

The job board refreshes daily from platform listings. Written reviews are re-verified when platforms change materially or when readers surface new evidence; each page shows when it was last checked.

The same evaluation discipline these reviews use is what the AI Evaluator Certification teaches. That is not a coincidence; it is the point.