2.7 Rubric Speed Drills

Study Time: 45 minutes Prerequisites: Modules 2.1-2.6 Learning Objectives:

• Build rubrics rapidly while maintaining quality
• Recognize patterns instantly
• Apply five properties automatically
• Meet real-world time constraints (15-30 min/task)
• Develop muscle memory for quality criteria

---

Introduction

In real evaluation work, speed matters. On many platforms a realistic working range is 15-30 minutes per task. This module develops that speed through drills.

Speed is not about rushing. It is about removing the friction that makes early-career evaluators slow: re-reading the same task, second-guessing simple criteria, and rebuilding rubrics from scratch every time. Experienced evaluators work quickly because the five core properties have become automatic, so they spend their attention on judgment rather than mechanics. The goal of this module is that automaticity. By the end you should be able to read a task, recognize what a strong rubric needs, and produce it inside a realistic time budget without sacrificing quality.

---

2.7.1 The Speed-Quality Balance

Target Times

• Simple task (text, straightforward): 10-15 minutes
• Standard task (audio/video, moderate complexity): 15-20 minutes
• Complex task (multimodal, many requirements): 20-30 minutes
• Novel task (a type you have not rubric-built before): 30-45 minutes

These include: Reading task, building rubric, self-audit. They are standard-evaluator targets; with expertise the same tasks drop to roughly 6-25 minutes (the expert series in Figure 2.7.2).

---

Speed Killers

What slows you down:

• Overthinking simple criteria
• Not using templates/patterns
• Skipping systematic approach
• Fixing criteria instead of writing correctly first
• No pre-built checklists

Solution: Drills build automaticity

---