2.5 Modality-Aware Rubrics
Study Time: 3 hours Prerequisites: Module 2.4 (Objectivity & Thresholds) Learning Objectives:
- Integrate all five core properties into complete rubrics
- Build modality-specific criteria for audio and video tasks
- Apply the Complete Rubric Checklist before every submission
- Handle multimodal tasks with cross-modality integration
- Create platform-ready evaluation rubrics
Introduction
This module integrates everything you've learned about rubric engineering. You'll combine all five core properties (atomic, instance-specific, self-contained, objective, modality-aware) to build complete, certification-ready rubrics.
The Five Core Properties:
- Atomic (Module 2.1): Tests exactly ONE aspect
- Instance-Specific (Module 2.2): References actual task content
- Self-Contained (Module 2.3): Stands alone without cross-referencing
- Objective (Module 2.4): Includes measurable thresholds
- Modality-Aware (This module): Evaluates modality-specific dimensions
2.5.1 The Complete Rubric Checklist
Many projects require criteria to meet specific properties. Here's how to verify your criteria meet common requirements when projects specify them:
For Each Criterion (verify which properties your project requires):
1. Atomic?
- Tests exactly ONE aspect
- No "and" connecting different things
- Passes failure scenario test (can't pass one part and fail another)
2. Instance-Specific?
- References actual content from THIS task
- Names specific facts, terms, numbers, components
- Can't be copy-pasted to a different task
3. Self-Contained?
- Understood without reading other criteria
- No "as mentioned above" or "see criterion X"
- Includes all needed context
4. Objective?
- Includes measurable threshold or standard
- No undefined "somewhat," "fairly," "adequate"
- Two evaluators would agree on the answer
5. Modality-Aware? (when specified by project)
- Audio tasks: may require clarity, pace, tone, or quality criteria
- Video tasks: may require visual and audio criteria
- Multimodal: may require integration criteria
The hands-on part starts here
Unlock the full lesson
- The step-by-step evaluation framework
- Graded practice drills with instant feedback
- Full video walkthrough
- Kappa, your AI study partner, for guided practice
- Downloadable rubric templates
- Module checkpoint quiz