Information Literacy Rubric Assessment

A multiple-choice test can efficiently sample declarative knowledge, recognizing a good source, knowing what a citation is, but information literacy is fundamentally about doing: actually finding, judging, and using sources in real work. Rubric assessment scores authentic artifacts such as research papers and annotated bibliographies, so it measures applied performance rather than recognition. It is also diagnostic, because analytic scoring reveals which dimension is weak. The trade-off is cost: rubrics require building criteria, designing aligned assignments, and calibrating raters, whereas tests scale cheaply. Many programs use a test for breadth and rubrics for authentic, actionable depth.

Through calibration, often called norming. Before scoring real work, raters independently apply the rubric to a shared set of anchor artifacts, then compare their scores, discuss where and why they differed, and refine their common interpretation of the level descriptors. This continues until agreement, measured by a statistic such as Cohen's kappa or Krippendorff's alpha, reaches an acceptable threshold. Double-scoring a subset during the main scoring monitors that agreement holds. Project RAILS found calibration both essential and surprisingly demanding; without it, scores reflect individual rater tendencies rather than student performance, undermining the whole assessment.

They are complementary. The VALUE rubric is a specific, ready-made analytic rubric for information literacy, with defined dimensions and capstone-to-benchmark performance levels, intended for shared use across institutions. Project RAILS is a research project and body of practical guidance about how to do rubric assessment well, whether with VALUE or with a locally developed rubric, covering collaboration, assignment design, rubric construction, rater calibration, and using results to improve instruction. In short, VALUE gives you an instrument, while RAILS gives you the method and lessons learned for building, calibrating, and applying such instruments effectively.