Berrypicking Evaluation

It is Bates's metaphor for how real information seeking works: just as wild berries are scattered and picked a few at a time, useful information is gathered bit-by-bit from many sources across an evolving search rather than delivered as one comprehensive result set. As each find reshapes the searcher's understanding, the query and the need shift, and the searcher moves among different techniques — footnote chasing, citation searching, journal runs, area scanning — picking relevant fragments along the way. The accumulated pickings, not a single retrieved set, satisfy the need.

The classic model assumes a fixed, well-formed query and judges a system by how well it returns the single best-matching set, scored with precision and recall. Berrypicking rejects both assumptions: the query evolves as the searcher learns, and satisfaction comes from gathering scattered fragments across many moves and sources rather than from one answer set. Consequently the berrypicking model also changes evaluation — instead of scoring a single query, it asks how well a system supports a continually changing need and the browsing and varied search strategies that real seekers use.

It is used as a lens that scores systems and interfaces by how well they facilitate an evolving, multi-strategy search rather than by one-query relevance. A system rates well if it lets searchers carry context from one move to the next, browse fluidly, follow citations and references, scan related areas, and reformulate as their need shifts; it rates poorly if it forces a fixed query and a static result set. Evaluators draw on session-level evidence — search logs, think-aloud protocols, observation — to see whether the interface supports the bit-at-a-time, berrypicking trajectory the model describes.