Rekodi ya ushahidi wa mbinu

TREC Pooling and Relevance Judgments

Pooling is the technique that lets the Cranfield evaluation paradigm scale to collections of millions of documents, where judging every document for every topic is impossible. Developed and institutionalized at the US National Institute of Standards and Technology for the Text REtrieval Conference (TREC), pooling gathers the top-ranked documents returned by many participating systems for each topic, merges them into a single pool, has human assessors judge only that pool, and treats every unjudged document as non-relevant. The result is a reusable test collection — documents, topics, and pooled relevance judgments (qrels) — on which new systems can later be scored without further assessment. Pooling is what made large-scale, reproducible retrieval evaluation feasible.

Sources recorded, not reviewed

Rekodi ya chanzo

Nukuu zimehamishwa kwa uhalisi kutoka kwa rekodi ya chanzo cha mbinu. Hakuna uthibitisho wa kiwango cha dai unaodokezwa kutoka kwao.

TREC Pooling and Relevance Judgments (Scalable Construction of Reusable Test Collections)

Rekodi ya mbinu ya kiajenda · process-pipeline / library-information-science

Voorhees, E. M., & Harman, D. K. (Eds.). (2005). TREC: Experiment and Evaluation in Information Retrieval. MIT Press. · ISBN 9780262220736
Manning, C. D., Raghavan, P., & Schütze, H. (2008). Introduction to Information Retrieval. Cambridge University Press. · ISBN 9780521865715
Cleverdon, C. W. (1967). The Cranfield tests on index language devices. Aslib Proceedings, 19(6), 173-194. · DOI 10.1108/eb050097

Fungua mbinu kamili

Madai yaliyotunzwa

Madai yamehifadhiwa katika daftari la ushahidi, kila moja ikiwa na tathmini yake.

Hakuna madai yaliyotunzwa bado

Mwonekano huu haubuni tathmini ya dai wakati daftari haina yoyote.

Mbinu zinazohusiana

Zilizotengenezwa kutoka kwa grafu ya mbinu na kuonyeshwa kama uhusiano uliopendekezwa na mashine — hakuna dai la ushahidi linalodokezwa.

Taxonomic bucketCranfield Evaluation Paradigmmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketQuery Expansion Evaluationmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketRelevance Feedback Evaluationmachine-suggested · Relational suggestion, not evidence.