A test collection for evaluating legal case law search

D Locke, G Zuccon - The 41st International ACM SIGIR Conference on …, 2018 - dl.acm.org
The 41st International ACM SIGIR Conference on Research & Development in …, 2018dl.acm.org
Test collection based evaluation represents the standard of evalua-tion for information
retrieval systems. Legal IR, more speci cally case law retrieval, has no such standard test
collection for evalua-tion. In this paper, we present a test collection for use in evaluating
case law search, being the retrieval of judicial decisions relevant to a particular legal
question. The collection is made available at ielab. io/caselaw.
Test collection based evaluation represents the standard of evalua- tion for information retrieval systems. Legal IR, more speci cally case law retrieval, has no such standard test collection for evalua- tion. In this paper, we present a test collection for use in evaluating case law search, being the retrieval of judicial decisions relevant to a particular legal question. The collection is made available at ielab.io/caselaw.
ACM Digital Library