Evaluation conferences such as TREC, CLEF, and NTCHI are modern examples of the Cranfied evaluation paradigm. In Cranfied researchers perform experiments on test collections to compare the relative effectiveness of different retrieval approaches. The test collections allow the researchers to control the effects of different system parameters, compared to user-based evaluations . This Cranfield paradigm, especially as they apply in the context of the evaluation conference