INST 734
Information Retrieval Systems
Fall 2014
Project Batch Evaluation Results (Assignment P11)
Once you have completed your batch evaluation, you will turn in a
written report describing your evaluation results. Here's a brief
outline for what should be in the report:
- Describe the problem that you are solving (not much detail is
needed on this for class purposes) [0.5-1 page]
- Describe the design of your evaluation (generally including: what
documents you used, where you got your topics, how many topics you
used, how you got your relevance judgments, and what evaluation
measure(s) you used). [1-2 pages]
- Present your results using one or more tables and/or graphs
(either way is fine), along with some explanatory comments. Probably
easiest to present this in the same way as you will in your video
presentation (assignment P14). [1-2 pages, most of which will be
tables or graphs]
- Analysis of your results. Don't get too carried away here -- the
key is to draw some interesting conclusions from your evaluation. [1-2
pages]
- Some appropriate way of ending (e.g., remarks on limitations, one
or more suggestions for future work, etc.) [0.5 page]
The total should be about 6 pages. Several good examples are
available from TREC or SIGIR (which
is available through the ACM Digital Library in Research Port).
Submit your batch evaluation report using ELMS. I will provide
feedback to you by email.
Doug Oard
Last modified: Sat Nov 8 20:02:28 2014