| Similarity |
Page |
Snapshot |
| 146 |
There has been much debate in the past as to whether precision and recall are in fact the appropriate quantities to use as measures of effectiveness
...1 the most commonly used pair;2 fairly well understood quantities
...The final question How to evaluate?has a large technical answer
...Before proceeding to the technical details relating to the measurement of effectiveness it is as well to examine more closely the concept of relevance which underlies it
...Relevance Relevance is a subjective notion
... |
| 152 |
for which average precision values are calculated by averaging over all queries the individual precision values corresponding to the standard recall values
...Interpolation Many interpolation techniques have been suggested in the literature
...IMG SRC Fig
...Figure 7
...It is an experimental fact that average precision recall graphs are monotonically decreasing
...Let R [[lambda]],P [[lambda]]be the set of precision recall values obtained by varying some parameter [[lambda]]... |
| 10 |
In the past there has been much debate about the validity of evaluations based on relevance judgments provided by erring human beings
...Effectiveness and efficiency Much of the research and development in information retrieval is aimed at improving the effectiveness and efficiency of retrieval
... |
| 156 |
He accepts the validity of measuring the effectiveness of retrieval by a curve either precision recall or recall fallout generated by the variation of some control variable [[lambda]]e
...In the simplest case we assume that the variable [[lambda]]is distributed normally on the set of relevant and non relevant documents
...The usual set up in IR is now to define a decision rule in terms of [[lambda]],to determine which documents are retrieved the acceptance criterion
... |
| 180 |
effectiveness can be calculated to infinite precision we may be insisting on a difference when in fact it only occurs in the tenth decimal place
...Finally,although I have just explained the use of the sign test in terms of single number measures,it is also used to detect a significant difference between precision recall graphs
...Bibliographic remarks Quite a number of references to the work on evaluation have already been given in the main body of the chapter
...Buried in the report by Keen Digger [32]Chapter 16 is an excellent discussion of the desirable properties of any measure of effectiveness
...A parameter which I have mentioned in passing but which deserves closer study in generality
...The trade off between precision and recall has for a long time been the subject of debate
...Guazzo [39]describe an approach to the measurement of retrieval effectiveness based on information theory
...The notion of relevance has at all times attracted much discussion
... |
