Page 154 Concepts and similar pages

Concepts

Similarity Concept
Swets model
Composite measures
Retrieval effectiveness
Generality
Theory of measurement
Cluster based retrieval
E measure
Measures of effectiveness
Measurement of effectiveness
Effectiveness

Similar pages

Similarity Page Snapshot
180 effectiveness can be calculated to infinite precision we may be insisting on a difference when in fact it only occurs in the tenth decimal place ...Finally,although I have just explained the use of the sign test in terms of single number measures,it is also used to detect a significant difference between precision recall graphs ...Bibliographic remarks Quite a number of references to the work on evaluation have already been given in the main body of the chapter ...Buried in the report by Keen Digger [32]Chapter 16 is an excellent discussion of the desirable properties of any measure of effectiveness ...A parameter which I have mentioned in passing but which deserves closer study in generality ...The trade off between precision and recall has for a long time been the subject of debate ...Guazzo [39]describe an approach to the measurement of retrieval effectiveness based on information theory ...The notion of relevance has at all times attracted much discussion ...
188 In basing a theory of evaluation on the theory of measurement,is it possible to devise a measure of effectiveness not starting with precision and recall but simply with the set of relevant documents and the set of retrieved documents?If so,can we generalise such a measure to take account of degree of relevance?An alternative derivation of an E type measure could be done in terms of recall and fallout ...Up to now the measurement of effectiveness has proved fairly intractable to statistical analysis ...I think the Robertson model described in Chapter 7 goes some way to being considered as a reasonable statistical model ...There may be laws of retrieval such as the well known trade off between precision and recall that are worth establishing either empirically or by theoretical argument ...6 ...There is a need for more intensive research into the problems of what to use to represent the content of documents in a computer ...Information retrieval systems,both operational and experimental,have been keyword based ...The major reason for this rather simple minded approach to document retrieval is a very good one ...