| Similarity |
Page |
Snapshot |
| 180 |
effectiveness can be calculated to infinite precision we may be insisting on a difference when in fact it only occurs in the tenth decimal place
...Finally,although I have just explained the use of the sign test in terms of single number measures,it is also used to detect a significant difference between precision recall graphs
...Bibliographic remarks Quite a number of references to the work on evaluation have already been given in the main body of the chapter
...Buried in the report by Keen Digger [32]Chapter 16 is an excellent discussion of the desirable properties of any measure of effectiveness
...A parameter which I have mentioned in passing but which deserves closer study in generality
...The trade off between precision and recall has for a long time been the subject of debate
...Guazzo [39]describe an approach to the measurement of retrieval effectiveness based on information theory
...The notion of relevance has at all times attracted much discussion
... |
| 182 |
19
...20
...21
...22
...23
...24
...25
...26
...27
...28
...29
...30
...31
...32
...33
...34
...35
...36
...37
...38
...39
...40
...41
... |
| 181 |
A short paper by Good [44]which is in sympathy with the approach based on a theory of measurement given here,discusses the evaluation of retrieval systems in terms of expected utility
...One conspicuous omission from this chapter is any discussion of cost effectiveness
...References 1
...2
...3
...4
...5
...6
...7
...8
...26,321 343 1975
...9
...10
...11
...12
...13
...14
...15
...16
...17
...18
... |
| 11 |
think of retrieval effectiveness in terms of precision and recall
...Bibliographic remarks The best introduction to information retrieval is probably got by reading some of the early papers in the field
...One early publication worth reading which is rather hard to come by is the report on the Cranfield II project by Cleverdon et al
...Papers on information retrieval have a tendency to get published in journals on computer science and library science
... |
| 188 |
In basing a theory of evaluation on the theory of measurement,is it possible to devise a measure of effectiveness not starting with precision and recall but simply with the set of relevant documents and the set of retrieved documents?If so,can we generalise such a measure to take account of degree of relevance?An alternative derivation of an E type measure could be done in terms of recall and fallout
...Up to now the measurement of effectiveness has proved fairly intractable to statistical analysis
...I think the Robertson model described in Chapter 7 goes some way to being considered as a reasonable statistical model
...There may be laws of retrieval such as the well known trade off between precision and recall that are worth establishing either empirically or by theoretical argument
...6
...There is a need for more intensive research into the problems of what to use to represent the content of documents in a computer
...Information retrieval systems,both operational and experimental,have been keyword based
...The major reason for this rather simple minded approach to document retrieval is a very good one
... |
