Page 157 Concepts and similar pages

Concepts

Similarity Concept
Measures of effectiveness
Measurement of effectiveness
E measure
Effectiveness
Nearly decomposable system
Association Measures
Theory of measurement
Measures of association
Information measure
Composite measures

Similar pages

Similarity Page Snapshot
154 Composite measures Dissatisfaction in the past with methods of measuring effectiveness by a pair of numbers e ...S P R This is simply related to a measure suggested by Borko BK P R 1 More complicated ones are Vickery s measure V can be shown to be a special case of a general measure which will be derived below ...Some single number measures have derivations which can be justified in a rational manner ...The Swets model As early as 1963 Swets [12]showed that the suggested modifications were in fact simply related to an alternative measure already suggested by Swets ...It is interesting that although the Swets model is theoreticallyattractive
177 important that they are quoted alongside the distribution from which they are derived ...There are a number of ways of representing sets of Z values graphically ...A more convenient way of showing retrieval results of this kind is to plot them as cumulative frequency distributions,or as they are frequently called by statisticians empirical distribution functions ...I have emphasised the measurement of effectiveness from the point of view of the user ...
156 He accepts the validity of measuring the effectiveness of retrieval by a curve either precision recall or recall fallout generated by the variation of some control variable [[lambda]]e ...In the simplest case we assume that the variable [[lambda]]is distributed normally on the set of relevant and non relevant documents ...The usual set up in IR is now to define a decision rule in terms of [[lambda]],to determine which documents are retrieved the acceptance criterion ...
168 Foundation Problems of measurement have arisen in physics,psychology,and more recently,the social sciences ...The problems of measurement in information retrieval differ from those encountered in the physical sciences in one important aspect ...The next three sections are substantially the same as those appearing in my paper:Foundations of evaluation,Journal of Documentation,30,365 373 1974 ...no reason why we cannot postulate a particular ordering,or,to put it more mildly,why we can not show that a certain model for the measurement of effectiveness has acceptable properties ...1 all properties ascribed are consistent;2 they bring out into the open all the assumptions made in measuring effectiveness;3 each property has an acceptable interpretation;4 the model leads to a plausible measure of effectiveness ...It is as well to point out here that it does not lead to a uniquemeasure,but it does show that certain classes of measures can beregarded as being equivalent ...
176 conjoint structure ...The analysis is not limited to the two factors precision and recall,it could equally well be carried out for say the pair fallout and recall ...Presentation of experimental results In my discussion of micro,macro evaluation,and expected search length,various ways of averaging the effectiveness measure of the set of queries arose in a natural way ...In this section the discussion will be restricted to single number measures such as a normalised symmetric difference,normalised recall,etc ...The measurements we have therefore are Za Q 1,Za Q 2,...