[Corpora-List] comparing two IR systems using statistical tests?

[Chris Jordan]

Not to plug my own thesis work or anything :P

I have been exploring the usage of automatic query generation based on 
relative entropy to manufacture controlled environments for evaluating 
retrieval algorithms. I have paper I am preparing for ECIR with futher 
controlled environments that I have been playing with that has resulted 
in some interesting findings. I can pass that along to you if it gets 
accepted (knock on wood) but for now I can give you ready access to a 
pdf of my thesis.


Timad Kahena wrote:

>Hi, 
>
>Based on two (or more) results list (in TREC formats), how can we 
>compare two IR systems using statistical tests? Could someone show me how to 
>do that? 
>
>Examples and tutorial links are welcome…
>
>Thank you,
>Timad
>
>
>		
>---------------------------------
> Appel audio GRATUIT partout dans le monde avec le nouveau Yahoo! Messenger
> Téléchargez le ici !  
>
>
>  
>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: cjordan.vcf
Type: text/x-vcard
Size: 345 bytes
Desc: not available
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20051011/81801651/attachment-0001.vcf>