[Corpora] [Corpora-List] Calculating statistical significant

[Noura Farra]

Hi,

I have used McNemar's test for calculating significance in the train set/
test set scenario, evaluating for accuracy and weighted f-measure across
labels. Here's a good calculator:

http://vassarstats.net/propcorr.html

You need to input 4 numbers:
a: # times where both system 1 & system 2 are correct
b: # times where system 1 is correct & system 2 is incorrect
c: # times where system 2 is correct & system 1 is incorrect
d: # times where both are incorrect

Cheers,
Noura

On Mon, Nov 10, 2014 at 10:36 AM, Zeljko Agic <zeljko.agic at gmail.com> wrote:

> On 2014-11-10 12:28, Jack Alan wrote:
>
>> <cut />
>> Could someone pinpoint me to the way of calculating the statistical
>> significant between them?
>>
>
> Hi,
>
> take a look at these two papers, and give the bootstrap test and
> approximate randomization a try as well. :-)
>
> http://www.aclweb.org/anthology/D12-1091
> http://www.aclweb.org/anthology/W/W14/W14-1601.pdf
>
> Bests,
> Z.
>
>
> _______________________________________________
> UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
> Corpora mailing list
> Corpora at uib.no
> http://mailman.uib.no/listinfo/corpora
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20141110/e394458c/attachment.htm>
-------------- next part --------------
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora