Corpora: Negative mutual information?

Miles Osborne osborne at cogsci.ed.ac.uk
Thu Mar 8 13:39:46 UTC 2001


a negative mi sounds like a bug.  as far as i understand, mi can be
thought of as the kullback-liebler divergence between an independent
and a dependent model.  kl diverengence is always postive.

(also check Manning + Schutze p 72)

Miles



More information about the Corpora mailing list