[Corpora-List] POS-tagger maintenance and improvement

Chris Dyer redpony at umd.edu
Thu Feb 26 23:03:00 UTC 2009


> Its not like wikipedia, where you can pop in, fix
> something and in 1/2 hour you're on your way ...
> it requires a a heavy up-front investment, which
> in turn implies a long-term commitment (like most
> software projects) -- so its not for social butterflies.
I also work with statistical models, so I certainly appreciate the
difficulty of identifying a problem and coming up with a change to the
model that will learn the fix.  But, I was actually proposing
something a bit different than this (and also different from what Adam
was originally asking for, but, in the long run, which I still think
would lead to the improvements of statistical tools that he was asking
for).  Basically, there are some activities related to what we do that
don't require major expertise, but which could still benefit from
wikipedia-type organization. To name a few: correcting defects in
corpora, certain annotation tasks, and identifying areas of inadequate
coverage and/or systematic errors in existing tools.

On the other hand, with the ubiquity of language on the web as a
basically free resource, you could definitely argue that the NLP
community, more than any other, has benefited from the "bazaar" model,
so I should just stop complaining.  Maybe that's a better way to think
about this.

-CJD

_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora



More information about the Corpora mailing list