[Corpora-List] Cyrillic tokenizer and sentence splitter
George Mitrevski
mitrege at auburn.edu
Thu May 12 21:17:38 UTC 2005
Hi folks.
Can anyone reccomend a good perl sentence splitter and tokenizer that
works well with Cyrillic characters/texts (Russian, Bulgarain, etc.)?
I've tried some for English, German and other langauges, but they don;t
do well with Cyrillic.
thanks,
George.
Foreign Languages tel. 334-844-6376
6030 Haley Center fax. 334-844-6378
Auburn University
Auburn, AL 36849
home: www.auburn.edu/~mitrege
More information about the Corpora
mailing list