[Corpora-List] how to increase reordering diversity of n-best list generated by Moses
Saeed Farzi
saeedfarzi at gmail.com
Fri Oct 10 13:11:00 UTC 2014
Dear All,
I am going to increase reordering diversity of n-best list generated by
Moses in order to apply my reordering model (a re-ranker system) for
improving translation quality.
In the first step due to low reordering diversity of the n-best list, i
need that the n-best list is included by different sentences which have
different reorderings.
For increasing the n-best list diversity, we generate 10000-best list and
then select 100-best of sentences with different reorderings.
For generating 10000-best list we use stack diversity and cube-pruning
options.
There are two disadvantages:
1) This task is very time consuming because of generating 10000-best in the
first step.
2) we loose lots of good translation candidates in terms of lexical choice.
It is caused that our reranker system could not find better translation
candidates in order to improve translation quality (BLEU score).
I am looking for new solution for increasing reordering diversity
without aforementioned problems.
Cheers
--
S.Farzi, Ph.D. Student
Natural Language Processing Lab,
School of Electrical and Computer Eng.,
Tehran University
Tel: +9821-6111-9719
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20141010/e016015f/attachment.htm>
-------------- next part --------------
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora
More information about the Corpora
mailing list