[Corpora-List] Guidelines for creating Gold Standard Alignment

[Nitin Madnani]

There has been work on creating gold-standard alignments. See the following:

(1) The annotation style guide for the Blinker project by Dan Melamed.
Even though this was written for the purpose of creating
English-French alignments using the Blinker tool, some of the
guidelines still carry over to the general case.
http://repository.upenn.edu/cgi/viewcontent.cgi?article=1054&context=ircs_reports

(2) Annotation guidelines for creating paraphrase alignments by
Callison-Burch, Cohn and Lapata. Even though this guide is to help
create alignments between sentences in the same language (English), it
might still be useful.
http://www.dcs.shef.ac.uk/~tcohn/paraphrase_guidelines.pdf

(3) A more comprehensive collection of word alignment guidelines can
be found on Rada Mihalcea's web page:
http://www.cse.unt.edu/~rada/wa/#guidelinesWA

Cheers,
Nitin

On Fri, Apr 16, 2010 at 1:20 AM, mohnish jadwani <mohnishgj at gmail.com> wrote:
> Respected Readers,
> The need to create a Gold Standard Alignment of vital importance when one
> has to evaluate results of bilingual corpus given to word alignment tools
> like Giza++. This Gold Standard Alignment( Test Data ) as many of us know
> serves as a reference against which one can evaluate the results obtained
> using the Training data. For the creation of this test data which is a
> subset of the Training Data, when one goes about it manually,  an individual
> comes across lot of variations with respect source and target languages
> while aligning words for e.g
>
>
> 1# 5 # does(1) he(2) go(3) home(4) ?(5) # 4 2 4 3 0
>
> 1# 5 # क्या(1) वह(2) घर(3) जाता(4) है(5) #
>
> 0 2 4 3 0
>
> the word "does" maps to 'ता' of 'जाता'
>
> There are many such careful considerations one has to keep in mind while
> going about creation of Gold Standard Alignment.
>
> Could you please suggest me any basic guidelines( if not
> English-Hindi language specific ) that one could follow while going about
> this, any reference paper or advice would be of great help.
>
> Thanking You
>
> Mohnish
>
>
>
> _______________________________________________
> Corpora mailing list
> Corpora at uib.no
> http://mailman.uib.no/listinfo/corpora
>
>



-- 
Got Blog?
http://greenideas.blogspot.com

_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora