Conf: Automatic Procedures in MT Evaluation - MT Summit XI, Copenhagen, 11 September 2007

[Thierry Hamon]

Date: Wed, 25 Jul 2007 17:10:58 +0200
From: ELDA <info at elda.org>
Message-ID: <46A76802.4070700 at elda.org>
X-url: http://mtsummitcph.ku.dk/workshops/

[Apologies for multiple postings]

Automatic Procedures in MT Evaluation
MT Summit XI, Copenhagen, 11 September 2007
Workshop organised by the ELRA Evaluation Committee

Gregor Thurmair, Linguatec
Khalid Choukri, ELDA
Bente Maegaard, University of Copenhagen

The purpose of this workshop is to discuss automatic evaluation 
procedures in MT. Among the discussion points are:

   * What do the scores really measure?
   * What kind of implicit assumptions do they make?
   * What kind initial effort do they require (e.g.: pre-translate
     test corpus)?
   * What kind of resources do they need (e.g.: third party grammars)?
   * Are they biased towards specific MT technologies?
   * What kind of diagnostic support can they give? (where to improve
     the system)
   * What kind of evaluation criteria (e.g. related to the FEMTI
     framework) do they support (adequacy, fluency, ...)

The objective of the workshop is to have a better understanding of the
strengths and limitations of the respective approaches, and perhaps
make steps towards defining a common methodology for MT output
evaluation.

Please visit http://mtsummitcph.ku.dk/workshops/ to find more about
the workshop's programme.


-------------------------------------------------------------------------
Message diffuse par la liste Langage Naturel <LN at cines.fr>
Informations, abonnement : http://www.atala.org/article.php3?id_article=48
English version       : 
Archives                 : http://listserv.linguistlist.org/archives/ln.html
                                http://liste.cines.fr/info/ln

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  : http://www.atala.org/
-------------------------------------------------------------------------