Appel: Campaign TRAD 2012, A machine translation evaluation campaign on Arabic-French language pair

[Thierry Hamon]

Date: Wed, 30 May 2012 11:52:24 +0200
From: "Kahn Juliette" <juliette.kahn at lne.fr>
Message-ID: <10C58690E5732B47BE9AEC4BF97CA1340168427E at TMSG.intra.lne>
X-url: http://www.lne.fr/
X-url: http://www.lne.fr/fr/formation/offre-formation.asp?utm_source=mail&utm_medium=signature&utm_content=offre&utm_campaign=formation_2012
X-url: http://www.lne.fr/fr/formation/catalogue-stages.asp?utm_source=mail&utm_medium=signature&utm_content=cat&utm_campaign=formation_2012
X-url: http://www.lne.fr/fr/formation/E-catalogue-2012/index.html?utm_source=mail&utm_medium=signature&utm_content=e-cat&utm_campaign=formation_2012
X-url: http://www.lne.fr/fr/formation/journees-techniques.asp?utm_source=mail&utm_medium=signature&utm_content=jt&utm_campaign=formation_2012

Machine translation (MT) enjoys a new boom driven by the
applications. The goal is to translate sentences in a source language
into a target language without human intervention This difficult task
need to be regularly assessed to establish the scientific and technical
progress.


Funded by the French defense procurement agency (DGA), the Laboratoire
national de métrologie et d'essais (LNE) and CASSIDIAN conducts the
TRAD-campaign 2012 in order to support MT research and help advance the
state of art in MT technologies for the Arabic-French language pair.


To meet this objective, the LNE provides the following to the
participants:


* Consistent data for the training sets, the development and the test
  sets. The data bases contain newspapers articles or broadcast news
  transcriptions.

* An evaluation by automatic metrics.

* An evaluation by human judgment for the 4 best systems depending on
  the results obtained with the automatic metrics.

The LNE organizes a workshop at the end of the campaign to account for
the results and compare the approaches of the various participants.

Tasks

The language pair in TRAD 2012 is Arabic to French. Two tasks are
offered because of the sources of the elements to be translated.

* Text Task : Translation of newspapers articles that come from various
  newspapers.

* H4 Task : Translation of broadcast news transcriptions that come from
  various radio and television programs.

How to participate ?

This evaluation is intended to be of interest of all researchers working
on the problem of translation. Participation in the evaluation is
invited for all researchers who find the tasks and the evaluation of
interest.

The only requirement is the participation in the follow-up workshop. All
the participants must attend the workshop and be prepared to discuss
their system(s) and their results in detail. The workshop is restricted
to the TRAD-campaigns participants and representatives of supporting
government agencies.

To participate, simply fill out the registration form available at
www.trad-campaign.org. The participants can sign up for both tasks or
for only one of two.

Important dates

Evaluation plan released 15/04/2012

Early registration       01/05/2012

Training data available  01/06/2012

Registration deadline    01/07/2012

Evaluation test data available 23/09/2012

Deadline for submitting the results 01/10/2012

Deadline for submitting system descriptions to the LNE 08/10/2012

Beginning of the adjudication 10/11/2012

End of the adjudication 20/11/2012

Workshop 28/11/2012

Juliette KAHN
Ingénieur en évaluation des système de traitement de l'information
multimedia
Direction des Essais
Tél. : 01 30 69 13 62 

Laboratoire national de métrologie et d'essais
29, avenue Roger Hennequin - 78197 Trappes cedex
Tél. : 01 30 69 10 00 - Fax : 01 30 69 12 34
Site internet : www.lne.fr <http://www.lne.fr/> 

-------------------------------------------------------------------------
Message diffuse par la liste Langage Naturel <LN at cines.fr>
Informations, abonnement : http://www.atala.org/article.php3?id_article=48
English version       : 
Archives                 : http://listserv.linguistlist.org/archives/ln.html
                                http://liste.cines.fr/info/ln

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  : http://www.atala.org/
-------------------------------------------------------------------------