Appel: Open evaluation campaign on spoken language translation, IWSLT 2014

[Thierry Hamon]

Date: Sun, 25 May 2014 23:02:21 +0200
From: yvon <francois.yvon at limsi.fr>
Message-ID: <66bc4beb55eb63e0f85ed0892cac0d28 at limsi.fr>
X-url: http://www.iwslt.org


(Apologies for multiple postings)

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
       11th International Workshop on Spoken Language Translation
                              (IWSLT 2014)

First Call for Participation

December 4-5, 2014
     Lake Tahoe, CA, USA
	   http://www.iwslt.org
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

The International Workshop on Spoken Language Translation (IWSLT) is an
annual scientific workshop, associated with an open evaluation campaign
on spoken language translation, at which both, scientific papers and
system descriptions, are presented. The 11th International Workshop on
Spoken Language Translation will take place in Lake Tahoe, USA on
December 4-5, 2014. IWSLT 2014 is co-located with SLT 2014, which will
take place right after IWSLT.

For full information see our website at http://www.iwslt.org

=== Evaluation Campaign ===

The IWSLT 2014 Evaluation Campaign will focus on the translation of TED
and TEDx talks, a collection of public speeches on a variety of
topics. The evaluation campaign will include the following tracks:

ASR track: automatic transcription of talks from audio to text, 
Languages:
English, German and Italian

SLT track: speech translation of talks from audio (or ASR output) to
text
Input format: segmented SPHERE or ASR output
Directions:
* Official: English -> French, German <-> English, Italian <-> English
* Optional: English -> Arabic, Chinese

MT track : text translation of talks for three language pairs plus 
twelve optional language
pairs Directions:
* Official: English -> French, English <-> German, Italian
* Optional: English <-> Arabic, Chinese, Dutch, Hebrew, Persian, 
Polish, Portuguese (B),
   Romanian, Russian, Slovenian, Spanish, Turkish

Evaluation methods:
ASR track: word or character error rate
SLT/MT: BLEU (all directions) and post-edit effort (most popular
official direction)

Training of MT systems and language models for ASR is constrained to
data supplied by the organizers. Supplied training, development, and
test data will be available on the workshop’s webpage.

-------------------------------
Important Dates:
-------------------------------

June 02, 2014:	    Release of TRAIN and DEV data TEST period ASR track
Sep 01-10, 2014:    TEST period ASR track
Sep 15-10, 2014:    TEST period SLT track (official directions)
Sep 22-30, 2014:    TEST period MT track (official directions)
Oct 06-17, 2014:    TEST period MT/SLT track (optional directions)
Nov 03, 2014:       System description paper due
Nov 19, 2014:       Review feedback,
Nov 25, 2014:       Camera-ready paper due
Dec 04-05, 2014:    Workshop

Contact:
Marcello Federico, FBK, federico at fbk.eu
Sebastian Stüker, KIT, sebastian.stueker at kit.edu

=== Scientific Papers ===

The IWSLT invites submissions of scientific papers to be published in
the workshop proceedings and presented in dedicated technical sessions
of the workshop, either in oral or poster form. The workshop welcomes
original and high quality contri- butions covering theoretical and
practical issues in the fields of automatic speech recognition and
machine translation that are applied to spoken language
translation. Possible topics include, but are not limited to:

- Speech and text MT
- Integration of ASR and MT
- Statistical modeling for MT and SLT
- Evaluation for MT and SLT
- Adaptation in SLT
- Simultaneous speech translation
- Computer assisted speech translation
- Automatic translation of lectures
- Efficient computational architectures for SLT
- SLT for under-resourced languages
- Spoken language summarization
- Rich transcription of speech for MT
- Stream-based algorithms for MT
- Multilingual ASR and TTS
- Cross-lingual spoken document retrieval
- Multi-lingual spoken language mining
- Translation of non-verbal events
- Speech-to-speech translation
- Language resources for MT and SLT
- Open source software for MT and SLT

The IWSLT 2014 review process is double-blind. Submitted manuscripts
will be peer-reviewed. Authors of accepted papers are required to
present their paper at the workshop.

-------------------------------
Important Dates:
-------------------------------

Sep 25, 2014:	Scientific paper submission
Nov 03, 2014:	Notification to authors
Nov 13, 2014:	Camera-ready paper due
Dec 04-05, 2014:	Workshop

Contact:
Francois Yvon, LIMSI/CNRS
yvon at limsi.fr

-------------------------------------------------------------------------
Message diffuse par la liste Langage Naturel <LN at cines.fr>
Informations, abonnement : http://www.atala.org/article.php3?id_article=48
English version       : 
Archives                 : http://listserv.linguistlist.org/archives/ln.html
                                http://liste.cines.fr/info/ln

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  : http://www.atala.org/

ATALA décline toute responsabilité concernant le contenu des
messages diffusés sur la liste LN
-------------------------------------------------------------------------