[Corpora-List] EVALITA 2011 Call for Interest

Manuela Speranza manspera at fbk.eu
Tue Jan 18 15:47:30 UTC 2011


<apologies for cross-posting>


****************************************************************

                                 EVALITA 2011

           Evaluation of NLP and Speech Tools for Italian

****************************************************************




EVALITA 2011 - Call for Interest
January 2011


Following the success obtained by the previous editions, we are pleased to
announce Evalita 2011, the third evaluation campaign of Natural Language
Processing and Speech tools for Italian.

The general objective of Evalita (http://evalita.fbk.eu) is to promote the
development of language technologies for the Italian language, providing a
shared framework where different systems and approaches can be evaluated
in a consistent manner.

In particular, we intend to organise the following tasks:

Text tasks
- Parsing (Main Task)
- Domain Adaptation for Dependency Parsing (Pilot Task)
- Named Entity Recognition on Transcribed Broadcast News
- Cross-document Coreference Resolution of Named Person Entities
- Anaphora Resolution
- Super Sense Tagging
- Frame Labeling over Italian texts
- Lemmatisation

Speech tasks
- Automatic Speech Recognition - Large Vocabulary Transcription
- Spoken Dialogue Systems Evaluation
- Forced Alignment on Spontaneous Speech
- Voice Applications on Mobile - Student Contest

As with other international evaluation campaigns, guidelines describing the
different tasks will be distributed among the participants. Participants 
will
also be provided with training data and will have the chance to test their
systems with the evaluation metrics and procedures to be used in the formal
evaluation. The results of the evaluation will be disseminated at the final
workshop which will be organized in conjunction with the next AISV
Conference (date and location to be announced).

We invite participation from both academic institutions and industrial
organizations.

Please indicate your intention to participate and the specific task(s) you
are interested in, by filling out the form at the following link:
http://evalita.fbk.eu/CFI2011.html
Your expressions of interest will be very important to help us organising
the evaluation campaign.

Important dates
- 1st March 2011: on-line registration opens
- 20th May 2011: development data available to participants
- 4th October 2011: test data available, registration closes
- 14th October 2011: system results due to organizers
- 28th October 2011: assessment returned to participants
- 24th November 2011: technical reports due to organizers
- January/February 2012: final workshop

Scientific coordination:
Bernardo Magnini (FBK-irst, Trento) and Emanuele Pianta (FBK-irst and CELCT,
Trento)

Scientific coordination for Speech Technology Evaluation:
Francesco Cutugno (Uni. Napoli "Federico II") and Mauro Falcone (Fondazione
Ugo Bordoni, Roma)

Task Organization:

* Parsing (Main task): Cristina Bosco (Uni. Torino) and Alessandro Mazzei
  (Uni. Torino)
* Domain Adaptation for Dependency Parsing (Pilot Task): Felice dell'Orletta
  (ILC-CNR, Pisa), Simonetta Montemagni (ILC-CNR, Pisa) and Giulia Venturi
  (ILC-CNR, Pisa)
* Named Entity Recognition on Transcribed Broadcast News: Valentina 
Bartalesi
  Lenzi (CELCT, Trento), Manuela Speranza (FBK-irst, Trento) and Rachele
  Sprugnoli (CELCT, Trento)
* Co-reference: Luisa Bentivogli (FBK-irst, Trento) and Alessandro Marchetti
  (CELCT, Trento)
* Anaphora Resolution: Massimo Poesio (Uni. Trento)
* Super Sense Tagging: Stefano Dei Rossi, Giulia Di Pietro and Maria Simi
  (Uni. Pisa)
* Frame Labeling over Italian texts: Roberto Basili (Uni.Roma Tor Vergata)
  and Alessandro Lenci (Uni. Pisa)
* Lemmatisation: Fabio Tamburini (Uni. Bologna)
* ASR - Large vocabulary transcription: Fabio Brugnara, Roberto Gretter and
  Marco Matassoni (FBK-irst, Trento)
* Spoken Dialogue Systems Evaluation: Silvia Quarteroni (Politecnico di 
Milano),
  Giuseppe Riccardi (Uni. Trento) and Pierluigi Roberti (Interactive Media)
* Forced Alignment on Spontaneous speech: Francesco Cutugno (Uni. Napoli),
  Dino Seppi (Uni. Leuven), Antonio Origlia (Uni. Napoli)
* Voice Applications on Mobile - Student Contest: Francesco Cutugno (Uni.
  Napoli), Roberto Pieraccini (SpeechCycle, New York, USA)

Contact: Manuela Speranza, manspera at fbk.eu


_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora



More information about the Corpora mailing list