[Corpora-List] EVALITA 2009 Newsletter No. 1

Manuela Speranza manspera at fbk.eu
Fri Jun 12 10:08:58 UTC 2009


<apologies for cross-posting>


********************************************************************

                           EVALITA 2009

       Evaluation of NLP and Speech Tools for Italian

                      http://evalita.fbk.eu

********************************************************************




EVALITA 2009 - Newsletter No. 1
June 12th, 2009

We would like to remind you that the registration to EVALITA 2009,
the second evaluation campaign of Natural Language Processing and
Speech tools for Italian, is open. In order to register for one or more
EVALITA tasks, follow the link: http://evalita.itc.it/registration.html

The general objective of EVALITA is to promote the development
of language technologies for the Italian language, providing a shared
framework where different systems and approaches can be evaluated
in a consistent manner.
EVALITA is organised with the support of AI*IA (the Italian
Association for Artificial Intelligence) and AISV (the Italian
Association of Speech Science ).

The results of the evaluation will be disseminated at the final workshop,
which will be organized in conjunction with AI*IA 2009 and will take
place in Reggio Emilia on December 12th, 2009.


Tasks
----

Text tasks:
- PoS-Tagging
- Parsing
- Lexical substitution
- Entity Recognition
- Textual Entailment

Speech tasks:
- Connected Digits Recognition
- Dialogue System Evaluation
- Speaker Identity Verification


Training data
----------

Training data for all eight tasks are available.
Please follow the link at "Data distribution" from the webpage of each
task to get information as to how to obtain them. Test data will be
available from September 10th.


Registrations
---------

We have received 39 registrations up to now, from 27 different
organizations. Among these, 11 are not Italian and 5 are not academic.


Remind of deadlines
--------------

10th September 2009: test data available, registration closes
20th September 2009: system results due to organizers
5th October 2009: assessment returned to participants
25th October 2009: technical reports due to organizers
12th December 2009: final workshop, Reggio Emilia


Organizers
--------

Coordination:
Bernardo Magnini (FBK-irst) and Amedeo Cappelli (ISTI-CNR and CELCT)

Text tasks:
- PoS-Tagging: Giuseppe Attardi and Maria Simi (Uni. Pisa)
- Parsing: Cristina Bosco, Alessandro Mazzei, Vincenzo Lombardo
(Uni. Torino), Felice dell'Orletta, Alessandro Lenci (Uni. Pisa) and
Simonetta Montemagni (ILC-CNR, Pisa)
- Lexical Substitution: Antonio Toral (ILC-CNR, Pisa)
- Entity Recognition: Manuela Speranza (FBK-irst, Trento),
Valentina Bartalesi Lenzi and Rachele Sprugnoli (CELCT, Trento)
- Textual Entailment: Johan Bos (Uni. Roma "La Sapienza"),
Marco Pennacchiotti (Saarland University) and Fabio Massimo
Zanzotto (Uni. Roma "Tor Vergata")

Speech tasks:
Scientific coordination: Francesco Cutugno (Uni. Napoli "Federico II")
and Mauro Falcone (Fondazione Ugo Bordoni, Roma)
- Connected Digits Recognition: Gianpaolo Coro (ABLA, Milano),
Roberto Gretter and Marco Matassoni (FBK-irst, Trento)
- Spoken Dialogue Evaluation: Giuseppe Riccardi (Uni. Trento),
Francesco Cutugno (Uni. Napoli "Federico II"), Roberto Pieraccini
(Speechcycle, New York) and Morena Danieli (Loquendo, Torino)
- Speaker Identity Verification: Guido Aversano (Parrot SA, Paris)
and Luciano Romito (Uni. Calabria, Cosenza)



In order to register for one or more of the EVALITA 2009 tasks,
please go to the registration page of the EVALITA 2009 website:
http://evalita.fbk.eu/registration.html

For more detailed information please refer to the website at
http://evalita.fbk.eu


Timeline

- 1st February 2009: on-line registration opens
- 1st April 2009: development data available to participants
- 10th September 2009: test data available, registration closes
- 20th September 2009: system results due to organizers
- 5th October 2009: assessment returned to participants
- 25th October 2009: technical reports due to organizers
- 12th December 2009: final workshop, Reggio Emilia




Contact: Manuela Speranza - manspera at fbk.eu


_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora



More information about the Corpora mailing list