[Corpora-List] EVALITA 2009 First Call for Participation

Manuela Speranza manspera at fbk.eu
Tue Feb 3 18:30:35 UTC 2009


<apologies for cross-posting>


********************************************************************

                              EVALITA 2009

          Evaluation of NLP and Speech Tools for Italian

                         http://evalita.fbk.eu

********************************************************************




EVALITA 2009 - First Call for Participation
February 2009

We are pleased to announce that the registration to EVALITA 2009,
the second evaluation campaign of Natural Language Processing and
Speech tools for Italian, is now open.
The general objective of Evalita is to promote the development of
language technologies for the Italian language, providing a shared
framework where different systems and approaches can be evaluated
in a consistent manner.

We invite participation, both from academic institutions and
industrial organizations, in eight tasks, all for Italian.
With respect to the previous edition, tasks also include a range of
Speech tasks and a new Textual Entailment task.

Text tasks
- PoS-Tagging
- Parsing
     - Dependency Parsing
     - Constituency Parsing
- Lexical substitution
- Entity Recognition
     - Named Entity Recognition
     - Local Entity Detection and Recognition
- Textual Entailment

Speech tasks
- Connected Digits Recognition
     - Clean Digits
     - Noisy Digits
- Dialogue System Evaluation
- Speaker Identity Verification
     - Application
     - Forensic

As with the previous edition, guidelines describing the different tasks
will be distributed to participants.
Participants will also be provided with training data and will have
the chance to test their systems with the evaluation metrics and
procedures to be used in the formal evaluation.
The results of the evaluation will be disseminated at the final
workshop, which will be organized in conjunction with AI*IA 2009
and will take place in ReggioEmilia (to be confirmed).

In order to register for one or more of the EVALITA 2009 tasks,
please go to the registration page of the EVALITA 2009 website:
http://evalita.fbk.eu/registration.html

Please notice that some weeks ago there has been a change in the
important dates.
Updated information is always available on the website at
http://evalita.fbk.eu


Timeline

- 1st February 2009: on-line registration opens
- 1st April 2009: development data available to participants
- 10th September 2009: test data available, registration closes
- 20th September 2009: system results due to organizers
- 5th October 2009: assessment returned to participants
- 25th October 2009: technical reports due to organizers
- 12th December 2009: final workshop, Reggio Emilia (to be confirmed)


Coordination:
Bernardo Magnini (FBK-irst) and Amedeo Cappelli (ISTI-CNR and CELCT)

Task Organization:
- PoS-Tagging: Giuseppe Attardi and Maria Simi (Uni. Pisa)
- Parsing: Cristina Bosco, Alessandro Mazzei, Vincenzo Lombardo
(Uni. Torino), Felice dell'Orletta (Uni. Pisa), Alessandro Lenci
(Uni. Pisa) and Simonetta Montemagni (ILC-CNR, Pisa)
- Lexical Substitution: Antonio Toral (ILC-CNR, Pisa)
- Entity Recognition: Manuela Speranza (FBK-irst, Trento),
Valentina Bartalesi Lenzi, Rachele Sprugnoli (CELCT, Trento)
- Textual Entailment: Johan Bos (Uni. Roma "La Sapienza"),
Marco Pennacchiotti (Saarland University), Fabio Massimo
Zanzotto (Uni. Roma "Tor Vergata")
- Connected Digits Recognition: Gianpaolo Coro (ABLA, Milano),
Roberto Gretter (FBK-irst, Trento) and Marco Matassoni (FBK-irst,
Trento)
- Spoken Dialogue Evaluation: Giuseppe Riccardi (Uni. Trento),
Francesco Cutugno (Uni. Napoli "Federico II")  and Roberto Pieraccini
(Speechcycle, New York)
- Speaker Identity Verification: Guido Aversano (Parrot SA, Paris)
and Luciano Romito (Uni. Calabria, Cosenza)


Contact: Manuela Speranza - manspera at fbk.eu


_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora



More information about the Corpora mailing list