22.352, FYI: Call for Interest: EVALITA 2011

[linguist at LINGUISTLIST.ORG]

LINGUIST List: Vol-22-352. Thu Jan 20 2011. ISSN: 1068 - 4875.

Subject: 22.352, FYI: Call for Interest: EVALITA 2011

Moderators: Anthony Aristar, Eastern Michigan U <aristar at linguistlist.org>
            Helen Aristar-Dry, Eastern Michigan U <hdry at linguistlist.org>
 
Reviews: Veronika Drake, U of Wisconsin-Madison  
Monica Macaulay, U of Wisconsin-Madison  
Eric Raimy, U of Wisconsin-Madison  
Joseph Salmons, U of Wisconsin-Madison  
Anja Wanner, U of Wisconsin-Madison  
       <reviews at linguistlist.org> 

Homepage: http://linguistlist.org/

The LINGUIST List is funded by Eastern Michigan University, 
and donations from subscribers and publishers.

Editor for this issue: Brent Miller <brent at linguistlist.org>
================================================================  

To post to LINGUIST, use our convenient web form at
http://linguistlist.org/LL/posttolinguist.cfm.

===========================Directory==============================  

1)
Date: 18-Jan-2011
From: Manuela Speranza [manspera at fbk.eu]
Subject: Call for Interest: EVALITA 2011
 

	
-------------------------Message 1 ---------------------------------- 
Date: Thu, 20 Jan 2011 14:38:51
From: Manuela Speranza [manspera at fbk.eu]
Subject: Call for Interest: EVALITA 2011

E-mail this message to a friend:
http://linguistlist.org/issues/emailmessage/verification.cfm?iss=22-352.html&submissionid=4491758&topicid=6&msgnumber=1
  


EVALITA 2011 - Call for Interest
Evaluation of NLP and Speech Tools for Italian
January 2011

Following the success obtained by the previous editions, we are pleased to
announce Evalita 2011, the third evaluation campaign of Natural Language
Processing and Speech tools for Italian.

The general objective of Evalita (http://evalita.fbk.eu) is to promote the
development of language technologies for the Italian language, providing a
shared framework where different systems and approaches can be evaluated in
a consistent manner.

In particular, we intend to organise the following tasks:

Text tasks
- Parsing (Main Task)
- Domain Adaptation for Dependency Parsing (Pilot Task)
- Named Entity Recognition on Transcribed Broadcast News
- Cross-document Coreference Resolution of Named Person Entities
- Anaphora Resolution
- Super Sense Tagging
- Frame Labeling over Italian texts
- Lemmatisation

Speech tasks
- Automatic Speech Recognition - Large Vocabulary Transcription
- Spoken Dialogue Systems Evaluation
- Forced Alignment on Spontaneous Speech
- Voice Applications on Mobile - Student Contest

As with other international evaluation campaigns, guidelines describing the
different tasks will be distributed among the participants. Participants
will also be provided with training data and will have the chance to test
their systems with the evaluation metrics and procedures to be used in the
formal evaluation. The results of the evaluation will be disseminated at
the final workshop which will be organized in conjunction with the next
AISV Conference (date and location to be announced).

We invite participation from both academic institutions and industrial
organizations.

Please indicate your intention to participate and the specific task(s) you
are interested in, by filling out the form at the following link:

http://evalita.fbk.eu/CFI2011.html

Your expressions of interest will be very important to help us organising
the evaluation campaign.

Important dates
- 1st March 2011: on-line registration opens
- 20th May 2011: development data available to participants
- 4th October 2011: test data available, registration closes
- 14th October 2011: system results due to organizers
- 28th October 2011: assessment returned to participants
- 24th November 2011: technical reports due to organizers
- January/February 2012: final workshop

Scientific coordination:

Bernardo Magnini (FBK-irst, Trento) and Emanuele Pianta (FBK-irst and
CELCT, Trento)

Scientific coordination for Speech Technology Evaluation:

Francesco Cutugno (Uni. Napoli ''Federico II'') and Mauro Falcone
(Fondazione Ugo Bordoni, Roma)

Task Organization:

* Parsing (Main task): Cristina Bosco (Uni. Torino) and Alessandro Mazzei
(Uni. Torino)
* Domain Adaptation for Dependency Parsing (Pilot Task): Felice
dell'Orletta (ILC-CNR, Pisa), Simonetta Montemagni (ILC-CNR, Pisa) and
Giulia Venturi (ILC-CNR, Pisa)
* Named Entity Recognition on Transcribed Broadcast News: Valentina
Bartalesi Lenzi (CELCT, Trento), Manuela Speranza (FBK-irst, Trento) and
Rachele Sprugnoli (CELCT, Trento)
* Co-reference: Luisa Bentivogli (FBK-irst, Trento) and Alessandro
Marchetti (CELCT, Trento)
* Anaphora Resolution: Massimo Poesio (Uni. Trento)
* Super Sense Tagging: Stefano Dei Rossi, Giulia Di Pietro and Maria Simi
(Uni. Pisa)
* Frame Labeling over Italian texts: Roberto Basili (Uni.Roma Tor Vergata)
and Alessandro Lenci (Uni. Pisa)
* Lemmatisation: Fabio Tamburini (Uni. Bologna)
* ASR - Large vocabulary transcription: Fabio Brugnara, Roberto Gretter and
Marco Matassoni (FBK-irst, Trento)
* Spoken Dialogue Systems Evaluation: Silvia Quarteroni (Politecnico di
Milano), Giuseppe Riccardi (Uni. Trento) and Pierluigi Roberti (Interactive
Media)
* Forced Alignment on Spontaneous speech: Francesco Cutugno (Uni. Napoli),
Dino Seppi (Uni. Leuven), Antonio Origlia (Uni. Napoli)
* Voice Applications on Mobile - Student Contest: Francesco Cutugno (Uni.
Napoli), Roberto Pieraccini (SpeechCycle, New York, USA)

Contact: Manuela Speranza, manspera at fbk.eu 



Linguistic Field(s): Computational Linguistics





 




-----------------------------------------------------------
LINGUIST List: Vol-22-352	
----------------------------------------------------------