[Corpora-List] ****** EVALITA 2014: final CALL for TASKS and deadline extension ******

[Cristina Bosco]

****** EVALITA 2014: final CALL for TASKS and deadline extension ******

The Submission deadline has been extended to Thursday, 30 January 2014.

The 4th evaluation campaign EVALITA 2014, will be held on December 11 2014 in Pisa, as a workshop of the 14th Symposium of the AI*IA (Associazione Italiana per l'Intelligenza Artificiale/Italian Association for Artificial Intelligence).
Evalita is supported by the AI*IA working group on NLP and by AISV (Associazione Italiana di Scienze della Voce/Italian Association of Speech Sciences).

As in the previous editions, EVALITA-2014 will be organized along few selected Tasks, which provide participants with opportunities to discuss and explore both emerging and traditional areas of Natural Language Processing and Speech for Italian. The goals of each task is to compare systems on common datasets applying different approaches and paradigms, to share experiences, foster research communities, identify open issues and explore directions for future research, thus providing significant room for controversial and stimulating discussions. 
The participation is encouraged for teams working both in academic institutions and industrial organizations.


TASK PROPOSAL SUBMISSION

Tasks proposals should be no longer than 4 pages and should include:
- Task title and acronym
- Names and affiliation of the organizers (minimum 2 organizers)
- Brief task description, including motivations and state of the art showing the international relevance of the task
- Description and examples of the data needed for the task, including information about their availability and development stage
- Expected number of participants and attendees
- Names and contact information of the organizers

The organizers of the accepted tasks should take care of planning, according to the scheduled deadlines (to be decided by the workshop chairs):
- the development and distribution of data sets needed for the contest, i.e. data for training and development, and data for testing 
- the development of task guidelines, where all the instructions for the participation are made clear together with a detailed description of data and evaluation metrics applied for the evaluation of the participant results
- the collection of participants results 
- the evaluation of participants results according to standard metrics
- the solicitation of submissions (according to the format to be made available by the workshop chairs) 
- the reviewing process of the papers describing the participants approach and results
- the production of a paper describing the task (according to the format to be made available by the workshop chairs)

Email your proposal in PDF format to bosco at di.unito.it with "Evalita 2014 TASK Proposal" as the subject line by the submission deadline (30th January 2014). Please feel free to contact the workshop chairs in case of any questions or suggestions.


IMPORTANT DATES:

- 15th January 2014 extended to 30th January 2014: submission of task proposals

- 31th January 2014 extended to 10th February 2014: notification of task proposal acceptance; call for Interest opens

- 1st March 2014: on-line registration opens

- 15th May 2014: development data available to participants

- 8th September 2014: test data available, registration closes

- 15th September 2014: system results due to organizers

- 22th September 2014: assessment returned to participants

- 31st October 2014: technical reports due to organizers

- 11 December 2014: final workshop (after CLIC-2014)



EVALITA-2014 CHAIRS

- For NLP tasks:
Cristina Bosco (University of Torino)
Alessandro Mazzei (University of Torino)
Maria Simi (University of Pisa)
Simonetta Montemagni (Istituto di Linguistica Computazionale "Antonio Zampolli" - CNR, Pisa)

- For Speech Technology Evaluation:
Piero Cosi (Istituto di Scienze e Tecnologie della Cognizione - CNR, Padova) 
Mauro Falcone (Fondazione Ugo Bordoni)


CONTACT PERSON:
Cristina Bosco (bosco at di.unito.it)



_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora