29.312, Calls: Italian, Computational Linguistics/Italy

The LINGUIST List linguist at listserv.linguistlist.org
Wed Jan 17 23:46:40 UTC 2018


LINGUIST List: Vol-29-312. Wed Jan 17 2018. ISSN: 1069 - 4875.

Subject: 29.312, Calls: Italian, Computational Linguistics/Italy

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Helen Aristar-Dry, Robert Coté,
                                   Michael Czerniakowski)
Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           http://funddrive.linguistlist.org/donate/

Editor for this issue: Kenneth Steimel <ken at linguistlist.org>
================================================================


Date: Wed, 17 Jan 2018 18:46:11
From: Tommaso Caselli [t.caselli at rug.nl]
Subject: 6th Evaluation Campaign of NLP and Speech Technology for Italian

 
Full Title: EVALITA 2018 6th Evaluation Campaign of NLP and Speech Technology for Italian 

Date: 12-Dec-2018 - 13-Dec-2018
Location: Turin, Italy 
Contact Person: Tommaso Caselli
Meeting Email: evalita2018 at gmail.com

Linguistic Field(s): Computational Linguistics 

Subject Language(s): Italian (ita)

Call Deadline: 12-Feb-2018 

Meeting Description:

The 6th evaluation campaign EVALITA 2018 will be held in Turin, as a satellite
event of the 5th Italian Conference on Computational Linguistics - CLiC-it
2018 (December 10-12, 2018).
EVALITA 2018 is an initiative of AILC (Associazione Italiana di Linguistica
Computazionale, http://www.ai-lc.it/).

As in the previous editions (http://www.evalita.it/), EVALITA 2018 will be
organized along few selected tasks, which provide participants with
opportunities to discuss and explore both emerging and traditional areas of
Natural Language Processing and Speech for Italian. The participation is
encouraged for teams working both in academic institutions and industrial
organizations.


Call for Proposals:

EVALITA 2018

As in the previous editions, EVALITA 2018 (http://www.evalita.it/), an
initiative of AILC (Associazione Italiana di Linguistica Computazionale,
http://www.ai-lc.it/) will be organized along selected tasks in all areas of
Natural Language Processing and Speech for Italian. Participation is
encouraged for teams working both in academic institutions and industrial
organizations.

Tasks proposals should be no longer than 4 pages and should include:

- Task title and acronym
- Names and affiliation of the organizers (minimum 2 organizers)
- Brief task description, including motivations and state of the art showing
the international relevance of the task
- Description and examples of the data needed for the task, including
information about availability and development stage
- Expected number of participants and attendees
- Names and contact information of the organizers

In submitting your proposal, bear in mind that we encourage:

- The re-annotation of datasets from previous years with new annotation types
or texts from publicly available corpora
- Application-oriented tasks, that is tasks that have a clearly defined
end-user application showcasing
- Both new tasks and re-runs. For new tasks, you must specify why this would
attract a reasonable number of participants, and why is needed. For a re-run,
you must defend the need for having such task again (new metrics, new types of
data, new domains, growing interest, etc.)

Organizers of the accepted tasks should take care of planning, according to
the scheduled deadlines (see below):

- The development and distribution of data sets needed for the contest, i.e.
data for training and development, and data for testing; the scorer to be used
to evaluate the submitted systems should be included in the release of
development data
- The development of task guidelines, where all the instructions for the
participation are made clear together with a detailed description of data and
evaluation metrics applied for the evaluation of the participant results; -
the collection of participants results
- The evaluation of participants results according to standard metrics and
baseline(s) 
- The solicitation of submissions 
- The reviewing process of the papers describing the participants approach and
results (according to the template to be made available by the EVALITA-2018
chairs)
- The production of a paper describing the task 

Email your proposal in PDF format to evalita2018 at gmail.com with ''Evalita 2018
TASK Proposal'' as the subject line by the submission deadline (February 12,
2018). 

Please feel free to contact the EVALITA-2018 chairs at evalita2018 at gmail.com
in case of any questions or suggestions.

Important Dates:

12 February 2018: submission of task proposals
5 March 2018: notification of task proposal acceptance; call for Interest
opens
12 March 2018: on-line registration opens
28 May 2018: development data available to participants
3 September 2018: test data available, registration closes
3 - 23 September 2018: evaluation window
30 September 2018: assessment returned to participants
5 November 2018 (tentative): technical reports due to organizers (camera
ready) 
12 or 13 December 2018: final workshop, in conjunction with the 5th Italian
Conference on Computational Linguistics - CLiC-it 2018 (Turin, December 10-12,
2018).

EVALITA-2018 Chairs:

Tommaso Caselli (Center for Language and Cognition Groningen,
Rijksuniversiteit Groningen, The Netherlands)HAIRS
Nicole Novielli (Dipartimento di Informatica, University of Bari ''A. Moro'',
Italy)
Viviana Patti (Dipartimento di Informatica, Università degli Studi di Torino,
Italy)
Paolo Rosso (PRHLT Research Center, Universitat Politècnica de València,
Spain)




------------------------------------------------------------------------------

*****************    LINGUIST List Support    *****************
Please support the LL editors and operation with a donation at:
            http://funddrive.linguistlist.org/donate/
 


----------------------------------------------------------
LINGUIST List: Vol-29-312	
----------------------------------------------------------






More information about the LINGUIST mailing list