29.1566, Calls: Italian, Computational Linguistics/Italy

The LINGUIST List linguist at listserv.linguistlist.org
Tue Apr 10 22:16:49 UTC 2018


LINGUIST List: Vol-29-1566. Tue Apr 10 2018. ISSN: 1069 - 4875.

Subject: 29.1566, Calls: Italian, Computational Linguistics/Italy

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Helen Aristar-Dry, Robert Coté,
                                   Michael Czerniakowski)
Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           http://funddrive.linguistlist.org/donate/

Editor for this issue: Kenneth Steimel <ken at linguistlist.org>
================================================================


Date: Tue, 10 Apr 2018 18:16:13
From: Tommaso Caselli [t.caselli at rug.nl]
Subject: EVALITA 2018 6th Evaluation Campaign of NLP and Speech Technology for Italian

 
Full Title: EVALITA 2018 6th Evaluation Campaign of NLP and Speech Technology for Italian 

Date: 12-Dec-2018 - 13-Dec-2018
Location: Turin, Italy 
Contact Person: Tommaso Caselli
Meeting Email: evalita2018 at gmail.com

Linguistic Field(s): Computational Linguistics 

Subject Language(s): Italian (ita)

Call Deadline: 03-Sep-2018 

Meeting Description:

The 6th evaluation campaign EVALITA 2018 will be held in Turin, as a satellite
event of the 5th Italian Conference on Computational Linguistics - CLiC-it
2018 (December 10-12, 2018).
EVALITA 2018 is an initiative of AILC (Associazione Italiana di Linguistica
Computazionale, http://www.ai-lc.it/).

As in the previous editions (http://www.evalita.it/), EVALITA 2018 will be
organized along few selected tasks, which provide participants with
opportunities to discuss and explore both emerging and traditional areas of
Natural Language Processing and Speech for Italian. The participation is
encouraged for teams working both in academic institutions and industrial
organizations.


2nd Call for Participation:

The general objective of EVALITA (http://www.evalita.it) is to promote the
development of language technologies for the Italian language, providing a
shared framework where different systems and approaches can be evaluated in a
consistent manner. EVALITA is an initiative of the Italian Association for
Computational Linguistics (AILC) and it is endorsed by the Italian Association
for Artificial Intelligence (AI*IA) and the Italian Association for Speech
Sciences (AISV).

For the 2018 edition tasks are organized along the following tracks:

Affect, Creativity and Style  
- ABSITA - Aspect-based Sentiment Analysis 
- ITAMoji - Italian Emoji Prediction 
- IronITA - Irony Detection in Twitter 
- GxG - Cross-Genre Gender Prediction 

Dialogue Systems  
- iLISTEN - itaLIan Speech acT labEliNg
- IDIAL - Italian DIALogue systems evaluation

Hate Speech  
- AMI - Automatic Misogyny Identification (aligned with IberEval2018)
- HaSpeeDe - Hate Speech Detection 

Semantics4AI  
- NLP4FUN - Solving language games 
- SUGAR - Spoken Utterances Guiding chef’s Assistant Robots 

As with other international evaluation campaigns, guidelines describing the
different tasks will be distributed among the participants.

Participants to the tasks will also be provided with training data and will
have the chance to test their systems according to the metrics and procedures
to be used in the formal evaluation. 

The results of the evaluation will be disseminated at the final workshop,
which will be organised in Turin as a co-located event of the 5th Italian
Conference on Computational Linguistics - CLiC-it 2018 (December 10-12, 2018).

We encourage participation from both academic institutions and industrial
organisations. Please visit the EVALITA web site where information about all
tasks is currently available (http://www.evalita.it/2018/tasks), and indicate
your intention to participate and the specific task(s) you are interested in.
You can do so by filling out the registration form at the following link,
which will be available until September 3 2018, when test sets will be made
available by the task organizers.

http://www.evalita.it/2018/registration

Registration is compulsory to participate in the task(s) you selected,
although it is not binding. In any case, independently of your registration,
you can decide to withdraw from participating by not sending the system
results during the evaluation stage. 

Important Dates:

28 May 2018: development data available to participants
3 September 2016: registration closes
3 - 23rd September 2018: evaluation windows and collection of participants
results, as follows:
3 - 10 Sept. 2018: Evaluation Window I - Tasks: ITAMoji; HaSpeeDe
10 - 16 Sept. 2018: Evaluation Window II - Task: GxG, SUGAR, ABSITA, NLP4FUN
16 - 23 Sept. 2018: Evaluation Window III - Tasks:  iLISTEN, AMI, IronITA
30 September 2018: assessment returned to participants
5 November 2018 (tentative): technical reports due to organisers
12 or 13 December 2018: final workshop

Scientific coordination:

Tommaso Caselli (Center for Language and Cognition Groningen,
Rijksuniversiteit Groningen, The Netherlands)
Nicole Novielli (Dipartimento di Informatica, Università di Bari “A. Moro”,
Italy)
Viviana Patti (Dipartimento di Informatica, Università degli Studi di Torino,
Italy)
Paolo Rosso (PRHLT Research Center, Universitat Politècnica de València,
Spain)

Contact:
evalita2018[AT]gmail.com

FOLLOW US!
Twitter: @EVALITAcampaign
Facebook: https://www.facebook.com/evalita2018/




------------------------------------------------------------------------------

*****************    LINGUIST List Support    *****************
Please support the LL editors and operation with a donation at:
            http://funddrive.linguistlist.org/donate/
 


----------------------------------------------------------
LINGUIST List: Vol-29-1566	
----------------------------------------------------------






More information about the LINGUIST mailing list