29.1900, FYI: Shared Task on Irony Detection in Italian Tweets

The LINGUIST List linguist at listserv.linguistlist.org
Fri May 4 21:12:42 UTC 2018


LINGUIST List: Vol-29-1900. Fri May 04 2018. ISSN: 1069 - 4875.

Subject: 29.1900, FYI: Shared Task on Irony Detection in Italian Tweets

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Helen Aristar-Dry, Robert Coté,
                                   Michael Czerniakowski)
Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           http://funddrive.linguistlist.org/donate/

Editor for this issue: Kenneth Steimel <ken at linguistlist.org>
================================================================


Date: Fri, 04 May 2018 17:12:24
From: Alessandra Teresa Cignarella [cigna at di.unito.it]
Subject: Shared Task on Irony Detection in Italian Tweets

 
Call for Participants:    

Task: Irony Detection in Italian Tweets (ironITA) in the context of EVALITA
2018

Info: http://di.unito.it/ironita18

Final Workshop: 12-13 December 2018, Turin, Italy (co-located with CLiC-it
2018)

Registration is required to obtain data and participate in the shared task. 

Register at http://www.evalita.it/2018/registration

The ironITA Task:

We propose two different subtasks for the automatic detection of irony on
Twitter. Participants may choose to participate to both the tasks or only to
one sub-task.

A) Irony detection:

The first subtask is a two-class (or binary) classification task where the
system has to predict whether a tweet is ironic or not.
Given a message, decide whether the message is ironic or not.

B) Different types of irony (with special focus on sarcasm identification):

The second subtask is a multi-class classification task where the system has
to predict one out of three labels describing:

i) Sarcasm
ii) Irony which cannot be categorized as sarcasm (i.e. other kinds of verbal
irony or descriptions of situational irony which do not show the
characteristics of sarcasm)
iii) Non-irony

Given a message, decide whether the message is  sarcastic, ironic but not
sarcastic or not ironic. Notice that in our interpretation sarcasm is a
specific kind of irony.

Irony and sarcasm are present in many domains of great interest nowadays, such
as hate speech and political stance. For this reason, we will include in our
datasets tweets related to those domains. In particular, a portion of tweets
will overlap with data from the EVALITA 2018 shared task devoted to Hate
Speech Detection (HaSpeeDe).

Further details on the task, data, and evaluation are available at the task
website: http://di.unito.it/ironita18 

Important Dates:

28 May 2018: Training set available.
3 September 2018: Registration closes.
17 September 2018: Test set available.
23 September 2018: Systems results due to the organizers.
1 October 2018: Assessment returned to participants.
15 October 2018: Submission of the working notes due to the organizers.
25 October 2018: Reviews to participants.
5 November 2018: Camera-ready working notes due.
12 or 13 December 2018: Final workshop in Turin.

Organizers:

Alessandra T. Cignarella, University of Torino, Italy  (cigna at di.unito.it)
[Primary Contact]
Simona Frenda, University of Torino, Italy  (frenda at di.unito.it) [Primary
Contact]
Cristina Bosco, University of Torino, Italy
Viviana Patti, University of Torino, Italy
Paolo Rosso, Universitat Politècnica de València, Spain

Contact:

Join the google group: ironita-evalita2018 at googlegroups.com
 



Linguistic Field(s): Computational Linguistics

Subject Language(s): Italian (ita)





 



------------------------------------------------------------------------------

*****************    LINGUIST List Support    *****************
Please support the LL editors and operation with a donation at:

              The IU Foundation Crowd Funding site:
       https://iufoundation.fundly.com/the-linguist-list

               The LINGUIST List FundDrive Page:
            http://funddrive.linguistlist.org/donate/
 


----------------------------------------------------------
LINGUIST List: Vol-29-1900	
----------------------------------------------------------






More information about the LINGUIST mailing list