28.4011, FYI: SemEval-2018 Task 9: Hypernym Discovery

[The LINGUIST List]

LINGUIST List: Vol-28-4011. Fri Sep 29 2017. ISSN: 1069 - 4875.

Subject: 28.4011, FYI: SemEval-2018 Task 9: Hypernym Discovery

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Helen Aristar-Dry, Robert Coté,
                                   Michael Czerniakowski)
Homepage: http://linguistlist.org

Please support the LL editors and operation with a donation at:
           http://funddrive.linguistlist.org/donate/

Editor for this issue: Kenneth Steimel <ken at linguistlist.org>
================================================================


Date: Fri, 29 Sep 2017 12:13:18
From: Enrico Santus [esantus at mit.edu]
Subject: SemEval-2018 Task 9: Hypernym Discovery

 
Training data released:
https://competitions.codalab.org/competitions/17119#participate

Evaluation deadline: 29 Jan 2018, 23:59 GMT

The organizers of the SemEval-2018 - Task 9 are pleased to announce the shared
task on Hypernym Discovery.

Hypernymy, i.e. the capability for generalization, lies at the core of human
cognition. It is not surprising, therefore, that identifying hypernymic
relations (i.e., is-a relations) has been pursued in NLP for over two decades.
This task contributes in fact to the improvement of Question Answering,
Textual Entailment and Semantic Search systems. In addition, hypernymic
relations are the backbone of almost any ontology, semantic network and
taxonomy, being therefore fundamental for downstream tasks, such as web
retrieval, website navigation or records management.

In previous editions of SemEval, the identification of hypernymic relations
from text corpora has been evaluated within the broader task of Taxonomy
Evaluation. Most of other attempts have approached hypernymic relations
through the task of Hypernym Detection, i.e. the binary task consisting of,
given a pair of words, deciding whether a hypernymic relation holds between
them or not.

This experimental setting has already led to criticisms regarding its alleged
oversimplification. Inspired by recent work, we propose therefore to
reformulate the problem as Hypernym Discovery, i.e. given the search space of
a domain’s vocabulary, and an input concept, discover its best (set of)
hypernyms.

Colleagues are invited to participate by proposing a system for hypernym
discovery by the evaluation deadline, on the 29 January 2018 (test data will
be released on the 8 January). Training Data has just been released and it is
accessible in the task's website.

Short papers describing the systems and their evaluation results must be
submitted by the 26 February 2018. All papers that meet the formal review
criteria will be published in the workshop proceedings.

For further details and downloads see the task homepage:
https://competitions.codalab.org/competitions/17119#learn_the_details

For any communication, feel free to join our Google Group:
https://groups.google.com/d/forum/semeval2018-hypernymdiscovery

Important Dates:

25 Sep 2017: Training data release.
08 Jan 2018: Test data release. Evaluation start
29 Jan 2018: Evaluation end
05 Feb 2018: Results Posted
26 Feb 2018: System description paper submissions due by 23:59 GMT -12:00
19 Mar 2018: Paper reviews due
02 Apr 2018: Author notifications
16 Apr 2018: Camera ready submissions due

Shared Task Organizers:

Jose Camacho-Collados - Sapienza University of Rome
Claudio Delli Bovi - Sapienza University of Rome
Tommaso Pasini - Sapienza University of Rome
Roberto Navigli - Sapienza University of Rome
Vered Shwartz - Bar-Ilan University
Luis Espinosa-Anke - Universitat Pompeu Fabra
Sergio Oramas - Universitat Pompeu Fabra
Horacio Saggion - Universitat Pompeu Fabra
 



Linguistic Field(s): Computational Linguistics





 



------------------------------------------------------------------------------

*****************    LINGUIST List Support    *****************
Please support the LL editors and operation with a donation at:
            http://funddrive.linguistlist.org/donate/
 


----------------------------------------------------------
LINGUIST List: Vol-28-4011	
----------------------------------------------------------