27.4915, Calls: Coreference Resolution : Computational Linguistics/Spain

Thu Dec 1 17:19:24 UTC 2016

LINGUIST List: Vol-27-4915. Thu Dec 01 2016. ISSN: 1069 - 4875.

Subject: 27.4915, Calls: Coreference Resolution : Computational Linguistics/Spain

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Helen Aristar-Dry, Robert Coté,
                                   Michael Czerniakowski)
Homepage: http://linguistlist.org

*****************    LINGUIST List Support    *****************
                       Fund Drive 2016
                   25 years of LINGUIST List!
Please support the LL editors and operation with a donation at:
           http://funddrive.linguistlist.org/donate/

Editor for this issue: Kenneth Steimel <ken at linguistlist.org>
================================================================

Date: Thu, 01 Dec 2016 12:19:17
From: Yulia Grishina [grishina at uni-potsdam.de]
Subject: Shared Task on Projection-Based Coreference Resolution

Full Title: Shared Task on Projection-Based Coreference Resolution 
Short Title: CORBON Shared Task 

Date: 03-Apr-2017 - 04-Apr-2017
Location: Valencia, Spain 
Contact Person: Yulia Grishina
Meeting Email: grishina at uni-potsdam.de
Web Site: http://corbon.nlp.ipipan.waw.pl/index.php/shared-task/ 

Linguistic Field(s): Computational Linguistics 

Call Deadline: 27-Dec-2016 

Meeting Description:

This shared task will be a part of the CORBON workshop, co-located with EACL
2017. 

The CORBON workshop will focus on:

- Coreference resolution for less-researched languages (e.g., annotation
strategies, resolution modules and formal evaluation)
- Evaluation of influence of language-specific properties such as lack of
articles, quasi-anaphora, ellipsis or complexity of reflexive pronouns to
coreference resolution
- Representation of coreferential relations other than identity coreference
(e.g., bridging references, reference to abstract entities, etc.)
- Investigation of difficult cases of anaphora and coreference and their
resolution by resorting to e.g. discourse-based and pragmatic levels
- Coreference resolution in noisy data (e.g. in speech and social networks)
- New applications of coreference resolution.

The shared task for the conference focuses on similar areas. Previous shared
tasks on coreference resolution (e.g., the SemEval 2010 shared task
Coreference Resolution in Multiple Languages, the CoNLL 2011 and CoNLL 2012
shared tasks) operated in a setting where a large amount of training data was
provided to train coreference resolvers in a fully supervised manner. Our
shared task has a different goal: we are primarily interested in a
low-resource setting. In particular, we seek to investigate how well one can
build a coreference resolver for a language for which there is no
coreference-annotated data available for training.

With a rising interest in annotation projection, we hereby offer a
projection-based task which will facilitate the application of existing
coreference resolution algorithms to new languages. We believe that with this
exciting setting, the shared task can help promote the development of
coreference technologies that are applicable to a larger number of natural
languages than is currently possible.

This year we will focus on two languages — German and Russian. To mimic a
low-resource setting, no German or Russian coreference-annotated data will be
provided. Rather, to facilitate system development, the shared task
participants will be provided two versions of an English-German-Russian
parallel corpus: an unlabelled version and a labelled version. The labelled
version has the English side of the parallel corpus automatically
coreference-labelled using the Berkeley coreference resolver, which was
trained on the English OntoNotes corpus.

More information on the Shared Task on Projection-Based Coreference Resolution
can be found at http://corbon.nlp.ipipan.waw.pl/index.php/shared-task/ .

Call for Papers:

Shared Task Tracks:

Participants will compete in two tracks: 

Closed track: projection-based coreference resolution on German and Russian.
The only coreference-annotated training data that the participants can use is
the English OntoNotes corpus. Alternatively, they can use any of the
publicly-available coreference resolvers trained on English OntoNotes. They
can then use whatever parallel corpus and method they prefer to project the
English annotations into German/Russian and subsequently train a new
coreference resolver on the projected annotations. As for additional
linguistic information, the participants can use POS information provided by
the parser of their choice. Note that they do not have to use the provided
English-German-Russian parallel corpus. 

Open track: coreference resolution on German and Russian with no restriction
on the kind of coreference-annotated data the participants can use for
training. For instance, they can label their own German/Russian coreference
data and use it to train a German/Russian coreference resolver, or they can
adopt a heuristic-based approach where they employ knowledge of German/Russian
to write coreference rules for these languages.
The participants can choose to take part in either one or both tracks.

Data:

Please see the Data package section at
http://corbon.nlp.ipipan.waw.pl/index.php/shared-task/.

Evaluation:

The evaluation will follow CoNLL-2012 shared task's strategy. The ranking
score will be determined by computing the unweighted average across the MUC,
B-CUBED and CEAFE.

The systems will be run on test data by participants who are required to send
their outputs to the Shared Task Coordinator by December 27 (CET).

Important Dates:

November 29, 2015: Training data released
December 19, 2016: Test data released
December 27, 2016: System outputs collected
January 6, 2017: Shared task results announced
January 16, 2017: System description paper due
February 11, 2017: Notification of acceptance
February 21, 2017: Camera-ready papers due
April 3 or 4, 2017: Workshop date

Organizers:

Yulia Grishina (University of Potsdam)

------------------------------------------------------------------------------

*****************    LINGUIST List Support    *****************
                       Fund Drive 2016
Please support the LL editors and operation with a donation at:
            http://funddrive.linguistlist.org/donate/

        Thank you very much for your support of LINGUIST!

----------------------------------------------------------
LINGUIST List: Vol-27-4915	
----------------------------------------------------------