[Corpora-List] CoNLL Shared Task 2013: Call for Proposals (extended)

[Erik Tjong Kim Sang]

CoNLL Shared Task 2013: Call for Proposals (extended)

SIGNLL (ACL's Special Interest Group on Natural Language Learning)
invites proposals for the CoNLL Shared Task 2013. Since 1999, CoNLL
(the Conference on Computational Natural Language Learning) has
included a shared task in which training and test data are provided
by the organizers, which allows participating systems to be evaluated
and compared in a systematic way. Descriptions of the participating
systems and an evaluation of their performance are presented both at
the conference and in the proceedings. Previous shared tasks have
been devoted to chunking (1999, 2000), clausing (2001), named entity
recognition (2002, 2003), semantic role labeling (2004, 2005),
dependency parsing (2006, 2007), joint parsing of syntactic and
semantic dependencies (2008, 2009), hedge detection (2010), and
co-reference resolution (2011, 2012). For CoNLL-2013, to be held in
conjunction with ACL in Sofia, Bulgaria, August 4 to 9, 2013,
proposals are invited for any shared task involving natural language
learning, including not only natural language processing tasks and
applications but also the modeling of human language learning.

Proposals should contain the following information:
- Names and affiliations of the members of the organizing committee
     (including a designated contact person)
- Description of the shared task, including its relevance for the
     study of computational natural language learning
- Description of the process for selecting, acquiring and preparing the
     data for training and evaluation, including conditions of
     availability
- Description of the procedure for evaluating the performance of
     participating systems, including the availability of evaluation
     software
- Any other relevant information

A tentative timeline for the CoNLL shared task 2013 is as follows:
- November 15, 2012: general announcement (made by SIGNLL)
- December 17, 2012: call for interest in participation
- February 1, 2013: task website (first version with general
   information, task definition, examples and calendar)
- February 1, 2013: trial datasets (plus documentation and scorer)
- February 15, 2013: registration for the task (plus corpora licenses)
- March 1, 2013: training and development sets available
- May 5, 2013: test set available
- May 10, 2013: systems' outputs collected
Proposals should make clear that a similar schedule can be implemented,
especially for the preparation of resources (trial/training
/development/test data sets).

Proposals should be in PDF format, maximum 2 pages, and sent by e-mail
to carreras at lsi.upc.edu no later than *October 10*. Proposals will
be reviewed by the SIGNLL steering committee and proposers will be
notified about the selection before October 31. Questions regarding the
proposals can be sent to carreras at lsi.upc.edu.

_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora