[Corpora-List] Call for Participation: CoNLL-2014 Shared Task on Grammatical Error Correction

[Christian Hadiwinoto]

CoNLL-2014 Shared Task: Grammatical Error Correction
Baltimore, Maryland, USA
June 26-27, 2014

http://www.comp.nus.edu.sg/~nlp/conll14st.html

======================
Call for Participation
======================

CoNLL-2014 will continue the CoNLL tradition of having a high profile shared
task in natural language processing. This year's shared task will be
grammatical error correction, a continuation of the CoNLL shared task in
2013. A participating system in this shared task is given short English
texts written by non-native speakers of English. The system detects the
grammatical errors present in the input texts, and returns the corrected
essays. The shared task in 2014 will require a participating system to
correct all errors present in an essay (i.e., not restricted to just five
error types in 2013). Also, the evaluation metric will be changed to F0.5,
weighting precision twice as much as recall.

The grammatical error correction task is impactful since it is estimated
that hundreds of millions of people in the world are learning English and
they benefit directly from an automated grammar checker. However, for many
error types, current grammatical error correction methods do not achieve a
high performance and thus more research is needed.

Participating teams will be provided with common training data in which
grammatical errors have been annotated. Blind test data will be used to
evaluate the outputs of the participating teams using a common scoring
software and evaluation metric.

Registration
------------

Registration for the shared task has begun. To participate in the shared
task, please download the license form
(http://www.comp.nus.edu.sg/~nlp/conll14st/nucle_license.pdf) for usage of
the training data. Print the form, sign, and have the scanned PDF file of
the signed form ready. You may then proceed to register your team through
our registration page
(http://sterling8.ddns.comp.nus.edu.sg/conll14st/register/) by providing the
particulars (name, affiliation, and email address) of the main contact
person and all the other team members. Please upload your scanned PDF file
of the *signed* form through the same page.

After you have registered, we will get back to you within two days. If your
registration is complete, you will be provided with the training data and
the scorer for the shared task. You will also be added to a Google Group
where discussions of the details of the shared task will take place. As
such, please register early so that you are informed of the details of the
shared task. If you encounter problems in registering or you do not hear
from us after two days, please inform us through the shared task contact
email address conll14st at gmail.com.

Important Dates
---------------

* November 22, 2013: announcement of shared task
* December 5, 2013: set up of shared task website
* December 27, 2013: registration begins and release of training set and
scorer
* January 22, 2014: registration deadline
* March 16, 2014: test set available
* March 19, 2014: systems' outputs collected
* March 26, 2014: system results due to participants
* April 2, 2014: shared task system papers due
* April 11, 2014: reviews due
* April 14, 2014: notification of acceptance
* April 21, 2014: camera ready version of shared task system papers due
* June 26-27, 2014: CoNLL-2014 conference (Baltimore, Maryland, USA)

Shared Task Organizers
----------------------

* Hwee Tou Ng (Chair), National University of Singapore
* Siew Mei Wu, National University of Singapore
* Ted Briscoe, University of Cambridge
* Christian Hadiwinoto, National University of Singapore
* Raymond Hendy Susanto, National University of Singapore

Contact
-------

Questions about the CoNLL-2014 shared task can be sent to
conll14st at gmail.com.


Yours sincerely,
Christian Hadiwinoto



_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora