[Corpora-List] Call for Participation: The 3nd Chinese Parsing Evaluation (CIPS-SIGHAN-ParsEval-2012)

[Qiang Zhou]

==============================================================================
Call for Participation

The 3nd Chinese Parsing Evaluation：CIPS-SIGHAN-ParsEval-2012
http://202.118.18.77:8080/clp2012/index.html
==============================================================================

== INTRODUCTION

The first and second Chinese parsing evaluations (CIPS-ParsEval-2009 and CIPS-SIGHAN-ParsEval-2010) were held successfully in 2009 and 2010 respectively. The evaluation results in the Chinese clause and sentence levels show that the complex sentence parsing is still a big challenge for the Chinese language. This time we will focus on the sentence parsing task proposed by the second CIPS-ParsEval to dig out the detailed difficulties of Chinese complex sentence parsing in the respect of two typical sentence complexity schemes: event combination in the sentence level and concept composition in the clausal level. We will introduce a new lexicon-based Combinatory Categorical Grammar (CCG) annotation scheme in the evaluation, and make a parallel comparison of the parser performance with the traditional Phrase Structure Grammar (PSG) used in the Tsinghua Chinese Treebank (TCT).


== TASK OVERVIEW

This evaluation includes two sub-tasks, i.e. PSG parsing evaluation and CCG parsing evaluation. For each sub-task, there are two tracks. One is the Close track in which model parameter estimation is conducted solely on the train data. The other is the Open track in which any datasets besides given training data can be used to estimate model parameters. We will take separate evaluations for these two tracks.

 

Sub task 1:  PSG Parsing Evaluation

       Input: A Chinese sentence with correct word segmentation annotation. 

Parsing goal: Assign appropriate part-of-speech (POS) tags to the words and generate phrase structure tree for the sentence.

Output: The phrase structure tree with POS tags for the sentence.

 

Sub task 2:  CCG Parsing Evaluation

       Input: A Chinese sentence with correct word segmentation annotation. 

Parsing goal: Assign appropriate CCG category tags to the words and generate CCG derivation tree for the sentence.

Output: The CCG derivation tree with CCG category tags for the sentence. 

 


== FOR MORE DETAILS

Please visit  http://202.118.18.77:8080/clp2012/task3.html
A link to the CIPS-SIGHAN-ParsEval-2012 task participants registration page is now available from this page.

Please note that the registration deadline is June 30, 2012 (for all CLP 2012 Bake-offs tasks)

== ORGANIZERS

Qiang Zhou (CSLT, RIIT, Tsinghua University)

If you have any questions, please send e-mails to the task organizer: zq-lxd at mail.tsinghua.edu.cn
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20120615/49fe659f/attachment.htm>
-------------- next part --------------
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora