26.550, Calls: German, Computational Linguistics/Germany

[The LINGUIST List via LINGUIST]

LINGUIST List: Vol-26-550. Mon Jan 26 2015. ISSN: 1069 - 4875.

Subject: 26.550, Calls: German, Computational Linguistics/Germany

Moderators: linguist at linguistlist.org (Damir Cavar, Malgorzata E. Cavar)
Reviews: reviews at linguistlist.org (Anthony Aristar, Helen Aristar-Dry, Sara Couture)
Homepage: http://linguistlist.org

Editor for this issue: Anna White <awhite at linguistlist.org>
================================================================


Date: Mon, 26 Jan 2015 17:19:13
From: Tristan Miller [miller at ukp.informatik.tu-darmstadt.de]
Subject: GermEval 2015: LexSub

 
Full Title: GermEval 2015: LexSub 

Date: 30-Sep-2015 - 02-Oct-2015
Location: Duisburg-Essen, Germany 
Contact Person: Tristan Miller
Meeting Email: miller at ukp.informatik.tu-darmstadt.de
Web Site: https://sites.google.com/site/germeval2015 

Linguistic Field(s): Computational Linguistics 

Subject Language(s): German (deu)

Call Deadline: 15-Jul-2015 

Meeting Description:

GermEval 2015: LexSub
(German Lexical Substitution Shared Task)

https://sites.google.com/site/germeval2015

Introduction:

We invite all researchers and industry professionals to participate in GermEval 2015: LexSub, the first lexical substitution task for the German language. We plan for the task to be associated with the International Conference of the German Society for Computational Linguistics and Language Technology 2015 (GSCL 2015) in Duisburg-Essen, and to take place as a workshop there in September/October 2015.

Task Description:

Lexical substitution is the task of identifying an appropriate substitute for a target word in a given context. For example, in the sentence ''She's a bright kid who excels academically,'' an appropriate substitute for ''bright'' might be ''smart'', whereas an inappropriate one would be ''glowing''. Automatically identifying substitution candidates, and selecting those which best match the context, requires intelligent application of lexical-semantic knowledge and word sense disambiguation techniques. However, unlike traditional WSD tasks, lexical substitution does not mandate the use of any particular sense inventory.

The data for the GermEval 2015: LexSub task is described by Cholakov et al. in ''Lexical substitution dataset for German'' (Proc. LREC, 2014). All together it consists of 2040 sentences from the German Wikipedia, each containing a target word and a list of substitutions proposed by human annotators. There are 153 unique target words, equally distributed across parts of speech (nouns, verbs, and adjectives) and three frequency groups. About half of this data (26 nouns, 26 verbs, and 26 adjectives in 1040 sentence contexts) forms the training set, which will be made available to participants in advance. The remainder forms the test set, which will be used for the evaluation and published in full only after the shared task is completed.

Systems' performance will be measured by comparing their substitutes against those selected by the human annotators; for this we will use the ''best'', ''out of ten'', and ''generalized average precision'' metrics. The organizers will provide a scoring system and the output of some baseline systems.

Call for Participation:

Practical Information:

- 23 January 2015: Availability of training data
- 1 July 2015: Availability of test data
- 15 July 2015: Deadline for initial submission of papers and results
- 1 August 2015: Notification of acceptance and shared task results
- 15 August 2015: Deadline for camera-ready papers
- 30 September–2 October 2015: GSCL 2015

Submissions will consist of a file providing the substitutions for each instance of the target data and a paper of up to four pages (including references) describing the approach and analyzing the performance. Papers should follow the GSCL 2015 style guide, and will be reviewed and published in an online volume of workshop proceedings. (We may ask participants to peer-review other submissions.) Participants are expected to present summaries of their systems at the GermEval 2015: LexSub workshop at GSCL 2015.

Organizing Committee:

- Sallam Abualhaija, Technische Universität Hamburg-Harburg
- Darina Benikova, LT Group, Technische Universität Darmstadt
- Chris Biemann, LT Group, Technische Universität Darmstadt
- Judith Eckle-Kohler, UKP Lab, Technische Universität Darmstadt
- Iryna Gurevych, UKP Lab, Technische Universität Darmstadt
- Tristan Miller, UKP Lab, Technische Universität Darmstadt







----------------------------------------------------------
LINGUIST List: Vol-26-550	
----------------------------------------------------------