[Corpora-List] Call for Participation: SemEval-2010 Shared Task 7 (Argument Selection and Coercion)

[Anna Rumshisky]

Call for Participation:  SemEval-2010 Shared Task #7 (Argument Selection and
Coercion)

Webpage:
http://asc-task.org

This shared task will be of interest to researchers working on:
- Predicate-argument structure
- Type shifting violations and coercions
- Metaphor and Metonymy
- Creative word use

Task Description

This task involves identifying the compositional operations involved in
argument selection. Most annotation schemes to date encoding propositional
or predicative content have focused on the identification of the predicate
type, the argument extent, and the semantic role (or label) assigned to
that argument by the predicate. In contrast, this task attempts to capture
the 'compositional history' of the argument selection relative to the
predicate. In particular, this task attempts to identify the operations of
type adjustment induced by a predicate over its arguments when they do not
match its selectional properties. The task is defined as follows: for each
argument of a predicate, identify whether the entity in that argument
position satisfies the type expected by the predicate. If not, then one
needs to identify how the entity in that position satisfies the typing
expected by the predicate; that is, to identify the source and target types
in a type-shifting (or coercion) operation. The possible relations between
the predicate and a given argument will, for this task, be restricted to
selection and coercion.

In selection, the argument NP satisfies the typing requirements of the
predicate. For example, in the sentence 'The child threw the ball', the
object NP 'the ball' directly satisfies the type expected by the predicate,
Physical Object.

If this is not the case, then a coercion has occurred. For example, in the
sentence 'The White House denied this statement.', the type expected in
subject position by the predicate is Human, but the surface NP is typed as
Location. The task is to identify both the type mismatch and the type
shift; namely Location -> Human.

Resources and Corpus Development

The following methodology was used in the creation of the data set: (1) For
a chosen set of selection contexts, randomly select a set of sentences from
a variety of corpora, including the BNC and other sources; (2) Identify the
target noun phrase in each sentence, and determine the composition type in
each case; (3) In cases of coercion, identify the source and target types
for the semantic head of each relevant noun phrase. Double annotation and
adjudication is performed over the data set.

Evaluation Methodology

Precision and recall will be used as evaluation metrics. A scoring program
will be supplied for participants. Two Subtasks will be evaluated
separately: (1) identifying the argument type and (2) identifying the
compositional operation (i.e. selection vs. coercion). This task is part of
a larger effort to annotate text with compositional operations.

Organizers:
James Pustejovsky, Nicoletta Calzolari, Anna Rumshisky,
Elisabetta Jezek, Valeria Quochi, Olga Batiukova, Jessica Moszkowicz

Timeline
11/10/09 - Trial data for English and Italian posted
3/10/10 - Training data for English and Italian released
3/25/10 - Test data for English and Italian released
4/02/10 - Closing competition

For more up-to-date information, please contact the organzers or see the
task webpage at:
http://asc-task.org

Trial data is currently available now at:
http://asc-task.org/data/trial-data

Training and test data will be posted according to the timeline on the
SemEval-2010 website:
http://semeval2.fbk.eu/semeval2.php
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20100305/39e207be/attachment.htm>
-------------- next part --------------
_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora