21.1039, FYI: Call for Participation: SemEval-2010 Shared Task 7

Wed Mar 3 21:57:24 UTC 2010

LINGUIST List: Vol-21-1039. Wed Mar 03 2010. ISSN: 1068 - 4875.

Subject: 21.1039, FYI: Call for Participation: SemEval-2010 Shared Task 7

Moderators: Anthony Aristar, Eastern Michigan U <aristar at linguistlist.org>
            Helen Aristar-Dry, Eastern Michigan U <hdry at linguistlist.org>

Reviews: Monica Macaulay, U of Wisconsin-Madison  
Eric Raimy, U of Wisconsin-Madison  
Joseph Salmons, U of Wisconsin-Madison  
Anja Wanner, U of Wisconsin-Madison  
       <reviews at linguistlist.org> 

Homepage: http://linguistlist.org/

The LINGUIST List is funded by Eastern Michigan University, 
and donations from subscribers and publishers.

Editor for this issue: Elyssa Winzeler <elyssa at linguistlist.org>
================================================================  

To post to LINGUIST, use our convenient web form at
http://linguistlist.org/LL/posttolinguist.cfm.

===========================Directory==============================  

1)
Date: 01-Mar-2010
From: Anna Rumshisky < arum at cs.brandeis.edu >
Subject: Call for Participation: SemEval-2010 Shared Task 7

-------------------------Message 1 ---------------------------------- 
Date: Wed, 03 Mar 2010 16:56:39
From: Anna Rumshisky [arum at cs.brandeis.edu]
Subject: Call for Participation: SemEval-2010 Shared Task 7

E-mail this message to a friend:
http://linguistlist.org/issues/emailmessage/verification.cfm?iss=21-1039.html&submissionid=2613774&topicid=6&msgnumber=1

Call for Participation

SemEval-2010 Shared Task #7: Argument Selection and Coercion

Webpage:
http://asc-task.org

This shared task will be of interest to researcher working on:
- Predicate-argument structure
- Type shifting violations and coercions
- Metaphor and Metonymy
- Creative word use

Task Description

This task involves identifying the compositional operations involved in
argument selection. Most annotation schemes to date encoding propositional
or predicative content have focused on the identification of the predicate
type, the argument extent, and the semantic role (or label) assigned to
that argument by the predicate.  In contrast, this task attempts to capture
the 'compositional history' of the argument selection relative to the
predicate. In particular, this task attempts to identify the operations of
type adjustment induced by a predicate over its arguments when they do not
match its selectional properties. The task is defined as follows: for each
argument of a predicate, identify whether the entity in that argument
position satisfies the type expected by the predicate. If not, then one
needs to identify how the entity in that position satisfies the typing
expected by the predicate; that is, to identify the source and target types
in a type-shifting (or coercion) operation.  The possible relations between
the predicate and a given argument will, for this task, be restricted to
selection and coercion. 

In selection, the argument NP satisfies the typing requirements of the
predicate. For example, in the sentence 'The child threw the ball', the
object NP 'the ball' directly satisfies the type expected by the predicate,
Physical Object. 

If this is not the case, then a coercion has occurred. For example, in the
sentence 'The White House denied this statement.', the type expected in
subject position by the predicate is Human, but the surface NP is typed as
Location. The task is to identify both the type mismatch and the type
shift; namely Location -> Human.

Resources and Corpus Development

The following methodology was used in the creation of the data set: (1) For
a chosen set of selection contexts, randomly select a set of sentences from
a variety of corpora, including the BNC and other sources; (2) Identify the
target noun phrase in each sentence, and determine the composition type in
each case; (3) In cases of coercion, identify the source and target types
for the semantic head of each relevant noun phrase.  Double annotation and
adjudication is performed over the data set.

Evaluation Methodology

Precision and recall will be used as evaluation metrics. A scoring program
will be supplied for participants. Two Subtasks will be evaluated
separately: (1) identifying the argument type and (2) identifying the
compositional operation (i.e. selection vs. coercion). This task is part of
a larger effort to annotate text with compositional operations.

Organizers:
James Pustejovsky, Nicoletta Calzolari, Anna Rumshisky,
Elisabetta Jezek, Valeria Quochi, Olga Batiukova, Jessica Moszkowicz

Timeline
11/10/09 - Trial data for English and Italian posted
3/10/10  - Training data for English and Italian released
3/25/10  - Test data for English and Italian released
4/02/10  - Closing competition 

For more up-to-date information, please contact the organzers or see the
task webpage at:
http://asc-task.org

Trial data is currently available now at:
http://asc-task.org/data/trial-data

Training and test data will be posted according on the SemEval-2010 website:
http://semeval2.fbk.eu/semeval2.php 

Linguistic Field(s): Computational Linguistics
                     Semantics
                     Text/Corpus Linguistics

-----------------------------------------------------------
This Year the LINGUIST List hopes to raise $65,000. This money will go to help 
keep the List running by supporting all of our Student Editors for the coming year.

See below for donation instructions, and don't forget to check out our Space Fund 
Drive 2010 and join us for a great journey!

http://linguistlist.org/fund-drive/2010/

There are many ways to donate to LINGUIST!

You can donate right now using our secure credit card form at  
https://linguistlist.org/donation/donate/donate1.cfm

Alternatively you can also pledge right now and pay later. To do so, go to: 
https://linguistlist.org/donation/pledge/pledge1.cfm

For all information on donating and pledging, including information on how to 
donate by check, money order, or wire transfer, please visit: 
http://linguistlist.org/donation/

The LINGUIST List is under the umbrella of Eastern Michigan University and as 
such can receive donations through the EMU Foundation, which is a registered 
501(c) Non Profit organization. Our Federal Tax number is 38-6005986. These 
donations can be offset against your federal and sometimes your state tax return 
(U.S. tax payers only). For more information visit the IRS Web-Site, or contact 
your financial advisor.

Many companies also offer a gift matching program, such that they will match 
any gift you make to a non-profit organization. Normally this entails your 
contacting your human resources department and sending us a form that the 
EMU Foundation fills in and returns to your employer. This is generally a simple 
administrative procedure that doubles the value of your gift to LINGUIST, without 
costing you an extra penny. Please take a moment to check if your company 
operates such a program.

Thank you very much for your support of LINGUIST! 
-----------------------------------------------------------
LINGUIST List: Vol-21-1039	