[Corpora-List] Senseval-3: Call for Task Proposals

[phil.edmonds at sharp.co.uk]

                       SENSEVAL-3

                 CALL FOR TASK PROPOSALS


The Senseval Committee invites proposals for tasks to be run as part
of Senseval-3.  We welcome proposals for any kind of task that can
test a word sense disambiguation (WSD) system, be it application
dependent or independent.  We especially encourage tasks for different
languages, cross-lingual tasks, and tasks that are relevant to
particular NLP applications such as MT and IR.  We also encourage
tasks for areas related to WSD such as semantic tagging and
domain classification.

It will help us if tasks are designed in such that they can be run and
scored automatically from a central website (as in Senseval-2). We'll
be happy to help with task design, data formatting, and so on.

Information on the design of Senseval-1 and -2 tasks can be found at:
  http://www.itri.bton.ac.uk/~Adam.Kilgarriff/framework.pdf
  http://www.sle.sharp.co.uk/senseval2/archive/

The time period for Senseval-3 has not yet been finalised, but it will be
held over a 1-2 month period after July 2003.

SUBMISSION DETAILS

Proposals for tasks will ideally contain:

 - A description of the task (max 1 page)
 - How the training/testing data will be built and/or procured
 - The evaluation methodology to be used including clear evaluation
   criteria
 - The availability of the resources to the participants (copyright,
   costs, etc)
 - The resources required to prepare the task (time, money, and human)
 - How much of the resources your team can supply or muster

If you aren't yet at a point to provide outlines of all of these,
that's fine, but please give some thought to each, and present a note
of your first ideas.  We will gladly give feedback.

Please submit proposals as soon as possible, preferably by electronic
mail in plain ASCII text to the Senseval chair: Phil Edmonds,
phil at sharp.co.uk

IMPORTANT DATES

Sep 21, 2002  Intention to submit (send a short-paragraph description)
Oct 26, 2002  Submission deadline for task proposals
Nov 23, 2002  Notification of acceptance