[Corpora-List] ACL 2004 Workshop: Senseval-3 Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text

[Rada Mihalcea]

[Apologies for multiple postings]


=====================================================================
CALL FOR  PARTICIPATION IN THE SENSEVAL-3 EVALUATIONS

SENSEVAL-3 Third International Workshop on the Evaluation of
Systems for the Semantic Analysis of Text

An ACL-2004 Workshop
Barcelona, Spain
July 25-26, 2004

http://www.senseval.org/senseval3
======================================================================



The main purpose of this workshop is to analyze and discuss the results
of systems participating in the Senseval-3 evaluations, to be held in
March-April 2004. Fourteen different tasks are planned for Senseval-3,
to conduct evaluations of systems that perform automatic semantic analysis
of text, including: word sense disambiguation for various languages,
identification of semantic roles, logic forms, multilingual annotations,
subcategorization acquisition.

This is an advance notice of the evaluation exercise and workshop.
Registration for the evaluation will open in February (watch the website
for updates). Papers will be accepted from participants only.


[BACKGROUND]

There are now many computer systems that do automatic semantic analysis of
text. The purpose of Senseval is to evaluate the strengths and weaknesses
of such systems with respect to different words, relations, types of texts,
different varieties of language, and different languages.

This workshop is a follow-up to Senseval-1 and Senseval-2.
Senseval-1 took place in the summer of 1998 for English, French, and Italian,
culminating in a workshop held at Herstmonceux Castle, Sussex, England on
September 2-4.
Senseval-2 took place in the summer of 2001, and was followed by a workshop
held in July 2001 in Toulouse, in conjunction with ACL-2001. Senseval-2
included tasks for Basque, Chinese, Czech, Danish, Dutch, English, Estonian,
Italian, Japanese, Korean, Spanish, Swedish.


[TASKS]

The following tasks are planned for Senseval-3 (see webpage for a description
of each task):

1. English all words
2. Italian all words
3. Basque lexical sample
4. Catalan lexical sample
5. Chinese lexical sample
6. English lexical sample
7. Italian lexical sample
8. Romanian lexical sample
9. Spanish lexical sample
10. Automatic subcategorization acquisition
11. Multilingual lexical sample
12. WSD of WordNet glosses
13. Semantic Roles
14. Logic Forms


This 2-day workshop will consist of several Senseval-3 task and system
presentations, including analyses of results obtained during the
evaluations, with comparisons across different systems, techniques,
and languages. We also plan for two panels on (1) the interaction
between systems for semantic analysis of text and other NLP applications,
and (2) planning Senseval-4.


[SUBMISSION FORMAT]

Submissions will consist of refereed papers describing the Senseval-3
tasks and participating systems:
- one paper for each task, limited to four pages
- one paper for each participating team, limited to four pages for the
first task, and one extra page for each additional task
Papers will have to follow the ACL 2004 formatting guidelines.
Submissions will be entered via the Senseval-3 website.


[IMPORTANT DATES]

Registration					February
Evaluations					March - April
Deadline for paper submissions			April 20
Deadline for camera-ready papers		May 18
Workshop					July 25-26


[ORGANIZING COMMITTEE]

Phil Edmonds, Sharp Laboratories of Europe
Rada Mihalcea, University of North Texas


[PROGRAM COMMITTEE]

Eneko Agirre, University of the Basque Country
Rebecca Bruce, University of North Carolina at Asheville
Nicoletta Calzolari, ILC-CNR, Pisa
Tim Chklovski, Information Sciences Institute
Massimiliano Ciaramita, Brown University
Silviu Cucerzan, Microsoft Research
Walter Daelemans, University of Antwerp
Florentina Hristea, University of Bucharest
Nancy Ide, Vassar College
Diana Inkpen, University of Ottawa
Adam Kilgarriff, University of Brighton
Dimitrios Kokkinakis, Goteborg University
Anna Korhonen, University of Cambridge
Robert Krovetz, Teoma
Sadao Kurohashi, The University of Kyoto
Dekang Lin, University of Alberta
Ken Litkowski, CL Research
PengYuan Liu, Harbin Institute of Technology
Bernardo Magnini, ITC-IRST, Trento
Lluis  Marquez, University of Catalunya
Diana McCarthy, University of Sussex
Vivi Nastase, University of Ottawa
Hwee Tou Ng, National University of Singapore
Martha Palmer, University of Pennsylvania
Patrick Pantel, Information Sciences Institute
Ted Pedersen, University of Minnesota, Duluth
Judita Preiss, University of Cambridge
Amruta Purandare, University of Minnesota, Duluth
German Rigau, University of the Basque Country
Vasile Rus, Indiana University South-Bend
Charles Schafer, John Hopkins University
Carlo Strapparava, ITC-IRST, Trento
Dan Tufis, Romanian Academy
Cynthia Thompson, University of Utah
Paola Velardi, La Sapienza, Rome
Janyce Wiebe, University of Pittsburgh
David Yarowsky, John Hopkins University
Deniz Yuret, Koc University