Appel: SENSEVAL-3

Mon Jan 12 09:39:10 UTC 2004

[Apologies for multiple postings]

=====================================================================
CALL FOR  PARTICIPATION IN THE SENSEVAL-3 EVALUATIONS

SENSEVAL-3 Third International Workshop on the Evaluation of
Systems for the Semantic Analysis of Text

An ACL-2004 Workshop
Barcelona, Spain
July 25-26, 2004

http://www.senseval.org/senseval3
======================================================================

The main purpose of this workshop is to analyze and discuss the
results of systems participating in the Senseval-3 evaluations, to be
held in March-April 2004. Fourteen different tasks are planned for
Senseval-3, to conduct evaluations of systems that perform automatic
semantic analysis of text, including: word sense disambiguation for
various languages, identification of semantic roles, logic forms,
multilingual annotations, subcategorization acquisition.

This is an advance notice of the evaluation exercise and workshop.
Registration for the evaluation will open in February (watch the
website for updates). Papers will be accepted from participants only.

[BACKGROUND]

There are now many computer systems that do automatic semantic
analysis of text. The purpose of Senseval is to evaluate the strengths
and weaknesses of such systems with respect to different words,
relations, types of texts, different varieties of language, and
different languages.

This workshop is a follow-up to Senseval-1 and Senseval-2.  Senseval-1
took place in the summer of 1998 for English, French, and Italian,
culminating in a workshop held at Herstmonceux Castle, Sussex, England
on September 2-4.  Senseval-2 took place in the summer of 2001, and
was followed by a workshop held in July 2001 in Toulouse, in
conjunction with ACL-2001. Senseval-2 included tasks for Basque,
Chinese, Czech, Danish, Dutch, English, Estonian, Italian, Japanese,
Korean, Spanish, Swedish.

[TASKS]

The following tasks are planned for Senseval-3 (see webpage for a
description of each task):

1. English all words
2. Italian all words
3. Basque lexical sample
4. Catalan lexical sample
5. Chinese lexical sample
6. English lexical sample
7. Italian lexical sample
8. Romanian lexical sample
9. Spanish lexical sample
10. Automatic subcategorization acquisition
11. Multilingual lexical sample
12. WSD of WordNet glosses
13. Semantic Roles
14. Logic Forms

This 2-day workshop will consist of several Senseval-3 task and system
presentations, including analyses of results obtained during the
evaluations, with comparisons across different systems, techniques,
and languages. We also plan for two panels on (1) the interaction
between systems for semantic analysis of text and other NLP
applications, and (2) planning Senseval-4.

[SUBMISSION FORMAT]

Submissions will consist of refereed papers describing the Senseval-3
tasks and participating systems:
- one paper for each task, limited to four pages
- one paper for each participating team, limited to four pages for the
first task, and one extra page for each additional task
Papers will have to follow the ACL 2004 formatting guidelines.
Submissions will be entered via the Senseval-3 website.

[IMPORTANT DATES]

Registration
				February
Evaluations
				March - April
Deadline for paper submissions			April 20
Deadline for camera-ready papers		May 18
Workshop
				July 25-26

[ORGANIZING COMMITTEE]

Phil Edmonds, Sharp Laboratories of Europe
Rada Mihalcea, University of North Texas

[PROGRAM COMMITTEE]

Eneko Agirre, University of the Basque Country
Rebecca Bruce, University of North Carolina at Asheville
Nicoletta Calzolari, ILC-CNR, Pisa
Tim Chklovski, Information Sciences Institute
Massimiliano Ciaramita, Brown University
Silviu Cucerzan, Microsoft Research
Walter Daelemans, University of Antwerp
Florentina Hristea, University of Bucharest
Nancy Ide, Vassar College
Diana Inkpen, University of Ottawa
Adam Kilgarriff, University of Brighton
Dimitrios Kokkinakis, Goteborg University
Anna Korhonen, University of Cambridge
Robert Krovetz, Teoma
Sadao Kurohashi, The University of Kyoto
Dekang Lin, University of Alberta
Ken Litkowski, CL Research
PengYuan Liu, Harbin Institute of Technology
Bernardo Magnini, ITC-IRST, Trento
Lluis  Marquez, University of Catalunya
Diana McCarthy, University of Sussex
Vivi Nastase, University of Ottawa
Hwee Tou Ng, National University of Singapore
Martha Palmer, University of Pennsylvania
Patrick Pantel, Information Sciences Institute
Ted Pedersen, University of Minnesota, Duluth
Judita Preiss, University of Cambridge
Amruta Purandare, University of Minnesota, Duluth
German Rigau, University of the Basque Country
Vasile Rus, Indiana University South-Bend
Charles Schafer, John Hopkins University
Carlo Strapparava, ITC-IRST, Trento
Dan Tufis, Romanian Academy
Cynthia Thompson, University of Utah
Paola Velardi, La Sapienza, Rome
Janyce Wiebe, University of Pittsburgh
David Yarowsky, John Hopkins University
Deniz Yuret, Koc University

-------------------------------------------------------------------------
Message diffusé par la liste Langage Naturel <LN at cines.fr>
Informations, abonnement : http://www.biomath.jussieu.fr/LN/LN-F/
English version          : http://www.biomath.jussieu.fr/LN/LN/
Archives                 : http://listserv.linguistlist.org/archives/ln.html

La liste LN est parrainée par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhésion  : http://www.atala.org/
-------------------------------------------------------------------------