[Corpora-List] Call for participation: Semeval competition

Fri Feb 16 23:31:21 UTC 2007

	     ~~~~~ Apologies for multiple postings ~~~~~~

			WORKSHOP ANNOUNCEMENT
				 AND
	               CALL FOR PARTICIPATION

		   SemEval-2007 (formerly Senseval)
	  4th International Workshop on Semantic Evaluations
		  an ACL-SIGLEX event at ACL, Prague

			      June 23-24

		 http://nlp.cs.swarthmore.edu/semeval

	                http://www.acl2007.org/

	    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

REGISTRATION IS NOW OPEN!!
START OF COMPETITION: FEBRUARY 26
END OF COMPETITION: APRIL 1

The main purpose of this workshop is to analyze and discuss the
results of systems participating in the SemEval-2007 evaluations, to
be held in February-March 2007. Nineteen different tasks are planned
for SemEval, to conduct evaluations of systems that perform automatic
semantic analysis of text, covering a wide range of aspects of
semantics and multilinguality.

Background and motivation
------------------------------------

There are now many computer systems that do automatic semantic
analysis of text. The purpose of SemEval is to evaluate the strengths
and weaknesses of such systems with respect to different words,
relations, types of texts, different varieties of language, and
different languages.

This workshop is a follow-up to the Senseval series of workshops on
semantic evaluation. Senseval-1 took place in the summer of 1998 for
English, French, and Italian, culminating in a workshop held at
Herstmonceux Castle, Sussex, England on September 2-4.  Senseval-2
took place in the summer of 2001, and was followed by a workshop held
in July 2001 in Toulouse, in conjunction with ACL-2001.  It included
tasks for 12 languages. Senseval-3 took place in the spring of 2004,
and was followed by a workshop held in July 2004 in Barcelona, in
conjunction with ACL-2004. More than 55 teams participated with over
160 systems in its 16 tasks.

For this fourth edition, Senseval is changing its name to SemEval (for
Semantic Evaluation). The change of name is motivated by a desire to
broaden the spectrum of accepted works to all aspects of computational
semantic analysis of language. In the call for task proposals we
especially encouraged the proposal of tasks for different languages,
cross-lingual tasks, and tasks that are relevant to particular NLP
applications such as machine translation, information retrieval and
information extraction.

In recent years, the deployment of multiple semantic lexicons and
accordingly tagged corpora (WordNet-SemCor, VerbNet-PropBank, FrameNet
and Prague Dependency Treebank, to name a few) have radically changed
the way semantic analysis is performed, especially at the
disambiguation stage. Some of the proposals at SemEval 2007 are trying
to take this one step further by proposing multiple layers of semantic
annotation of the same corpus (e.g., senses, roles, name-entity
classes), allowing for novel research to be performed.

Tasks
----------

 1 Evaluating WSD on Cross Language Information Retrieval
 2 Evaluating Word Sense Induction and Discrimination Systems
 3 Multipart Semantic Tagging of Czech
 4 Classification of Semantic Relations between Nominals
 5 Multilingual Chinese-English Lexical Sample Task
 6 Word-Sense Disambiguation of Prepositions
 7 Coarse-grained English all-words
 8 Metonymy Resolution at Semeval-2007
 9 Multilevel Semantic Annotation of Catalan and Spanish
10 English Lexical Substitution Task for SemEval-2007	 	 
11 English Lexical Sample Task via English-Chinese Parallel Text
12 Turkish Lexical Sample Task	 	 
13 Web People Search
14 Affective Text
15 TempEval: A proposal for Evaluating Time-Event Temporal Relation
   Identification
16 Evaluation of wide coverage knowledge resources
17 English Lexical Sample, English SRL and English All-Words Tasks
18 Arabic Semantic Labeling
19 Frame Semantic Structure Extraction

Check Semeval website for details.

Participation and papers
------------------------------

Systems that plan to participate in any of the tasks can register in
the Semeval website now. The evaluation period starts on February 26
and finishes the 1st of April. For further details check the Semeval
website and the instruction for participants in:

  http://nlp.cs.swarthmore.edu/semeval/participants.shtml

For registration:

  http://nlp.cs.swarthmore.edu/semeval/team/registration.shtml

The workshop will include presentations by participants and task
organizers. The proceedings will include papers by participants and
task organizers.

Schedule
--------

Registration for tasks:               Open now!
Evaluation period:                    February 26 - April 1, 2007
Submission of description papers:     April 17, 2007
Notification of acceptance:	      April 23, 2007
Camera ready due:		      May 6, 2007
Workshop Date:                        June 23-24, 2007

Workshop Organizers
-------------------

Eneko Agirre (University of the Basque Country, UPV/EHU, Spain)
Lluís Màrquez (Technical University of Catalonia, UPC, Spain)
Richard Wicentowski (Swarthmore College, USA)

Program Committee
-----------------

Collin Baker, University of California, Berkeley, USA
Nicoletta Calzolari, Istituto di Linguistica Computazionale - CNR, Pisa
Xavier Carreras, Massachusetts Institute of Technology, USA
Walter Daelemans, University of Antwerp, Belgium
Phil Edmonds, Sharp Laboratories of Europe
Julio Gonzalo, UNED, Spain
Veronique Hoste, University of Antwerp
Eduard Hovy, Information Science Institute, USA
Nancy Ide, Vassar College, USA
Dimitrios Kokkinakis, Goteborg University
Sadao Kurohashi, The University of Kyoto
Kenneth Litkowski, CL Research, USA
Bernardo Magnini, IRST, Italy
David Martínez, University of Melbourne, Australia
Diana McCarthy, University of Sussex
Paola Merlo, University of Geneva, Switzerland
Rada Mihalcea University of North Texas
Hwee Tou Ng, National University of Singapore
German Rigau, Basque Country University, Basque Country
Mark Stevenson, University of Sheffield, UK
Suzanne Stevenson, University of Toronto, Canada
Carlo Strapparava, ITC-IRST, Italy
Yorick Wilks, University of Sheffield, UK
Dekai Wu, The Hong Kong University of Science & Technology, China
Deniz Yuret, Koc University, Turkey