17.3436, Calls: Computational Ling/Traitement Automatique des Langues (Jrnl)

[LINGUIST Network]

LINGUIST List: Vol-17-3436. Wed Nov 22 2006. ISSN: 1068 - 4875.

Subject: 17.3436, Calls: Computational Ling/Traitement Automatique des Langues (Jrnl)

Moderators: Anthony Aristar, Eastern Michigan U <aristar at linguistlist.org>
            Helen Aristar-Dry, Eastern Michigan U <hdry at linguistlist.org>
 
Reviews: Laura Welcher, Rosetta Project / Long Now Foundation  
         <reviews at linguistlist.org> 

Homepage: http://linguistlist.org/

The LINGUIST List is funded by Eastern Michigan University, Wayne
State University, and donations from subscribers and publishers.

Editor for this issue: Hannah Morales <hannah at linguistlist.org>
================================================================  

As a matter of policy, LINGUIST discourages the use of abbreviations
or acronyms in conference announcements unless they are explained in
the text.

To post to LINGUIST, use our convenient web form at 
http://linguistlist.org/LL/posttolinguist.html. 



===========================Directory==============================  

1)
Date: 22-Nov-2006
From: Patrick Paroubek < pap at limsi.fr >
Subject: Traitement Automatique des Langues 

	
-------------------------Message 1 ---------------------------------- 
Date: Wed, 22 Nov 2006 11:34:55
From: Patrick Paroubek < pap at limsi.fr >
Subject: Traitement Automatique des Langues 
 


Full Title: Traitement Automatique des Langues 


Linguistic Field(s): Computational Linguistics; General Linguistics 

Call Deadline: 15-Dec-2006 

Deadline Extension

Principles of Evaluation in Natural Language Processing.

Special Issue of the Journal 'Traitement Automatique des Langues' (TAL)

Deadline for submission: 15th December 2006

Redacteurs Invites: 

Guest Editors: 
Patrick Paroubek (LIMSI-CNRS) 
Stéphane Chaudiron (MdRNT /U. Lille 3) 
Lynette Hirschman (MITRE)

First Call

For this special issue of TAL, we invite papers about the fundamental
principles that underlie the use of evaluation methods in NLP. We wish
to adopt a higher point of view which goes beyond the horizon of a
single evaluation campaign and have a more global approach about the
problems raised by the deployment of evaluation in NLP. Without any
prejudice, we do not wish to offer with this special issue yet another
tribune to articles relating the participation of a system in a given
evaluation campaign, or articles comparing the pros and cons of two
metrics for assessing performance in a particular task. Our intent is
to address more fundamental issues about the use of evaluation in NLP.

Topics

Specific topics include (but are not limited to):

1) Corpora in the evaluation process, their use, the development life
cycle, the synergy around the pair corpus - evaluation campaign.

2) Evaluation as a source of creation of linguistic resources. What help
does it bring in maintaining existing resources?

3) The question of re-using 'found corpora' for evaluation, i.e. corpora
that exist, with some level of annotation that can be adapted to provide
rich 'real world' corpora with somewhat noisy or incomplete annotations.

4) To evaluate implies to have a reference against which to gauge a
performance, but how is defined the reference in NLP? How should we deal
with the problem that often the reference is not unique (e.g. in machine
translation)?

5) Which formalisms for evaluation in NLP?

6) Which characteristics should evaluation have in NLP? Comparative,  
quantitative, qualitative... evaluation?

7) Technology Evaluation and User/Application Oriented Evaluation, how are
these two different kinds of evaluation perceived by the NLP community?

8) Evaluation and scientific progress, e.g. large scale evaluation programs
in NLP.

9) Which role does evaluation play in the NLP scientific process?

10) Some domains of NLP are reputed easier for evaluation that others
(parsing, semantics, translation)--myth or reality?

The Journal  (see http://www.atala.org/) 

Language
Articles are written in French or in English. Submissions in English are
only accepted for non-native speakers of French.

Important Dates

Extended Submission Deadline: 15/12/2006
Acceptance Notification: 22/01/2007
Revised Final Version: 16/04/2007

Format

Articles (25 pages maximum, PDF format) will be sent to: 
Patrick Paroubek <pap at limsi.fr>

Style sheets are available on line at: http://tal.e-revues.com/appel.jsp

Special Issue Editorial Board

Mohand Boughanem (IRIT)				
Frédéric Béchet (LIA, U. Avignon)		
Hervé Blanchon (IMAG)				
Jean-Francois Bonastre (LIA, U. Avignon)	
John Carroll (U. Sussex)					
Gael de Chalendar (CEA, Fontenay aux roses)	
Robert Gaizauskas (U. Sheffield)		
Guillaume Gravier (IRISA)			
Tony Hartley (U. of Leeds)			
Lori Lamel (LIMSI-CNRS)				
Dominique Laurent (Synapse)			
Joseph Mariani (LIMSI-CNRS)			
Jean-Luc Minel (Paris X)			
Adeline Nazarenko (Paris XIII)
Andrei Popescu-Belis (ISSCO, Genève)		
Gerard Sabah (LIMSI-CNRS)			
Anne Vilnat (LIMSI-CNRS)			
Claire Waast (EDF)				
Bonnie Webber (U. of Edinburgh)




-----------------------------------------------------------
LINGUIST List: Vol-17-3436