Appel: LREC 2010 Workshop - Evaluation of Information Filtering Systems

[Thierry Hamon]

Date: Wed, 20 Jan 2010 15:17:40 +0100
From: info at elda.org
Message-ID: <4B571084.2030506 at elda.org>
X-url: http://www.lrec-conf.org/lrec2010/?LREC2010-Map-of-Language-Resources.
X-url: http://www.infile.org


[Apologies for multiple postings]
CALL FOR PAPERS

Evaluation of Information Filtering Systems in a Competitive 
Intelligence Framework Workshop
22 May 2010
Held in conjunction with LREC 2010, Malta

Aims

The constant growth of publicly available information has entailed a
consequently similar growth in the research areas devoted to the
automated organization of this information. In particular, Information
Filtering systems have been developed to tackle the issues of many
applications of business intelligence, from mail categorization to
news routing and technology watch. However, the theoretically
challenging models of these systems have seldom been evaluated in real
usage context. Indeed, standard evaluation benchmarks usually
introduce artefacts that simplify the task. For instance, in the
context of competitive intelligence, systems must filter documents
without any global information on a "collection" but can use feedback
from the user, and must be efficient enough to deal with a real-time
document stream.  Furthermore, with the increase of globalized access
and availability of the information, sources may be found in many
languages, and the multilinguality issue must also be considered. TREC
Adaptive Filtering Track and INFILE track at CLEF for multilingual
information filtering have tried to propose evaluation frameworks
closer to the usage.

The goal of this workshop is to study different aspects of Information
Filtering Evaluation and to bring together researchers from the
community of Information Filtering to develop new evaluation
frameworks and confront current models with these new evaluation
models.  Submissions are expected to propose new insights on
evaluation methodologies and resources for Information Filtering or to
present Information Filtering models that will meet the requirements
of a real usage evaluation (in particular, researchers that submit
papers presenting Information Filtering Models are encouraged to
evaluate their model using an existing benchmark such as the INFILE
benchmark, available at http://www.infile.org).

Topics

Both theoretical and practical research papers are welcome from both
research and industrial communities addressing the main workshop
theme, in any aspect including:

- Resources and methodologies for Evaluation of Information Filtering
  Systems in real usage context

- New models for Information Filtering, that tackle one or several
  issues of this kind of evaluation: efficiency, adaptability,
  multilinguality, etc.

- Results of the Evaluation of Information Filtering Systems

- User studies of the use of Information Filtering Systems in 
  Competitive Intelligence

Submission information

Papers will be submitted to the workshop via the START LREC Conference
Manager, under https://www.softconf.com/lrec2010/InFile2010/
Authors should submit a PDF file of no more than 10 pages, following
the LREC conference formatting details. Papers will be reviewed by
three members of the Program Committee, Accepted papers will be
published in the workshop Proceedings.
When submitting a paper from the START page, authors will be asked to
provide essential information about resources (in a broad sense, i.e.
also technologies, standards, evaluation kits, etc.) that have been
used for the work described in the paper or are a new result of your
research.  For further information on this new initiative, please
refer to
http://www.lrec-conf.org/lrec2010/?LREC2010-Map-of-Language-Resources.

Important dates

Paper submission deadline 28 February 2010
Notification of acceptance 22 March 2010
Final version of accepted paper 4  April 2010
Workshop half-day 22 May 2010

Workshop Organizers

Romaric Besançon
CEA LIST
BP 6 92265 Fontenay-aux-roses CEDEX
FRANCE
Tel: +33 1 46 54 80 16
Fax: +33 1 46 54 75 80
email: romaric.besancon at cea.fr
Djamel Mostefa
ELDA
55-57,rue Brillat Savarin 75013 Paris
FRANCE
Tel: +33 1 43 13 33 33
email: mostefa at elda.org

Program Committee
Romaric Besançon, CEA LIST
Stéphane Chaudiron Université Lille 3
Khalid Choukri, ELDA
Christian Fluhr,
Meriama Laïb, CEA LIST
Djamel Mostefa, ELDA
Ismail Timimi, Université Lille 3


-------------------------------------------------------------------------
Message diffuse par la liste Langage Naturel <LN at cines.fr>
Informations, abonnement : http://www.atala.org/article.php3?id_article=48
English version       : 
Archives                 : http://listserv.linguistlist.org/archives/ln.html
                                http://liste.cines.fr/info/ln

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  : http://www.atala.org/
-------------------------------------------------------------------------