Appel: LREC 2010 Workshop - Evaluation of Information Filtering Systems

Thierry Hamon thierry.hamon at UNIV-PARIS13.FR
Sat Jan 23 18:13:06 UTC 2010

Date: Wed, 20 Jan 2010 15:17:40 +0100
From: info at
Message-ID: <4B571084.2030506 at>

[Apologies for multiple postings]

Evaluation of Information Filtering Systems in a Competitive 
Intelligence Framework Workshop
22 May 2010
Held in conjunction with LREC 2010, Malta


The constant growth of publicly available information has entailed a
consequently similar growth in the research areas devoted to the
automated organization of this information. In particular, Information
Filtering systems have been developed to tackle the issues of many
applications of business intelligence, from mail categorization to
news routing and technology watch. However, the theoretically
challenging models of these systems have seldom been evaluated in real
usage context. Indeed, standard evaluation benchmarks usually
introduce artefacts that simplify the task. For instance, in the
context of competitive intelligence, systems must filter documents
without any global information on a "collection" but can use feedback
from the user, and must be efficient enough to deal with a real-time
document stream.  Furthermore, with the increase of globalized access
and availability of the information, sources may be found in many
languages, and the multilinguality issue must also be considered. TREC
Adaptive Filtering Track and INFILE track at CLEF for multilingual
information filtering have tried to propose evaluation frameworks
closer to the usage.

The goal of this workshop is to study different aspects of Information
Filtering Evaluation and to bring together researchers from the
community of Information Filtering to develop new evaluation
frameworks and confront current models with these new evaluation
models.  Submissions are expected to propose new insights on
evaluation methodologies and resources for Information Filtering or to
present Information Filtering models that will meet the requirements
of a real usage evaluation (in particular, researchers that submit
papers presenting Information Filtering Models are encouraged to
evaluate their model using an existing benchmark such as the INFILE
benchmark, available at


Both theoretical and practical research papers are welcome from both
research and industrial communities addressing the main workshop
theme, in any aspect including:

- Resources and methodologies for Evaluation of Information Filtering
  Systems in real usage context

- New models for Information Filtering, that tackle one or several
  issues of this kind of evaluation: efficiency, adaptability,
  multilinguality, etc.

- Results of the Evaluation of Information Filtering Systems

- User studies of the use of Information Filtering Systems in 
  Competitive Intelligence

Submission information

Papers will be submitted to the workshop via the START LREC Conference
Manager, under
Authors should submit a PDF file of no more than 10 pages, following
the LREC conference formatting details. Papers will be reviewed by
three members of the Program Committee, Accepted papers will be
published in the workshop Proceedings.
When submitting a paper from the START page, authors will be asked to
provide essential information about resources (in a broad sense, i.e.
also technologies, standards, evaluation kits, etc.) that have been
used for the work described in the paper or are a new result of your
research.  For further information on this new initiative, please
refer to

Important dates

Paper submission deadline 28 February 2010
Notification of acceptance 22 March 2010
Final version of accepted paper 4  April 2010
Workshop half-day 22 May 2010

Workshop Organizers

Romaric Besançon
BP 6 92265 Fontenay-aux-roses CEDEX
Tel: +33 1 46 54 80 16
Fax: +33 1 46 54 75 80
email: romaric.besancon at
Djamel Mostefa
55-57,rue Brillat Savarin 75013 Paris
Tel: +33 1 43 13 33 33
email: mostefa at

Program Committee
Romaric Besançon, CEA LIST
Stéphane Chaudiron Université Lille 3
Khalid Choukri, ELDA
Christian Fluhr,
Meriama Laïb, CEA LIST
Djamel Mostefa, ELDA
Ismail Timimi, Université Lille 3

Message diffuse par la liste Langage Naturel <LN at>
Informations, abonnement :
English version       : 
Archives                 :

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  :

More information about the Ln mailing list