Appel: LREC 2010 Workshop on Evaluation of Information Filtering Systems (extended deadline)

Thierry Hamon thierry.hamon at UNIV-PARIS13.FR
Fri Feb 26 17:21:36 UTC 2010

Date: Fri, 26 Feb 2010 15:35:28 +0100
From: info at
Message-ID: <4B87DC30.9080709 at>

[Apologies for multiple postings]


Evaluation of Information Filtering Systems in a Competitive
Intelligence Framework Workshop
22 May 2010
Held in conjunction with LREC 2010, Malta


The constant growth of publicly available information has entailed a
consequently similar growth in the research areas devoted to the
automated organization of this information. In particular, Information
Filtering systems have been developed to tackle the issues of many
applications of business intelligence, from mail categorization to
news routing and technology watch.  However, the theoretically
challenging models of these systems have seldom been evaluated in real
usage context. Indeed, standard evaluation benchmarks usually
introduce artefacts that simplify the task. For instance, in the
context of competitive intelligence, systems must filter documents
without any global information on a ?collection? but can use feedback
from the user, and must be efficient enough to deal with a real-time
document stream. Furthermore, with the increase of mondialized access
and availability of the information, sources may be found in many
languages, and the multilinguality issue must also be considered. TREC
Adaptive Filtering Track and INFILE track at CLEF for multilingual
information filtering have tried to propose evaluation frameworks
closer to the usage.

The goal of this workshop is to study different aspects of Information
Filtering Evaluation and to bring together researchers from the
community of Information Filtering to develop new evaluation
frameworks and confront current models with these new evaluation
models. Submissions are expected to propose new insights on evaluation
methodologies and resources for Information Filtering or to present
Information Filtering models that will meet the requirements of a real
usage evaluation (in particular, researchers that submit papers
presenting Information Filtering Models are encouraged to evaluate
their model using an existing benchmark such as the INFILE benchmark,
available at


Both theoretical and practical research papers are welcome from both
research and industrial communities addressing the main workshop
theme, in any aspect including:

- Resources and methodologies for Evaluation of Information Filtering
  Systems in real usage context

- New models for Information Filtering, that tackle one or several
  issues of this kind of evaluation: efficiency, adaptivity,
  multilinguality, etc.

- Results of the Evaluation of Information Filtering Systems

- User studies of the use of Information Filtering Systems in
  Competitive Intelligence

Submission information

Papers will be submitted to the workshop via the START LREC Conference
Manager, under Authors
should submit a PDF file of no more than 10 pages, following the LREC
conference formatting details. Papers will be reviewed by three
members of the Program Committee, Accepted papers will be published in
the workshop Proceedings.  When submitting a paper from the START
page, authors will be asked to provide essential information about
resources (in a broad sense, i.e. also technologies, standards,
evaluation kits, etc.) that have been used for the work described in
the paper or are a new result of your research.  For further
information on this new iniative, please refer to http://

Important dates

Paper submission deadline (extended) 12 March 2010
Notification of acceptance 25 March 2010
Final version of accepted paper 4  April 2010
Workshop half-day 22 May 2010

Workshop Organizers
Romaric Besançon
BP 6 92265 Fontenay-aux-roses CEDEX
Tel: +33 1 46 54 80 16
Fax: +33 1 46 54 75 80
email: romaric.besancon at
Djamel Mostefa
55-57,rue Brillat Savarin 75013 Paris
Tel: +33 1 43 13 33 33
email: mostefa at

Program Committee
Romaric Besançon, CEA LIST
Stéphane Chaudiron Université Lille 3
Khalid Choukri, ELDA
Christian Fluhr, HossurTech
Meriama Laïb, CEA LIST
Djamel Mostefa, ELDA
Ismail Timimi, Université Lille 3

Message diffuse par la liste Langage Naturel <LN at>
Informations, abonnement :
English version       : 
Archives                 :

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  :

More information about the Ln mailing list