LREC 2010 Workshop: 1st CfP - Evaluation of Information Filtering Systems in a Competitive Intelligence Framework Workshop

[info at elda.org]

[Apologies for multiple postings]
CALL FOR PAPERS

Evaluation of Information Filtering Systems in a Competitive 
Intelligence Framework Workshop
22 May 2010
Held in conjunction with LREC 2010, Malta

Aims

The constant growth of publicly available information has entailed a 
consequently similar growth in the research areas devoted to the 
automated organization of this information. In particular, Information 
Filtering systems have been developed to tackle the issues of many 
applications of business intelligence, from mail categorization to news 
routing and technology watch. However, the theoretically challenging 
models of these systems have seldom been evaluated in real usage 
context. Indeed, standard evaluation benchmarks usually introduce 
artefacts that simplify the task. For instance, in the context of 
competitive intelligence, systems must filter documents without any 
global information on a "collection" but can use feedback from the user, 
and must be efficient enough to deal with a real-time document stream. 
Furthermore, with the increase of globalized access and availability of 
the information, sources may be found in many languages, and the 
multilinguality issue must also be considered. TREC Adaptive Filtering 
Track and INFILE track at CLEF for multilingual information filtering 
have tried to propose evaluation frameworks closer to the usage.

The goal of this workshop is to study different aspects of Information 
Filtering Evaluation and to bring together researchers from the 
community of Information Filtering to develop new evaluation frameworks 
and confront current models with these new evaluation models. 
Submissions are expected to propose new insights on evaluation 
methodologies and resources for Information Filtering or to present 
Information Filtering models that will meet the requirements of a real 
usage evaluation (in particular, researchers that submit papers 
presenting Information Filtering Models are encouraged to evaluate their 
model using an existing benchmark such as the INFILE benchmark, 
available at http://www.infile.org).

Topics

Both theoretical and practical research papers are welcome from both 
research and industrial communities addressing the main workshop theme, 
in any aspect including:
- Resources and methodologies for Evaluation of Information Filtering 
Systems in real usage context
- New models for Information Filtering, that tackle one or several 
issues of this kind of evaluation: efficiency, adaptability, 
multilinguality, etc.
- Results of the Evaluation of Information Filtering Systems
- User studies of the use of Information Filtering Systems in 
Competitive Intelligence

Submission information

Papers will be submitted to the workshop via the START LREC Conference 
Manager, under https://www.softconf.com/lrec2010/InFile2010/
Authors should submit a PDF file of no more than 10 pages, following the 
LREC conference formatting details. Papers will be reviewed by three 
members of the Program Committee,
Accepted papers will be published in the workshop Proceedings.
When submitting a paper from the START page, authors will be asked to 
provide essential information about resources (in a broad sense, i.e. 
also technologies, standards, evaluation kits, etc.) that have been used 
for the work described in the paper or are a new result of your research.
For further information on this new initiative, please refer to 
http://www.lrec-conf.org/lrec2010/?LREC2010-Map-of-Language-Resources.

Important dates

Paper submission deadline 28 February 2010
Notification of acceptance 22 March 2010
Final version of accepted paper 4  April 2010
Workshop half-day 22 May 2010

Workshop Organizers

Romaric Besançon
CEA LIST
BP 6 92265 Fontenay-aux-roses CEDEX
FRANCE
Tel: +33 1 46 54 80 16
Fax: +33 1 46 54 75 80
email: romaric.besancon at cea.fr
Djamel Mostefa
ELDA
55-57,rue Brillat Savarin 75013 Paris
FRANCE
Tel: +33 1 43 13 33 33
email: mostefa at elda.org

Program Committee
Romaric Besançon, CEA LIST
Stéphane Chaudiron Université Lille 3
Khalid Choukri, ELDA
Christian Fluhr,
Meriama Laïb, CEA LIST
Djamel Mostefa, ELDA
Ismail Timimi, Université Lille 3






-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/hpsg-l/attachments/20100120/f4d0a103/attachment.htm>
-------------- next part --------------