Appel: CLEF 2011 Amsterdam, September 19-22

Thierry Hamon thierry.hamon at UNIV-PARIS13.FR
Fri Feb 18 21:05:37 UTC 2011

Date: Wed, 16 Feb 2011 15:09:31 +0100
From: info at
Message-ID: <4D5BDA9B.8000905 at>



September 19th-22nd 2011

Amsterdam, The Netherlands


CLEF2011 is the second CLEF conference continuing the popular CLEF
campaigns. It will cover a broad range of issues in the fields of
multilingual and multimodal information access evaluation. It will
consist of two main parts: a peer-reviewed conference on research
papers, and a series of labs, which will continue the CLEF tradition
of community-based evaluation and discussion on evaluation issues.


The CLEF2011 conference aims at advancing the evaluation of complex
multimodal and multilingual information systems in order to support
individuals, organizations, and communities who design, develop,
employ, and improve such systems. The growth of the Internet has been
exponential with respect to the number of users, media, and languages
used regularly for global information dissemination. Language and
media barriers are no longer seen as inviolable and they are
constantly crossed and mixed to provide content that can be accessed
on a global scale within a multicultural and multilingual setting.

Users need to be able to co-operate and communicate across language
and media boundaries, going beyond separate search in diverse
media/languages and exploiting interactions between different
languages and media.

Experimental evaluation --- both laboratory and interactive --- is a
key to fostering the development of multilingual and multimodal
information systems that address increasingly complex information

We invite submissions for presentation at the CLEF2011 conference. We
welcome submissions on all aspects of multilingual and multimodal
information access evaluation. All submissions will be reviewed on the
basis of relevance, originality, importance, and clarity.


Relevant topics for the CLEF2010 conference include but are not
limited to:

    * Novel methodologies for the design of evaluation tasks,
      especially user-centric ones;
    * Analysis of the impact of multilingual/multicultural/multimodal
      differences in interface and search design;
    * Assessing multilinguality and multimodality in relevant
      application communities, e.g. digital libraries, intellectual
      property, medical, music, video, and social media;
    * Testing and evaluation of translation and summaries over
      documents and of linked documents in multilingual information
    * Benefits of multilingual information retrieval methods for
      different user groups or in different use cases, including those
      relevant to the developing world;
    * Alternative methods for improving and automating ground-truth
      creation, for example crowd-sourcing or log-based;
    * Alternatives and comparison of item-based, list-based,
      set-based, and session-based evaluation;
    * Prediction of success and satisfaction rate;
    * Task-oriented metrics of success and failure;
    * Simulation (of queries, sessions, users) and information
    * Innovative and easy to communicate techniques for analysing the
      experimental results, including statistical analyses, data
      mining, and information visualization;
    * Infrastructures for bringing automation and collaboration in the
      evaluation process;
    * Living laboratories and evaluating live systems;
    * Economic impact/sustainability of multilingual and multimodal
      information approaches, evaluation methodologies, and deployed


The conference proceedings will be published in the Springer Lecture
Notes in Computer Science (LNCS) series.

Authors are invited to submit electronically original papers, which
have not been published and are not under consideration elsewhere,
using the LNCS proceedings format.

Two types of papers are solicited:

    * full papers: 12 pages max;
    * short papers: 6 pages max.

Papers will be peer-reviewed by at least 3 members of the program
committee. Papers should be submitted in PDF format to the following


    * May 1st, 2011 Submission deadline
    * June 10th, 2011 Notification of acceptance
    * June 17th, 2011 Camera ready versions
    * September 19th-22nd, 2011 CLEF Conference


General chairs

    * Maarten de Rijke, University of Amsterdam, The Netherlands
    * Julio Gonzalo, UNED, Spain

Program chairs

    * Mounia Lalmas, Yahoo! Research, Spain
    * Jaana Kekäläinen, University of Tampere, Finland

Lab chairs

    * Vivien Petras, Humboldt University, Germany
    * Paul Clough, University of Sheffield, UK

Organization chair

    * Emanuele Pianta, CELCT, Italy

Resource and Publicity chair

    * Khalid Choukri, ELDA, France

Technical management

    * Pamela Forner, CELCT, Italy
    * Giovanni Moretti, CELCT, Italy

Local organizers

    * Richard Berendsen, University of Amsterdam, The Netherlands
    * Bouke Huurnink, University of Amsterdam, The Netherlands
    * Edgar Meij, University of Amsterdam, The Netherlands

Program committee

    * Maristella Agosti, University of Padua
    * Pia Borlund, Royal School of Library and Information Science, Denmark
    * Pavel Braslavski, Yandex, Russia
    * Ben Carterette, University of Delaware, USA
    * Nicola Ferro, University of Padua, Italy
    * Norbert Fuhr, University of Duisburg, Germany
    * Gareth Jones, Dublin City University, Ireland
    * Marko Junkkari, University of Tampere, Finland
    * Kal Järvelin, University of Tampere, Finland
    * Noriko Kando, National Institute of Informatics, Japan
    * Heikki Keskustalo, University of Tampere, Finland
    * Birger Larsen, Royal School of Library and Information Science,
    * Ray Larson, University of California, Berkeley, USA
    * Prasenjit Majumder, Dhirubhai Ambani Institute of Information and
      Communication Technology, India
    * Paul McNamee, Johns Hopkins University, USA
    * Stefano Mizzarro, University of Udine, Italy
    * Jian-Yun Nie, University of Montreal, Canada
    * Carol Peters, ISTI CNR Pisa, Italy
    * Vivien Petras, Humboldt University, Germany
    * Ian Ruthven, University of Strathclyde, United Kingdom
    * Christa Womser-Hacker, University of Hildesheim, Germany

Message diffuse par la liste Langage Naturel <LN at>
Informations, abonnement :
English version       : 
Archives                 :

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  :

More information about the Ln mailing list