[Corpora-List] INEX 2006 - Call for participation

[Christof Monz]

FYI

-------- Original Message --------
Subject: 	INEX 2006 - Call for participation
Date: 	Tue, 21 Feb 2006 13:42:47 +0000
From: 	Mounia Lalmas <mounia at dcs.qmul.ac.uk>
Organization: 	Queen Mary University of London
To: 	Mounia Lalmas <mounia at dcs.qmul.ac.uk>



INEX 2006 - Call for participation


http://inex.is.informatik.uni-duisburg.de/2006/index.html

Content-oriented XML retrieval has been receiving increasing interest  
fuelled by the widespread use of the eXtensible Markup Language  
(XML), as a standard document format. The continuous growth in XML  
data sources is matched by increasing efforts in the development of  
XML retrieval systems, which aim at exploiting the available  
structural information in documents to implement a more focused  
retrieval strategy and return document components, the so-called XML  
elements - instead of complete documents - in response to a user  
query. Implementing this, more focused, retrieval paradigm means that  
an XML retrieval system needs not only to find relevant information  
in the XML documents, but also determine the appropriate level of  
granularity to be returned to the user. In addition, the relevance of  
a retrieved component is dependent on meeting both content and  
structural conditions.

Evaluating the effectiveness of XML retrieval systems, hence,  
requires a test collection where the relevance assessments are  
provided according to a relevance criterion, which takes into account  
the imposed structural aspects. In 2002, the Initiative for the  
Evaluation of XML Retrieval (INEX) started to address these issues.  
The aim of the INEX initiative is to establish an infrastructure and  
provide means, in the form of a large XML test collection and  
appropriate scoring methods, for the evaluation of content-oriented  
XML retrieval systems.

Evaluating retrieval effectiveness is typically done by using test  
collections assembled specifically for evaluating particular  
retrieval tasks. A test collection as such has been built as a result  
of four rounds of INEX (2002 to 2005).

In INEX 2006, participating organisations will be able to compare the  
retrieval effectiveness of their XML retrieval systems and will  
contribute to the construction of a new XML test collection based on  
Wikipedia. The test collection will also provide participants a means  
for future comparative and quantitative experiments.

Tasks and tracks
In addition to the main general ad-hoc retrieval task, INEX 2006 will  
have the following two specific tasks:

  1. Relevance feedback task
  2. Natural query language task

INEX 2006 will continue with the following four tracks that started  
in previous years:

  1. Heterogeneous collection track
  2. Interactive track
  3. Document mining track
  4. Multimedia track

Two additional tracks are planned for INEX 2006:

  1. Use case studies track
  2. XML Entity Search track

Relevance assessments

Relevance assessments will be provided by the participating groups  
using INEX's on-line assessment system. Each participating  
organisation will judge around 2 topics. Please note that assessments  
take about one-person week per topic! Participating groups will gain  
access to the completed INEX test collection only after they have  
completed their assessment task. Upon completion of the relevance  
assessments, participants new to INEX can have access to the previous  
years test collections.

Workshop and proceedings

Participants will be able to present their approaches and final  
results at the INEX 2006 workshop to be held in December in Dagstuhl.  
Revised papers will be published in the INEX post-workshop final  
proceedings. As for INEX 2004 and 2005, we expect the INEX final  
proceedings to be published in the Springer's Lecture Notes in  
Computer Science (LNCS) series.

Organisers

Project Leaders
Norbert Fuhr
Mounia Lalmas

Contact persons
Saadia Malik
Zoltán Szlávik

Wikipedia document collection and exploration
Ludovic Denoyer
Martin Theobald

Use case studies
Andrew Trotman
Nils Pharo

Topic format specification
Andrew Trotman
Birger Larsen

Task description
Jaap Kamps
Charlie Clarkes

Online relevance assessment tool
Benjamin Piwowarski

Metrics
Gabriella Kazai
Stephen Robertson
Paul Ogilvie

Relevance feedback task
Yosi Mass
Ralf Schenkel

Natural query language task
Shlomo Geva
Xavier Tannier



Heterogeneous collection track
Ingo Frommholz
Ray Larson

Interactive track
Birger Larsen
Anastasios Tombros
Saadia Malik

Document mining track
Ludovic Denoyer
Anne-Marie Vercoustre
Patrick Gallinari

XML multimedia track
Roelof van Zwol
Thijs Westerveld

XML entity search track
Arjen de Vries
Nick Craswell




---
Christof Monz
Department of Computer Science
Queen Mary, University of London
London E1 4NS, UK

Phone: +44 (0)20 7882-7978
Fax: +44 (0) 20 8980 6533
E-mail: christof at dcs.qmul.ac.uk
Web: http://www.dcs.qmul.ac.uk/~christof
PGP: http://www.dcs.qmul.ac.uk/~christof/pubkey.asc