<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
</head>
<body bgcolor="#ffffff" text="#000000">
In 2009, INEX evaluation campaign runs a <b>question-answering</b>
& <b>answer aggregation</b> track
(<a class="moz-txt-link-freetext" href="http://www.inex.otago.ac.nz/tracks/qa/qa.asp">http://www.inex.otago.ac.nz/tracks/qa/qa.asp</a>).<br>
The INEX 2009 QA@INEX track aims to compare the performance of QA,
XML/passage
retrieval and automatic summarization systems on an encyclopedic
resource like the Wikipedia. The track will consider two type of
questions that extend queries considered in Ad-Hoc tasks. The first
set will be <b>factual questions</b> which require a <b>single
precise answer</b>
to be found in the corpus if it exists. The second set will consists
of more <b>complex questions</b> whose answers require the <b>aggregation</b>
of
several passages. The passages need not necessarily be in a single
document, thus might involve multi-document answer aggregation.
Participation of automatic summarization systems by passage
extraction is therefore encouraged. This will be an opportunity to
test XML/passage retrieval systems on advanced QA tasks. <br>
<br>
As for the ad hoc track, we will use the INEX 2009 <b>Wikipedia</b>
collection (without images). Each participating group will be asked
to create a set of candidate questions, representative of a range of
real user needs. <br>
<br>
More information can be found on
<a class="moz-txt-link-freetext" href="http://www.inex.otago.ac.nz/tracks/qa/qa.asp">http://www.inex.otago.ac.nz/tracks/qa/qa.asp</a><br>
<br>
Important dates:<br>
- 1/Jun/2009 Declaration of intent
<br>
- 15/Jun/2009 Submission deadline for candidate questions ; Result
Submission Specification
<br>
- 1/Jul/2009 Release of final set of questions <br>
- 31/Jul/2009 Submission deadline for Results (short and long
answers)
<br>
- 30/Sep/2009 Submission deadline for relevance assessments
<br>
- 6-10/Dec/2009 INEX Workshop in Brisbane, Australia<br>
<br>
Contacts:<br>
Patrice Bellot, University of Avignon, <a class="moz-txt-link-abbreviated" href="mailto:patrice.bellot@univ-avignon.fr">patrice.bellot@univ-avignon.fr</a><br>
Véronique Moriceau, LIMSI-CNRS, University Paris-Sud 11,
<a class="moz-txt-link-abbreviated" href="mailto:moriceau@limsi.fr">moriceau@limsi.fr</a><br>
Eric SanJuan, University of Avignon, <a class="moz-txt-link-abbreviated" href="mailto:eric.sanjuan@univ-avignon.fr">eric.sanjuan@univ-avignon.fr</a><br>
Xavier Tannier, LIMSI-CNRS, University Paris-Sud 11, <a class="moz-txt-link-abbreviated" href="mailto:xtannier@limsi.fr">xtannier@limsi.fr</a><br>
<br>
<br>
<br>
<div class="moz-signature">-- <br>
Xavier Tannier <br>
LIMSI-CNRS <br>
Université Paris-Sud 11<br>
B.P. 133 <br>
91403 ORSAY CEDEX <br>
FRANCE <br>
<br>
<a href="http://www.limsi.fr/%7Extannier/">http://www.limsi.fr/~xtannier/</a>
<br>
tel: 0033 (0)1 69 85 80 12 <br>
fax: 0033 (0)1 69 85 80 88 <br>
----------------------------------------------------------- <br>
</div>
<br>
</body>
</html>