Appel: QAst 2008

Thierry Hamon thierry.hamon at LIPN.UNIV-PARIS13.FR
Tue Mar 4 21:13:35 UTC 2008

Date: Mon, 03 Mar 2008 14:53:32 +0100
From: ELDA <info at>
Message-ID: <47CC02DC.2090205 at>

Dear All,

We are pleased to announce the release of the development dataset for
the CLEF-QA 2008 track "Question Answering on Speech
Transcripts" (QAst).  We take this opportunity to launch a first
call for participation in this evaluation exercise.

QAst is a CLEF-QA track that aims at providing an evaluation framework
for QA technology on speech transcripts, both manual and automatic.  A
detailed description of this track is available at: <>

It is the second evaluation for the QAst track.
Last year (QAst 2007), factual questions had been generated for two
distinct corpora (in English language only). This year, in addition to
factual questions, some definition questions are generated, and five
corpora covering three different languages are used (3 corpora in
English, 1 in Spanish and 1 in French).

Important dates:

# 15 June 2008: evaluation set released
# 30 June 2008: submission deadline

The pilot track is organized jointly by the Technical University of
Catalonia (UPC), the Evaluations and Language resources Distribution
Agency (ELDA) and Laboratoire d'Informatique pour la Mécanique et les
Sciences de l'Ingénieur (LIMSI).

If you are interested in participating please send an email to Jordi 
Turmo ( with "QAst" in the subject line.

Best regards,

QAst organizers.

Message diffuse par la liste Langage Naturel <LN at>
Informations, abonnement :
English version       : 
Archives                 :

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  :

More information about the Ln mailing list