Appel: GikiCLEF 2009

[Thierry Hamon]

Date: Mon, 19 Jan 2009 10:10:26 +0100
From: Nuno Cardoso <ncardoso at xldb.di.fc.ul.pt>
Message-ID: <49744382.3010902 at xldb.di.fc.ul.pt>
X-url: http://www.linguateca.pt/GikiCLEF/
X-url: http://www.clef-campaign.org/
X-url: http://ilps.science.uva.nl/WikiXML/xmlformat.php



Apologies for cross-postings 

=======================================================================
GikiCLEF - Cross-language Geographic Information Retrieval from
Wikipedia A CLEF 2009 track
=======================================================================
http://www.linguateca.pt/GikiCLEF/

----------------------
Call for Participation
----------------------

You are invited to participate in GikiCLEF 2009, a CLEF track
(http://www.clef-campaign.org/), whose aim is to evaluate systems
which find Wikipedia entries / documents that answer a particular
information need which requires geographical reasoning of some sort.

GikiCLEF is the follow-up of the GikiP 2008 pilot task which ran under
GeoCLEF 2008, and is one of the tracks under CLEF, whose workshop will
take place in Corfu Greece in connection with ECDL 2009.

TASK DESCRIPTION:
=================

Systems will receive a list of 50 questions and will have to return a
list of answers (in the form of titles of Wikipedia entries) for each,
from the GikiCLEF collection.

GikiCLEF LANGUAGES:
===================
Questions and answers are to be found in the nine languages (and ten
Wikipedia versions) below:

Bulgarian (BG), Dutch (NL), English (EN), German (DE), Italian (IT),
Norwegian (NN and NO), Portuguese (PT), Romanian (RO) and Spanish
(ES).

Systems may participate in any language subset, although the best
system would have to process all languages.

GikiCLEF COLLECTION:
===================

The GikiCLEF collection comprehends the June 2008 Wikipedia document
collections for the above mentioned languages, processed by the
WikiXML tool developed by the University of Amsterdam
(http://ilps.science.uva.nl/WikiXML/xmlformat.php). Also available to
the participants are the June 2008 MediaWiki SQL and HTML dumps for
the GikiCLEF languages.

TOPICS:
=======

Topics (or rather, questions) will be released early March 2009, in
all GikiCLEF languages. The topic choice committee will devise topics
with crosslingual and cultural interest, so that the need for looking
in Wikipedia in different languages is not artificial.

See the Web site for topic examples and previous GikiP topics.

EVALUATION:
===========

After pooling all answers returned by the participant systems, they
will be manually assessed by the organization.
The systems will be evaluated according to the number of correct hits
and precision in all languages, so that multilinguality is rewarded.

IMPORTANT DATES:
================

18 January 2009: Final registration required.
February 2009: Discussion / Publication of the final definition of the
GikiCLEF task.
March 2009: Topic release and run submission.
(2 weeks after topic release): Deadline for run submission.
June 2009: Assessment and GikiCLEF results made available.
14 August 2009: Submission of Papers for Working Notes
30 Sep/2 Oct 2009: CLEF Workshop (in Corfu, Greece)

-------------------------------------------------------------------------
Message diffuse par la liste Langage Naturel <LN at cines.fr>
Informations, abonnement : http://www.atala.org/article.php3?id_article=48
English version       : 
Archives                 : http://listserv.linguistlist.org/archives/ln.html
                                http://liste.cines.fr/info/ln

La liste LN est parrainee par l'ATALA (Association pour le Traitement
Automatique des Langues)
Information et adhesion  : http://www.atala.org/
-------------------------------------------------------------------------