[Corpora-List] Can machines pass University Entrance Exams?
    Anselmo Peñas 
    anselmo at lsi.uned.es
       
    Tue Mar 12 09:26:02 UTC 2013
    
    
  
Entrance Exams at CLEF QA4MRE 2013 Lab
http://nlp.uned.es/entrance-exams/
Call for participation
The challenge of "Entrance Exams" [4][5][6] aims at evaluating systems 
under the same conditions humans are evaluated to enter Japanese 
University in several subjects such as History, Maths or English. For 
example, Fujitsu announced it's participation as the "math team" [1].
The CLEF QA4MRE 2013 Lab [2] take part in this ambitious program 
promoting the challenge of Entrance Exams about English [3].
In this first campaign we will focus on Reading Comprehension exercises 
contained in the English exams. More types of exercises will be included 
in subsequent campaigns (2014-2016) in coordination with the "Entrance 
Exams" task at NTCIR [4][5]. Exams are created by the Japanese National 
Center for University Admissions Tests. The "Entrance Exams" corpus is 
provided by NII's Todai Robot Project [6] and NTCIR RITE.
Data
The Entrance Exams 2013 test set will be composed of reading 
comprehension tests taken from the Japanese Center Test, which is a 
nation-wide achievement test for Japanese university admissions:
     - 9 test documents
     - 45 questions (5 questions for each document) with
     - 180 choices/options (4 for each question)
You will find an example of test at:
http://nlp.uned.es/entrance-exams/data.html
More info at: http://nlp.uned.es/entrance-exams/
Important Dates
Test set release			May 6, 2013
Run submissions				May 15, 2013
Individual results to participants	May 20, 2013
Submission of Working Notes Papers	June 15, 2013
CLEF Workshop in Valencia, Spain	September 23-26, 2013
Organizing Committee
Anselmo Peñas (UNED, Spain)
Eduard Hovy (Carnegie Mellon University, USA)
Pamela Forner (CELCT, Italy)
Noriko Kando (National Institute of Informatics, Japan)
Teruko Mitamura (Carnegie Mellon University, USA)
Yusuke Miyao (National Institute of Informatics, Japan)
Links
[1] 
http://www.fujitsu.com/global/news/pr/archives/month/2012/20120910-01.html
[2] http://celct.fbk.eu/QA4MRE/
[3] http://nlp.uned.es/entrance-exams/
[4] http://www.cl.ecei.tohoku.ac.jp/rite2/
[5] http://research.nii.ac.jp/ntcir/index-en.html
[6] http://21robot.org/About/
-- 
Dr. Anselmo Peñas Padilla
Dpto. Lenguajes y Sistemas Informáticos, UNED
c./Juan del Rosal, 16
28040 Madrid, Spain
Correo-e: anselmo at lsi.uned.es
Pág. web: http://nlp.uned.es/~anselmo
Teléfono: +34 91 398 77 50
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora
    
    
More information about the Corpora
mailing list