[Corpora-List] Can machines pass University Entrance Exams?

Anselmo Peñas anselmo at lsi.uned.es
Tue Mar 12 09:26:02 UTC 2013


Entrance Exams at CLEF QA4MRE 2013 Lab
http://nlp.uned.es/entrance-exams/

Call for participation

The challenge of "Entrance Exams" [4][5][6] aims at evaluating systems 
under the same conditions humans are evaluated to enter Japanese 
University in several subjects such as History, Maths or English. For 
example, Fujitsu announced it's participation as the "math team" [1].

The CLEF QA4MRE 2013 Lab [2] take part in this ambitious program 
promoting the challenge of Entrance Exams about English [3].

In this first campaign we will focus on Reading Comprehension exercises 
contained in the English exams. More types of exercises will be included 
in subsequent campaigns (2014-2016) in coordination with the "Entrance 
Exams" task at NTCIR [4][5]. Exams are created by the Japanese National 
Center for University Admissions Tests. The "Entrance Exams" corpus is 
provided by NII's Todai Robot Project [6] and NTCIR RITE.

Data

The Entrance Exams 2013 test set will be composed of reading 
comprehension tests taken from the Japanese Center Test, which is a 
nation-wide achievement test for Japanese university admissions:

     - 9 test documents
     - 45 questions (5 questions for each document) with
     - 180 choices/options (4 for each question)

You will find an example of test at:
http://nlp.uned.es/entrance-exams/data.html

More info at: http://nlp.uned.es/entrance-exams/


Important Dates

Test set release			May 6, 2013
Run submissions				May 15, 2013
Individual results to participants	May 20, 2013
Submission of Working Notes Papers	June 15, 2013
CLEF Workshop in Valencia, Spain	September 23-26, 2013


Organizing Committee

Anselmo Peñas (UNED, Spain)
Eduard Hovy (Carnegie Mellon University, USA)
Pamela Forner (CELCT, Italy)
Noriko Kando (National Institute of Informatics, Japan)
Teruko Mitamura (Carnegie Mellon University, USA)
Yusuke Miyao (National Institute of Informatics, Japan)


Links

[1] 
http://www.fujitsu.com/global/news/pr/archives/month/2012/20120910-01.html
[2] http://celct.fbk.eu/QA4MRE/
[3] http://nlp.uned.es/entrance-exams/
[4] http://www.cl.ecei.tohoku.ac.jp/rite2/
[5] http://research.nii.ac.jp/ntcir/index-en.html
[6] http://21robot.org/About/

-- 
Dr. Anselmo Peñas Padilla

Dpto. Lenguajes y Sistemas Informáticos, UNED
c./Juan del Rosal, 16
28040 Madrid, Spain

Correo-e: anselmo at lsi.uned.es
Pág. web: http://nlp.uned.es/~anselmo
Teléfono: +34 91 398 77 50

_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora



More information about the Corpora mailing list