[Corpora-List] Can machines pass University Entrance Exams?
Anselmo Peñas
anselmo at lsi.uned.es
Tue Mar 12 09:26:02 UTC 2013
Entrance Exams at CLEF QA4MRE 2013 Lab
http://nlp.uned.es/entrance-exams/
Call for participation
The challenge of "Entrance Exams" [4][5][6] aims at evaluating systems
under the same conditions humans are evaluated to enter Japanese
University in several subjects such as History, Maths or English. For
example, Fujitsu announced it's participation as the "math team" [1].
The CLEF QA4MRE 2013 Lab [2] take part in this ambitious program
promoting the challenge of Entrance Exams about English [3].
In this first campaign we will focus on Reading Comprehension exercises
contained in the English exams. More types of exercises will be included
in subsequent campaigns (2014-2016) in coordination with the "Entrance
Exams" task at NTCIR [4][5]. Exams are created by the Japanese National
Center for University Admissions Tests. The "Entrance Exams" corpus is
provided by NII's Todai Robot Project [6] and NTCIR RITE.
Data
The Entrance Exams 2013 test set will be composed of reading
comprehension tests taken from the Japanese Center Test, which is a
nation-wide achievement test for Japanese university admissions:
- 9 test documents
- 45 questions (5 questions for each document) with
- 180 choices/options (4 for each question)
You will find an example of test at:
http://nlp.uned.es/entrance-exams/data.html
More info at: http://nlp.uned.es/entrance-exams/
Important Dates
Test set release May 6, 2013
Run submissions May 15, 2013
Individual results to participants May 20, 2013
Submission of Working Notes Papers June 15, 2013
CLEF Workshop in Valencia, Spain September 23-26, 2013
Organizing Committee
Anselmo Peñas (UNED, Spain)
Eduard Hovy (Carnegie Mellon University, USA)
Pamela Forner (CELCT, Italy)
Noriko Kando (National Institute of Informatics, Japan)
Teruko Mitamura (Carnegie Mellon University, USA)
Yusuke Miyao (National Institute of Informatics, Japan)
Links
[1]
http://www.fujitsu.com/global/news/pr/archives/month/2012/20120910-01.html
[2] http://celct.fbk.eu/QA4MRE/
[3] http://nlp.uned.es/entrance-exams/
[4] http://www.cl.ecei.tohoku.ac.jp/rite2/
[5] http://research.nii.ac.jp/ntcir/index-en.html
[6] http://21robot.org/About/
--
Dr. Anselmo Peñas Padilla
Dpto. Lenguajes y Sistemas Informáticos, UNED
c./Juan del Rosal, 16
28040 Madrid, Spain
Correo-e: anselmo at lsi.uned.es
Pág. web: http://nlp.uned.es/~anselmo
Teléfono: +34 91 398 77 50
_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora
More information about the Corpora
mailing list