[Corpora-List] Question Generation Shared Task Evaluation Campaign 2010

Brendan Wyse bjwyse at gmail.com
Sun Apr 4 10:07:08 UTC 2010


QUESTION GENERATION SHARED TASK EVALUATION CHALLENGE 2010
========================================================

This is a final call for participants for the QG STEC 2010. Development data
has already been released to interested participants. This month we will be
releasing the test data for the challenge. Please read on to learn about our
two tasks relating to Question Generation.


Task A: Open Question Generation from Paragraphs
======================================

Teams are given a paragraph of text from OpenLearn, Wikipedia or Yahoo
Answers.
QG Systems should produce six questions at various scope levels from this
text.

Example:

Abraham Lincoln (February 12, 1809 – April 15, 1865), the 16th President of
the United States, successfully led his country through its greatest
internal crisis, the American Civil War, preserving the Union and ending
slavery. As an outspoken opponent of the expansion of slavery in the United
States, Lincoln won the Republican Party nomination in 1860 and was elected
president later that year. His tenure in office was occupied primarily with
the defeat of the secessionist Confederate States of America in the American
Civil War. He introduced measures that resulted in the abolition of slavery,
issuing his Emancipation Proclamation in 1863 and promoting the passage of
the Thirteenth Amendment to the Constitution. As the civil war was drawing
to a close, Lincoln became the first American president to be assassinated.

1)      Who is Abraham Lincoln?

2)      What major measures did President Lincoln introduce?

3)      How did President Lincoln die?

4)      When was Abraham Lincoln elected president?

5)      When was President Lincoln assassinated?

6)      What party did Abraham Lincoln belong to?


Task B: Question Generation from Sentences
=================================

Teams are given a single sentence of text from OpenLearn, Wikipedia or Yahoo
Answers.
They are also given a target question type (WHO? WHEN? WHERE? etc.)
QG Systems should produce a question of the target type and the question
will typically be answered by the given sentence.

Example:

The Council of Europe was set up in 1949.

Target Question Type: WHEN?

1)      When was the Council of Europe set up?


Teams interested in the tasks described below should make their interest
known to Vasile Rus<vrus at memphis.edu> and Brendan Wyse<bjwyse at gmail.com>.

The QG STEC 2010 is part of Generation Challenges 2010 (
http://www.nltg.brighton.ac.uk/research/genchal10/index.html) and the
results of the challenge will be presented at the 3rd Workshop on Question
Generation (http://questiongeneration.org/QG2010).

We also have a further task whereby teams can submit interesting reports on
Question Generation at the workshop.

Please see http://questiongeneration.org/QGSTEC2010 for more details.


Thank You.

QGSTEC2010 Organisers
===================
Brendan Wyse (The Open University)
Vasile Rus (The University of Memphis)
Mihai Lintean (The University of Memphis)
Art Graesser (The University of Memphis)
Svetlana Stoyanchev (The Open University)
Paul Piwek (The Open University)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20100404/f93a0f7d/attachment.htm>
-------------- next part --------------
_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora


More information about the Corpora mailing list