[Corpora-List] Question Generation Shared Task Evaluation Campaign 2010

Brendan Wyse bjwyse at gmail.com
Tue Feb 16 09:43:48 UTC 2010


QUESTION GENERATION SHARED TASK EVALUATION CAMPAIGN 2010
=======================================================

Colleagues,

This is a reminder that teams interested in the Question Generation Tasks
described below should make their interest known to Vasile Rus<
vrus at memphis.edu> and Brendan Wyse<bjwyse at gmail.com>.

Task A: Open Question Generation from Paragraphs
======================================

Teams are given a paragraph of text from OpenLearn, Wikipedia or Yahoo
Answers.
QG Systems should produce six questions at various scope levels from this
text.

Example:

Abraham Lincoln (February 12, 1809 – April 15, 1865), the 16th President of
the United States, successfully led his country through its greatest
internal crisis, the American Civil War, preserving the Union and ending
slavery. As an outspoken opponent of the expansion of slavery in the United
States, Lincoln won the Republican Party nomination in 1860 and was elected
president later that year. His tenure in office was occupied primarily with
the defeat of the secessionist Confederate States of America in the American
Civil War. He introduced measures that resulted in the abolition of slavery,
issuing his Emancipation Proclamation in 1863 and promoting the passage of
the Thirteenth Amendment to the Constitution. As the civil war was drawing
to a close, Lincoln became the first American president to be assassinated.

1)      Who is Abraham Lincoln?

2)      What major measures did President Lincoln introduce?

3)      How did President Lincoln die?

4)      When was Abraham Lincoln elected president?

5)      When was President Lincoln assassinated?

6)      What party did Abraham Lincoln belong to?


Task B: Question Generation from Sentences
=================================

Teams are given a single sentence of text from OpenLearn, Wikipedia or Yahoo
Answers.
They are also given a target question type (WHO? WHEN? WHERE? etc.)
QG Systems should produce a question of the target type and the question
will typically be answered by the given sentence.

Example:

The Council of Europe was set up in 1949.

Target Question Type: WHEN?

1)      When was the Council of Europe set up?


We have a further task whereby teams can submit interesting reports on
Question Generation.

Please see http://questiongeneration.org/QGSTEC2010 for more details.

We will have development data available very soon from this site.

Thank You.

QGSTEC2010 Organisers
===================
Brendan Wyse (The Open University)
Vasile Rus (The University of Memphis)
Mihai Lintean (The University of Memphis)
Art Graesser (The University of Memphis)
Svetlana Stoyanchev (The Open University)
Paul Piwek (The Open University)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listserv.linguistlist.org/pipermail/corpora/attachments/20100216/fba0f321/attachment.htm>
-------------- next part --------------
_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora


More information about the Corpora mailing list