[Corpora-List] Generation Challenges 2011: Announcement of Tasks and Call for Papers

Thu Feb 3 14:58:37 UTC 2011

Announcement of Tasks and Call for Papers

GENERATION CHALLENGES 2011
--------------------------

To be held in conjunction with ENLG 2011, 28-30 Sep 2011, Nancy, France.

Over the past four years, there has been a lot of activity in connection
with shared tasks in Natural Language Generation (NLG). Three separate
sets of shared tasks each with its own data and team of organisers have so
far been run: TUNA (Gatt et al.), GREC (Belz et al.) and GIVE (Koller et
al.).  The Pilot Attribute Selection for Generating Referring Expressions
(ASGRE) Challenge took place in 2007 (TUNA); the Referring Expression
Generation (REG) Challenge in 2008 (TUNA, GREC); the first and second
Generation Challenges umbrella events encompassing diverse sets of shared
tasks, took place in 2009 (TUNA, GREC and GIVE) and 2010 (GREC and GIVE);
and other shared tasks are being prepared.  More information about all of
these activities can be found via the links on the Generation Challenges
homepage: http://www.nltg.brighton.ac.uk/research/genchal11.

In order to continue to provide a common forum for these activities, we
are organising Generation Challenges 2011 (GenChal'11), an umbrella event
designed to bring together a variety of shared-task evaluation efforts
that involve the generation of natural language.  Evaluation results and
participating systems will be presented at the Generation Challenges 2011
Special Session at the 13th European Workshop on Natural Language
Generation (ENLG'11).  The session will follow the format of previous
GenChal results sessions, with presentations of results by the organisers
of the different shared tasks, as well as presentations of proposals for
new shared tasks in the Task Proposals Track. As at GenChal'10, we
envisage having a poster session where participants in the various shared
tasks will have the opportunity to present their approaches and results.
In addition, we are planning to have break-out sessions for individual
tasks, providing further opportunity for current and future task
participants to exchange ideas and feed back to the organisers.

1. Shared Tasks:
 - - - - - - - -

The GenChal11 meeting will be held at ENLG11 in Nancy, France, 28-30 Sep
2011, but the timetables of the individual tasks are not completely
aligned, and they will be organised independently (for details, please
refer to the Call for Participation for each task). The following is the
list of tasks that are part of GenChal11:

1. Surface Realisation Task: (White, van Genabith, Hogan, Stent & Belz):
Generation of sentences from shallow and deep input represenations. Call
for Expressions of Interest has been posted
(http://www.nltg.brighton.ac.uk/home/Anja.Belz/sr-task-announcement.txt).
Call for Participation in preparation.

2. The GIVE-2.5 Challenge (Koller et al.): Generation of natural-language
instructions to aid human task-solving in a virtual environment. The
GIVE-2.5 Task will be the same as the GIVE-2 Taks. The call for
participation and the software infrastructure have been posted (see
http://www.give-challenge.org/research/), i.e. development can begin
immediately.

3. Helping Our Own (HOO) (Kilgarriff & Dale): Text-to-text generation task
aiming to improve the quality of texts, in particular those written by
non-native speakers.  Call for Participation in preparation.

4. QG11 (Rus et al.): Generating questions about the information content
of sentences and paragraphs. For general information see
http://www.questiongeneration.org. Call for Participation to be posted.
Results summary to be presented at GenChal'11, detailed results session at
separate QG Workshop.

2. Track on Proposals for Future Tasks:
- - - - - - - - - - - - - - - - - - - -

We invite submissions of papers describing ideas for future shared tasks
in the general area of language generation.  Proposed tasks can be in the
area of core NLG, or in other research areas in which language is
generated, e.g. text-to-text generation (including MT and summarisation),
combining core NLG and MT, or combining core NLG and text summarisation.
Submissions should describe possible future tasks in detail, including
information regarding organisers, task description, motivating theoretical
interest and/or application context, size and state of completion of data
to be used, and evaluation plans.

3. Instructions for Paper Submissions:
- - - - - - - - - - - - - - - - - - -

Submissions in the Task Proposals Track should be no more than 4 (four)
pages long excluding citations, and should follow the ACL'11 guidelines
using the style files provided via the ACL 2011 homepage.  Papers should
be sent in PDF format by email to nlg-stec at itri.brighton.ac.uk.  Task
Proposal papers should be submitted no later than 10 June 2011.

Submissions will be reviewed by at least 3 members of the Generation
Challenges Steering Committee (see below).  As reviewing will not be
blind, there is no need to anonymise papers.  This is not intended to be a
selective process, but the organisers reserve the right to reject papers
which do not fall within the scope of the GenChal initiative, or which do
not follow guidelines.

Accepted submissions will be included in the ENLG'11 proceedings, but the
page limit for camera-ready versions has not yet been finalised (the final
limit will depend on how many submissions there are).

6. Dates:
- - - - -

Paper submission				03 June 2011
Notification of acceptance			17 June 2011
Submission of camera-ready papers		15 July 2011
ENLG'11		  				28-30 September 2011

NB: Submission deadlines for the GenChal'11 Shared Tasks differ and can be
found in the calls for participation for the tasks.

7. Generation Challenges Steering Committee:
- - - - - - - - - - - - - - - - - - - - - -

Anja Belz, NLTG, University of Brighton, UK
Albert Gatt, University of Malta and University of Aberdeen, UK
Alexander Koller, Saarland University, Germany
Robert Dale, Macquarie University, Australia
Kevin Knight, ISI, University of Southern California, USA
Chris Mellish, University of Aberdeen, UK
Johanna Moore, University of Edinburgh, UK
Amanda Stent, AT&T Labs, USA
Kristina Striegnitz, Union College, USA

8. Organisation:
- - - - - - - - -

Anja Belz, NLTG, University of Brighton, UK
Albert Gatt, University of Malta and University of Aberdeen, UK
Alexander Koller, Saarland University, Germany
Kristina Striegnitz, Union College, US

Generation Challenges homepage: http://www.nltg.brighton.ac.uk/research/genchal11
Generation Challenges email: nlg-stec at itri.brighton.ac.uk

_______________________________________________
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora