[HPSG-L] Call for Participation: Extrinsic Parser Evaluation at DepLing and IWPT 2017

[Stephan Oepen]

[with apologies for cross-posting]

We would like to kindly invite participants to a friendly competition on

  Extrinsic Parser Evaluation (Using Syntactico-Semantic Dependencies)

This will be organized as a Shared Task, jointly sponsored by the

  4th International Conference on Dependency Linguistics (DepLing 2017)

and the

  15th International Conference on Parsing Technologies (IWPT 2017)

The two conferences will be co-located in Pisa (Italy), with one day of
joint programme, from September 18 to 22, 2017.  The findings from the
Shared Task will be presented on the overlapping, joint day: Wednesday,
September 20.

Our goal is to stimulate the statistical parsing community to evaluate
different types of dependency representations and different approaches
to dependency parsing in terms of their contributions to a broad range
of downstream applications, each assumed to depend heavily on the input
abstraction and normalization available through grammatical analysis.

The task organizers aim to provide the technical infrastructure to make
such extrinsic evaluation comparatively easy for all parser developers.
Anyone working on parsing English text into a representation that can
be interpreted as a bi-lexical dependency graph is invited to submit
parser outputs for automated extrinsic evaluation in state-of-the-art
downstream applications, as for example bio-medical event extraction,
negation scope resolution, and fine-grained opinion analysis.

Parser inputs are available as of today, and system outputs will have
to be submitted by mid-June.  Besides empirical results regarding the
downstream suitability of different parsing set-ups, we hope to gain a
better understanding of relevant linguistic differences between various
types of dependency representations, as well as to work jointly towards
a community-driven system for cross-framework extrinsic evaluation

For details on supported downstream applications, available data sets,
interface specifications, and the Shared Task schedule, please see:

  http://epe.nlpl.eu

We ask all interested parties to self-subscribe to the mailing list for
this task: the subscription link is available from the above web page.

Please do not hesitate to contact the task organizers for questions or
comments at ‘epe-organizers at nlpl.eu’.

Filip Ginter, Richard Johansson, Emanuele Lapponi, Joakim Nivre,
Stephan Oepen, Anders Søgaard, Erik Velldal, and Lilja Øvrelid