LREC 2012 Workshop: 1st CfP Collaborative Resource Development and Delivery

ELRA ELDA Information info at
Mon Dec 19 11:13:30 EST 2011

[Apologies for multiple postings]

LREC Workshop
Collaborative Resource Development and Delivery
Lütfi Kirdar Istanbul Exhibition and Congress Centre
Istanbul, Turkey
May 27, 2012

A confluence of needs and activities points to a new emphasis in 
computational linguistics to address lexical, propositional, and 
discourse semantics through corpora. A few examples are: - the demand 
for high quality linguistic annotations of corpora representing a wide 
range of phenomena, especially at the semantic level, to support machine 
learning and computational linguistics
research in general; - the demand for high quality annotated corpora 
representing a broad range of genres that are flexible and extensible as 
need demands; - the demand for high quality lexical and semantic 
resources to incorporate into the annotation process, and for the 
annotation process to produce; - the need for easy-to-use, open access 
to all of these resources for

Such resources can be very costly to produce, due to the need for manual 
creation or validation to ensure quality. Therefore, to answer the 
growing need and lower the costs of resource creation and enhancement, 
there is a movement within the community toward collaborative resource 
development, including collaborative corpus annotation and collective 
reation/enhancement of lexical resources and knowledge bases. 
Collaborative development encompasses both engaging the community in 
annotation and development of common resources, as well as 
crowd-sourcing and similar solutions.

Technological advances now enable development of web-based environments 
for collaborative annotation and enhancement of language resources, 
including annotated corpora, lexicons, and others; and platforms to 
support web services that deliver data, annotations, and other resources 
as well as high-quality automated linguistic annotations of language 
data. At the same time,
crowdsourcing is being explored as a viable means of producing high 
quality resources. Given the recent advancements in technology plus 
novel methods to collect manually annotated data, it is important to 
develop new methods of quality control, hopefully ones that permit rapid 
acquisition and sharing of resources.

This workshop seeks contributions in all dimensions of collaborative 
resource development and delivery, with a specific focus on case studies 
and lessons learned. We invite submissions that address but are not 
limited to the following topics:
- Web services and platforms for collaborative resource development and 
- Crowd sourcing for resource development, including studies of efficacy;
- Strategies and issues for open resource distribution;
- Evaluation of collaboratively developed resources;
- Position papers outlining issues and proposing solutions for 
community-based collaborative resource development and/or delivery.

Special session
The workshop will include a special session devoted to means and 
considerations for community-based linguistic annotation, with a special 
emphasis on the
Manually Annotated Sub-Corpus (MASC) ( We 
invite submissions to this session on the following topics:
- position papers concerning any aspect of collaborative resource 
development, including means to get the community fully invested in such 
- case studies describing collaborative development efforts, including 
assessment of what works and what doesn't;
- results obtained using collaboratively developed resources;
- the role of standards and best practices in collaboratively developed 
resources and contributed annotations.

Special consideration will be given to contributions that have used MASC 
data in a way that highlights the benefits of community-based annotation.

Submission information
Submissions may be long papers or short papers, following the formatting 
guidelines for submissions to the main conference given at All submissions should be made using 
the START system at

Important Dates
Submissions due: February 15, 2012
Acceptance notification to authors: March 15, 2012

Camera ready due: April 1, 2012

Workshop: May 27, 2012

Workshop organizers
Nancy Ide, Vassar College, USA
Collin Baker, ICSI/UC Berkeley, USA
Christiane Fellbaum, Princeton University, USA
Rebecca Passonneau, Columbia University, USA

Contact: collaboration-workshop at

Program Committee Members (tentative)
Collin Baker, ICSI/UC Berkeley, USA
Jason Baldridge, University of Texas at Austin, USA
Jordan Boyd-Graber, University of Maryland, USA
Nicoletta Calzolari, ILC/CNR, Italy
Bob Carpenter, Alias I,Inc., USA
Chris Cieri, LDC, University of Pennsylvania, USA
Mona Diab, Columbia University, USA
Bill Dolan, Microsoft Corp., USA
Christiane Fellbaum, Princeton University, USA
Dan Flickinger, Stanford University, USA
Terry Langendoen, University of Arizona, USA
Eric Nyberg, Carnegie-Mellon University, USA
Rebecca Passonneau, Columbia University, USA
Massimo Poesio, University of Trento, Italy
Sameer Pradhan, BBN Technologies, USA
James Pustejovsky, Brandeis University, USA
Owen Rambow, Columbia University, USA
Manfred Stede, Universitat Potsdam, Germany

More information about the HPSG-L mailing list