Corpora: Announcement of a LREC'2000 Satellite Workshop on Evaluation

[Patrick Paroubek]

Call for papers

LREC'2000 Satellite Workshop

"Using Evaluation within HLT Programs: Results and Trends"

Organized jointly by the IST/HLT-CLASS project, the ELSNET Network
and ELRA, the European Language Resource Association.


to be held in Athens, Greece, on May 30, 2000


A half-day workshop, will be held in conjunction with the LREC Conference
in Athens on May 30, 2000 (morning). The theme of the workshop is "what
exists, how it's used and what is needed in terms of Evaluation" within
Human Language Technology programs, such as the European IST-HLT program,
the US HLT or TIDES programs or those organized by NIST, their Japanese
counterparts, or other national programs.

Both the evaluation of technologies (systems and components) and the
evaluation of applications (user-oriented/usage evaluation) will be
addressed across various areas of HLT processing encompassing, but not
restricted to, written and spoken language processing: Textual and
multimedia document retrieval, Cross-lingual information retrieval, Message
and document understanding, Topic detection and tracking, Summarization,
Machine translation, Speech recognition and dictation, Speech synthesis,
Speech coding, Oral and multimodal dialog. Also experience and
methodologies from related domains, such as OCR, Face recognition, Image
segmentation and  understanding, will be considered.

This workshop concerns programs, both national and transnational, as well
as projects where evaluation is used to compare technologies and
approaches, or to measure progress. Participants and organizers of past or
present evaluation programs across the world are encouraged to attend, as
well as institutions or companies using or including evaluation in their
R&D activities. Especially the former EC-supported projects are invited to
present their experience in that field, and the new EC IST-HLT selected
projects are most welcomed to present their approach or their needs for
objective and subjective evaluation.

We wish to get from the workshop presentations a better knowledge of how
the various uses and needs of evaluation in the specific context of
projects or programs relate to what is available in terms of tools,
resources, practices and methodologies for evaluation.

We expect to gather a large selection of actors interested or involved in
evaluation for Human Language Processing (spoken and written), or related
domains, in the hope that it will trigger multilingual and crosslingual
international cooperation activities. We would like this workshop to be
also a kind of trade-fair for Human Language Technologies and Applications
Evaluation.


Submission of papers=20

Submissions should consist of an abstract of one page, plus a title page
providing the following information: official title of the paper; names and
affiliations of the authors; full address of the first author including
phone, fax, email, URL; presentation facilities required. Only electronic
submissions will be accepted. The submissions should be sent to
classwork at limsi.fr.

Reception of the submission will be acknowledged within 48 hours. If you do
not get an acknowledgement, please check the email address of your
submission, and send it again, or contact J. Mariani (mariani at limsi.fr) or
P. Paroubek (pap at limsi.fr).


Proceedings

The workshop organizers will produce proceedings. Therefore, print-ready
versions of the selected papers will have to be submitted according to LREC
Guidelines for Authors which can be found at www.elda.fr/lrec2000.html.
They should be up to 4-6 pages in length. These final versions should be
submitted electronically to the same email address: classwork at limsi.fr.


Important Dates=20

Deadline for submissions of papers:	March 20=20
Notification of acceptance:	April 3
Final versions of papers for proceedings:	May 15
Workshop:	May 30


Further information

Information about the workshop such as call, schedule, and program will be
available on the LREC web-page: ( http://www.elda.fr/lrec2000.html ), where
you will also find information about the LREC conference and other
satellite workshops.


Registration

The registration fee for the workshop is:

- 60 EURO for those not attending LREC
- 40 EURO for those attending LREC

 Registration and payment are explained on the LREC web-page.

Included in the registration fee are the proceedings and coffee at the=
 breaks.


Questions

For all questions with respect to the workshop focus, please contact the
workshop organizers at classwork at limsi.fr . For all questions with respect
to organizational issues, accommodation, etc., please contact the LREC
secretariat: LREC2000 at ilsp.gr.


Organizing Committee=20

- Chair: Joseph Mariani, LIMSI-CNRS, France

- Niels Ole Bernsen, NIS, Odense University, Denmark
- Stephane Chaudiron, University Paris 10 and MENRT, France
- Khalid Choukri, ELRA-ELDA, France
- Claude de Loupy, LIA, France
- Robert Gaizauskas, Sheffield University, UK
- Donna Harman, NIST - TREC group, USA
- Lynette Hirschman, MITRE, USA
- Christian Jacquemin, LIMSI-CNRS, France
- Adam Kilgariff, ITRI, University of Brighton, UK
- Patrick Paroubek, LIMSI-CNRS, France
- Jose Pardo, ETSI, UPM, Spain
- Martin Rajman, Swiss Federal Institute of Technology, Lausanne,=
  Switzerland
- Herman Steeneken, TNO-IZF, The Netherlands
- Oliviero Stock, IRST-ITC, Italy
- Hans Uszkoreit, DFKI, Germany