8.784, Confs: SALT Workshop, RIAO97
linguist at linguistlist.org
linguist at linguistlist.org
Sun May 25 00:59:36 UTC 1997
LINGUIST List: Vol-8-784. Sat May 24 1997. ISSN: 1068-4875.
Subject: 8.784, Confs: SALT Workshop, RIAO97
Moderators: Anthony Rodrigues Aristar: Texas A&M U. <aristar at linguistlist.org>
Helen Dry: Eastern Michigan U. <hdry at linguistlist.org>
T. Daniel Seely: Eastern Michigan U. <seely at linguistlist.org>
Review Editor: Andrew Carnie <carnie at linguistlist.org>
Associate Editors: Ljuba Veselinova <ljuba at linguistlist.org>
Ann Dizdar <ann at linguistlist.org>
Assistant Editor: Sue Robinson <sue at linguistlist.org>
Software development: John H. Remmers <remmers at emunix.emich.edu>
Zhiping Zheng <zzheng at online.emich.edu>
Home Page: http://linguistlist.org/
Editor for this issue: Ann Dizdar <ann at linguistlist.org>
==========================================================================
We'd appreciate your limiting conference announcements to 150 lines,
so that we can post more than 1 per issue. Please consider omitting
information useful only to attendees, such as information on housing,
transportation, or rooms and times of sessions. Please do not use
abbreviations or acronyms for your conference unless you explain
them in your text. Many people outside your area of specialization
will not recognize them. Thank you for your cooperation.
=================================Directory=================================
1)
Date: Fri, 23 May 97 18:16:42 BST
From: Robert John Gaizauskas <R.Gaizauskas at dcs.shef.ac.uk>
Subject: SALT Workshop on Evaluation -- Programme
2)
Date: Fri, 23 May 1997 17:58:20 -0300
From: Abdellatif.Saoudi at irin.univ-nantes.fr (Abdellatif Saoudi)
Subject: RIAO97 : CALL FOR PARTICIPATION
-------------------------------- Message 1 -------------------------------
Date: Fri, 23 May 97 18:16:42 BST
From: Robert John Gaizauskas <R.Gaizauskas at dcs.shef.ac.uk>
Subject: SALT Workshop on Evaluation -- Programme
Apologies if you receive this more than once.
***********************
Also available at:
http://www.dcs.shef.ac.uk/research/ilash/Meetings/SALT97
***********************
Speech and Language Technology (SALT) Club Workshop
on
Evaluation in Speech and Language Technology
June 17-18, 1997
Halifax Hall, University of Sheffield, Sheffield, UK
PROGRAMME
*** June 17 ***
9:00 Welcome, Rob Gaizauskas, Sheffield
9:15-10:00 Maghi King, ISSCO and ETI
The EAGLES Evaluation Group: Standards and Sharing
10:00-10:45 Lynette Hirschman, MITRE
Language Understanding Evaluations:
A Case Study of MUC and ATIS
10:45-11:15 COFFEE
11:15-1:00 Multi-site Evaluation Exercises
Towards a methodology for evaluating information retrieval systems
adapted to textual documents in the French language: the Amaryllis
exploratory cycle
A Coret, P Kremer, B Landi, D Schibler, L Schmitt - INIST
AUPELF Project: Term and Semantic Relation Extraction Tools:
Evaluation Paradigms
C Jouis, W Elhadi - UFR IDIST/CREDO
Industrial Parsing of Software Manuals: Empirical Qualitative
Comparison of Parsers and Parsing Schemes
E Atwell, R Sutcliffe - Universities of Leeds and Limerick
Progress report on the GRACE evaluation program for French
Part-Of-Speech taggers
J Mariani, J Lecomte, P Paroubek, M Rajman, G Adda - CNRS
1:00-2:00 LUNCH
2:00-3:15 System Evaluation I: Spoken Dialogue Systems
A Generic Template to evaluate integrated components in spoken
dialogue systems
G Churcher, E Atwell, C Souter - University of Leeds
The DISC Project
N Bernsen - Odense University
Corpus-Based Test System for an Automated Speech Processing System
L Rothkrantz, R van Vark, H Koppelaar - Delft University
3:15-3:45 COFFEE
3:45-5:00 Component Evaluation I: New Metrics + Tools
Evaluation of word sense disambiguation programs: progress report
A Kilgariff - University of Brighton
Evaluation of discourse segmentation techniques and representations
J Crowe - Harlequin Ltd.
A method for prosody evaluation
G Sonntag - University of Bonn
5:00-6:00 Poster Session
6:00 Sherry Reception
7:00 Dinner
*** JUNE 18 ***
9:00-9:45 Steve Young, Cambridge
Speech Recognition Evaluation: a Review of the ARPA Programme
9:45-10:45 System Evaluation II: Text Processing Systems
Towards Small-Scale Evaluation of a Multilingual Information Retrieval
Systems for Multimedia Documents
K Krueger-Thielman - Universiataet Tuebingen
Proposal for a user centred evaluation regime for automatic
abstracting research
F Johnson - Manchester Metropolitan University
10:45-11:15 COFEEE
11:15-1:00 Component Evaluation II: New Metrics + Tools
Towards a Rating System for Speech Recognisers
S Cox, P Linford, W Hill, R Johnston - University of East Anglia
and BT
The MUC Coreference Annotation: Status and Plans
L Hirschman, P Robinson, J Burger, M Vilain
A probabilistic error metric for segmentation algorithms
D Beeferman - Carnegie Mellon University
NL Module Evaluation in GATE
R Gaizauskas, P Rodgers, H Cunningham - University of Sheffield
1:00-2:00 LUNCH
2:00-3:45 Perspectives on Evaluation:
The Big Picture: Evaluation of Products, Projects, Programmes
(SALT Evaluation and European Opportunities Mapping)
N Ostler, Linguacubun Ltd.
User-Centred Evaluation in Language Engineering
J Tait - University of Sunderland
Towards a standard reference system for Speech Technology evaluation
D Johnston - BT Laboratories
Evaluation in Verbmobil
U Jost - University of Hamburg
3:45-4:15 COFFEE
4:15-5:15 Panel Session: Directions in S+L Evaluation
5:30 Closing Remarks
*** Poster Session ***
RQA methodology: towards a qualitative evaluation of speech
understanding and spoken dialog systems.
J Y Antoine, J Zeliger, J Caelen - VALORIA, ICP and CLIPS
Subjective assessment methods for text-to-speech systems
P Arden - BT Laboratories
Tagging Email with 8 Tagsets: lessons on evaluation
E Atwell, G Demetriou, J Hughes, M Schiffrin, C Souter, S Wilcox -
University of Leeds
A Tool for Qualitative Analysis of MUC-6 Performance
P Callaghan - University of Durham
A extendible specification and validation method for formal dialogue
validation
A Coillault - Universite Blaise Pascal
Evaluating the Pronunciation Component of a Text-to-Speech System
R I Damper, K. Gustafson - University of Southampton, KTH Sweden
An annotated Reference Corpus as Diagnostic Evaluation Tool
T Declerck and J Klein - DFKI
Usability Evaluation of Speech Technology Applications
C Delogu - Fondazione Ugo Bordoni
Measuring the Uncertainty in Grammatical Classification
G Demetriou, E Atwell, C Souter - University of Leeds
Evaluation with entropy indicators
C Lyon - University of Hertfordshire
DiET : Diagnostic and Evaluation Tools for Natural Language
Applications
DFKI, Aerospatiale, IBM Germany, ISSCO, LRC, SRI International
Evaluation of Translation Tools in Software Localisation
A Rinsche - The Language Technology Centre Ltd.
A Concatenation Framework for Text-to-Speech Synthesis using CVC
Syllables
R Sahandi, D Vine - Bournemouth University
Usability evaluation of speech based sevices: The user perspective
C K Sidhu - BT Laboratories
-------------------------------- Message 2 -------------------------------
Date: Fri, 23 May 1997 17:58:20 -0300
From: Abdellatif.Saoudi at irin.univ-nantes.fr (Abdellatif Saoudi)
Subject: RIAO97 : CALL FOR PARTICIPATION
"Apologies if you receive this call more than once"
- ------------------------------------------------------------------
Call For Participation
RIAO'97 CONFERENCE
Computer-Assisted Searching on the Internet
June 25-27, 1997
McGill University, Montreal, Quebec, Canada
http://www.sciences.univ-nantes.fr/RIAO97 [note: RIAO in CAPS]
Brief Description :
- -------------------
Every three years the Centre de Hautes Etudes Internationales
d'Information Documentaire (CID) of Paris, France, along with various
international affiliates, organizes an RIAO conference (RIAO is the
French acronym for Computer-Assisted Information Retrieval) under the
sponsorship of European Community (EC), Ministere des affaires
etrangeres, Ministere de l'industrie, Secretariat d'etat a la
recherche (France), Ministere de l'industrie, du commerce, de la
science et de la technologie (Quebec) and CRIM (Canada). RIAO97 will
be the fifth conference in the series. RIAO85 was held in Grenoble,
France; RIAO88 at MIT; RIAO91 in Barcelona; and RIAO94 at Rockefeller
University in New York.
RIAO conferences have the special feature of incorporating
both scientific papers and innovative product demonstrations. Both
the product demonstrations and the scientific papers (which are often
accompanied by prototype system demonstrations) are subject to a
rigorous selection process. The mix of scientific expertise and
state-of-the-art industrial development lends itself to a critical
examination of both aspects, stimulating both new product development,
ecnouraging sponsorship of start-ups, as well as initiating lines of
further, critical research investigations.
RIAO97 focuses on new problems in information retrieval,
filtering, and dissemination resulting from the recent profusion and
extensions of networks. In particular, RIAO97 brings together search
specialists and web-based media specialists to consider how searching
can best be accomplished in the context of the proliferation of web
sites, content formats, browsing modalities, amount of data
accessible, and number of user accesses.
------------------------------------------
FINAL PROGRAM AND SCHEDULE
GENERAL SESSION
June 25, 1997
------------------------------------------
9:00-9:15 a.m WELCOMING STATEMENT
Prof. P.R. Belanger
Vice Principal, Research
McGill University, Canada
9:15-9:30 a.m RIAO97' Introduction
J. Thuiller
Professor at the College de France
President of the C.I.D.
9:30-10:00 a.m Invited Speaker
GILS Projet
N. Brodie
National Library of Canada, Ottawa, Canada
---------------------------------
SESSION 1: INFORMATION DISCOVERY
---------------------------------
Chairman: L. Devroye, McGill University
10:00-10:25 a.m "The Do-I-Care Agent: Effective Social Discovery and
Filtering on the Web"
M.S. Ackerman, B. Starr, M. Pazzani
University of California, USA
10:25-10:50 a.m "Mining Information In Order To Extract Hidden And
Strategical Information"
T.Dkaki, B. Dousset, J. Mothe
Universite P. Sabatier, Toulouse, France
10:50-11:20 a.m Break and Demonstrations
----------------------------------------------------------
SESSION 2: VISUALISATION TOOLS FOR INFORMATION NAVIGATION
----------------------------------------------------------
Chairman: S. Tohme, ENST France
11:20-11:45 a.m "Design Issues for World Wide Web Navigation
Visualisation Tools"
A. Cockburn, S. Jones
University of Canterbury, University of Waikato, New
Zealand
11:45-12:10 a.m "Footprints: History-Rich Web Browsing"
A. Wexelblat, P. Maes
Media Lab, Massachusetts Institute of Technology, USA
12:10-12:35 p.m "Using terminological base for Term-based information
retrieval"
J-Y Nie, Universite de Montreal, Canada
12:35-2:05 p.m LUNCH
------------------------------------------------
SESSION 3: AUTOMATIC ABSTRACTING, REPOSITORIES
------------------------------------------------
Chairman: G. Grefenstette, Rank Xerox Research Centre
2:05-2:30 p.m "Development of a Document Summarization System for
Effective Information Services"
D. H. Jang, S. H. Myaeng
Chungnam National University, Taejon, Korea
2:30-2:55 p.m "Automatic summarization on the Web? RAFI: A system for
summarizing using indicating fragments"
A. Lehmam, Universite de Nancy II, France
2:55-3:20 p.m "Towards Sophisticated Wrapping of Web-based Information
Repositories"
B. Chidlovskii, U. M. Borghoff, P.Y. Chevalier
Rank Xerox Research Centre, France
3:20-3:45 p.m "Annotating the World Wide Web using Natural Language"
B. Katz, Massachussetts Institute of Technology, USA
3:45-4:15 p.m Break and Demonstrations
---------------------------------------------------------
SESSION 4: LINGUISTIC APPROACH FOR INFORMATION RETRIEVAL
---------------------------------------------------------
Chairman: R. Cencioni, European Community
4:15-4:40 p.m "IRENA: Information Retrieval Engine based on Natural
Language Analysis"
A.T. Arampatzis ,T. Tsoris, C.H.A. Koster.
Patras, Greece and Netherlands
4:40-5:05 p.m "The Effect of Syntactic Phrase Indexing on Retrieval
Performance for Dutch Texts"
R. Pohlmann , W. Kraaij
Utrecht University, TNO-TPD, Netherlands
5:05-5:30 p.m "Using Simulated Annealing to Understand Natural
Language Texts"
S.A. Laribi, G. Desrocques, A. Laribi, J.C. Bassano
Universite d'Orleans, France. Geneva Univeristy,
Switzerland
5:30-5:55 p.m "An Analysis of Statistical and Syntactic Phrases"
M. Mitra, C. Buckley, A. Singhal, C. Cardie
Cornell University, USA
-----------------------------------
June 26, 1997
SESSION 5: MULTILINGUAL APPROACH
----------------------------------
Chairman: C. Fluhr, Commissariat a l'Energie Atomique. France
9:00-9:25 a.m "Multi-Language Text Indexing for Internet Retrieval"
M.Wechsler, P. Sheridan, P. Schauble
Swiss Federal Institute of Technology, Zurich,
Switzerland
9:25-9:50 a.m "Adaptative Filtering of Multilingual Document Streams"
D.W. Oard, University of Maryland, USA
9:50-10:15 a.m "A domain Specific Lexicon Acquisition Tool for
Cross-Language Information Retrieval"
D. Hiemstra, F. de Jong, W. Kraaij
CTIT, Twente University, Netherlands
10:15-10:45 a.m Break and Demonstrations
----------------------------
SESSION 6: IRS ARCHITECTURE
----------------------------
Chairman: R. Marcus, Massachusetts Institute of Technology (USA)
10:45-11:10 a.m "EAGLE: An Extensible Architecture for General
Linguistic Engineering"
B. Baldwin , C. Doran, J.C. Reynar
11:10-11:35 a.m "Information Retrieval On The Word Wide Web using a
Decision Making System"
F. Corvaisier, A. Mille, J.M. Pinon, INSA, Lyon,
France
11:35-12:00 a.m "A Multiagent Architecture for Information Retrieval
on the World-Wide Web"
V.N. Gudivada, S.P. Tolety
Wayne State University, University of Missouri. USA
12:00-1:30 p.m LUNCH
---------------------------------
SESSION 7: INFORMATION EXTRACTION
---------------------------------
Chairman: C. Jacquemin, Universite de Nantes. France
1:30-2:45 p.m Panel
TREC in Many Languages
* TREC-5: English
D. Harman
National Institute of Standards and Technology, USA
* TREC-5: Spanish and Chinese
A. Smeaton
Dublin City University, Ireland
*The Amaryllis Project
C. Fluhr
Commissariat a l'Energie Atomique (CEA), France
2:45-3:10 p.m "Integrated text categorisation and information
extraction using pattern matching and linguistic
processing"
W. J. Black, L. Gilardoni, F. Rinaldi, R Dressel
UMIST, UK. Quinary Spa, Italy
3:10-3:35 p.m "On-Line Resource Discovery using Natural Language"
O.R. Zaine , A. Fall, S. Rochefort, V. Dahl, P. Tarau
Simon Fraser University, Canada
3:35-4:00 p.m "Coupling information retrieval and information
extraction: A new text technology for gathering
information from the web"
R. Gaizauskas, A.M. Robertson
University of Sheffield, UK
4:00-4:30 p.m Break and Demonstrations
----------------------------------------
SESSION 8: DOCUMENT / RELEVANCE RANKING
----------------------------------------
Chairman: D.J. Harman, National Institute of Standards and Technology, USA.
4:30-4:55 p.m "Summarizing Similarities and differences Among
Related Documents"
I. Mani , E. Bloedorn
The MITRE Corporation, USA
4:55-5:20 p.m "Relevance Ranking for One to Three Term Queries"
C.L.A. Clarke , G.V. Cormack, E.A. Tudhope
University of Toronto. Canada
5:20-5:45 p.m "Space Optimizations for Total Ranking"
D.R. Cutting, J.O. Pedersen
Excite Inc., USA
5:45-6:10 p.m "A Similarity-Based Agent for Internet Searching"
T.G. Rose, P. J. Wyard, Canon, UK
-------------------------------
June 27, 1997
SESSION 9: IRS ARCHITECTURE- II
-------------------------------
Chairman: U. Heid, Stuttgart University, Germany
9:00-9:25 a.m "ARACHNID: Adaptive Retrieval Agents Choosing
Heuristic Neighborhoods for Information Discovery"
F. Menczer , R.K. Belew
University of California, USA
9:25-9:50 a.m "Cobra: A new approach to IR System design"
T. Mills, K. Moody, K. Rodden
University of Cambridge Computer Laboratory. UK
9:50-10:15 a.m "Interactive Image Retrieval by Means of Abductive
Inference"
A. Muller, A. Everts
GMD. Germany
10:15-10:45 a.m Break and Demonstrations
---------------------------------
SESSION 10: QUERY REFORMULATION
---------------------------------
Chairman: J.C. Bassano, Universite d'Orleans France.
10:45-11:10 a.m "Query modification based on relevance
backpropagation"
M. Boughanem, C. Soule-Dupuy
MSI, Universite de Limoges, France
11:10-11:35 a.m "Query ReFormulation on the Internet: Empirical Data
and the Hyperindex Search Engine"
P.D. Bruza , S. Dennis
Queensland University of Technology, Australia
11:35-12:00 a.m SQLET: Short Query Linguistic Expansion Techniques:
Palliating One or Two-word Queries by Providing
Intermediate Structure to WWW Pages
G. Grefenstette
Rank Xerox Research Centre, Grenoble, France
12:00-1:30 p.m LUNCH
---------------------------------
SESSION 11: INFORMATION FILTERING
---------------------------------
Chairman: V. Semenova, ANALIT, Moscow
1:30-1:55 p.m "Probabilistic Learning for Information Filtering"
G. Amati , F. Crestani, F. Ubaldini, S. de Nardis
Fondazione Ugo Bordoni, Universita di Padova,
Universita di Roma, Italy
1:55-2:20 p.m "Using Syntactic Information in Document Filtering:
A Comparative Study of Part-of-speech Tagging and
Supertagging"
R. Chandrasekar , B. Srinivas
University of Pennsylvania, USA
2:20-2:45 p.m "Querying Hierarchical Text and Acyclic Hypertext with
Generalized Context-Free Grammars"
Y. Marcoux, M. Sevigny
Universite de Montreal, Canada
2:45-3:15 p.m Break and Demonstrations
-------------------------------------
SESSION 12: INFORMATION EXTRACTION II
-------------------------------------
Chairman: J.P. Haton, Universite Henri-Poincare, Nancy I, France
3:15-3:40 p.m "A probabilistic model of Passage Categorization"
M. Iwayama, T. Tokunaga
Advanced Research Laboratory, Japan
3:40-4:05 p.m "Knowledge Discovery From Natural Language Texts"
U. Hahn, K. Schnattinger
Freiburg University, Germany
4:05-4:30 p.m "Extraction of Index Words from Manuals"
H. Nakagawa
Yokohama National University, Japan
--------------------------------
SESSION 13: JUDICIAL PROBLEMS
--------------------------------
Chairman: J. Perriere, C.I.D. France
4:30-4:55 p.m "Limits of Using Data"
Maitre Feral-Schuhl
Ordre Des Avocats du Barreau de Paris, France.
4:55-5:20 p.m "Data Security"
Maitre G. Arendt
President of Computer Commission of the International
Union of Lawyers, Luxemburg
5:20-5:45 p.m "Security Concerns On The Intranet"
Maitre Landry
Montreal, Canada.
Union Internationale des Avocats.
5:45-6:15 p.m Conclusions
- ---------
For more information, please see our web page:
http://www.sciences.univ-nantes.fr/RIAO97/
- ---------
---------------------------------------------------------------------------
LINGUIST List: Vol-8-784
More information about the LINGUIST
mailing list