6.243 Multimodal references

Sat Feb 18 17:24:41 UTC 1995

----------------------------------------------------------------------
LINGUIST List:  Vol-6-243. Sat 18 Feb 1995. ISSN: 1068-4875. Lines: 142

Subject: 6.243 Multimodal references

Moderators: Anthony Rodrigues Aristar: Texas A&M U. <aristar at tam2000.tamu.edu>
            Helen Dry: Eastern Michigan U. <hdry at emunix.emich.edu>

Asst. Editors: Ron Reck <rreck at emunix.emich.edu>
               Ann Dizdar <dizdar at tam2000.tamu.edu>
               Ljuba Veselinova <lveselin at emunix.emich.edu>

-------------------------Directory-------------------------------------

1)
Date: Tue, 14 Feb 1995 09:16:20 -0500
From: "William J. Rapaport" (rapaport at cs.Buffalo.EDU)
Subject: Re: 6.217 Sum: Multimodal references

-------------------------Messages--------------------------------------
1)
Date: Tue, 14 Feb 1995 09:16:20 -0500
From: "William J. Rapaport" (rapaport at cs.Buffalo.EDU)
Subject: Re: 6.217 Sum: Multimodal references

Some more references on multimodal references:

1.  There's Rohini Srihari's PICTION project:

        On the Web, see URL:

                http://www.cedar.buffalo.edu/Piction/

        Also see:

Govindaraju, Venu; Sher, David B.;
Srihari, Rohini K.; & Srihari, Sargur N. (1989),
``Locating Human Faces in Newspaper Photographs,''
_Proceedings of CVPR_: 549--554.

Govindaraju, Venu, & Srihari, Rohini K. (1990),
``Recognizing Faces in a News Photo Database,'' _Advanced Imaging_ 5: 22--26.

Srihari, Rohini K. (1991a),
``PICTION: A System that Uses Captions to Label Human Faces in Newspaper
Photographs,''
_Proceedings of the 9th National Conference on
Artificial Intelligence (AAAI-91, Anaheim)_ (AAAI Press): 80--85.

Rohini K. Srihari (1991b), ``Extracting Visual Information from Text:  Using
Captions to Label Faces in Newspaper Photographs,''
_Technical Report 91-17 (Buffalo:  SUNY Buffalo Department of Computer Science_.

Srihari, Rohini K. (1993a),
``Intelligent Document Understanding: Understanding Photos with Captions,''
_Proceedings of the International Conference on
Document Analysis and Recognition (ICDAR-93, Tsukuba City, Japan)_,

Srihari, Rohini K. (1993b),
``Use of Collateral Text in Understanding Photos in Documents,''
_Proceedings of the Conference on
Applied Imagery and Pattern Recognition (AIPR/SPIE, Washington, DC)_,

Srihari, Rohini K., & Rapaport, William J. (1989),
``Extracting Visual Information From Text:  Using Captions to Label
Human Faces in Newspaper Photographs,''
_Proceedings of the 11th Annual Conference of the Cognitive Science Society
(Ann Arbor, MI)_ (Hillsdale, NJ:  Lawrence Erlbaum Associates): 364-371.

Srihari, Rohini K., & Rapaport, William J. (1990),
``Combining Linguistic and Pictorial Information:  Using Captions to
Interpret Newspaper Photographs,'' in D. Kumar (ed.),
_Current Trends in SNePS--Semantic Network Processing System_,
_Lecture Notes in Artificial Intelligence, No. 437_
(Berlin:  Springer-Verlag): 85-96.

2.  On Multimodal interfaces, see:

AUTHOR = "Neal, J. G. and Bettinger, K. E. and Byoun, J. S.
                  and Dobes, Z. and Thielman, C. Y.",
        YEAR = 1988,
        TITLE = " An Intelligent Multi-Media Human-Computer Dialogue System",
        BOOKTITLE = "Proceedings of the Workshop on Space,
                     Operations, Automation, and Robotics, (SOAR88)",
        PUBLISHER = "Wright State University, Dayton, OH"

AUTHOR = "Neal, J. G. and Dobes, Z. and Bettinger, K. E.
                  and Byoun, J. S.",
        YEAR = 1988,
        TITLE = "Media-Modual References in Human-Computer Dialogue",
        BOOKTITLE = "Proceedings of the Seventh National Conference of
                     the American Association for Artificial Intelligence",
        PUBLISHER = "Morgan Kaufmann",
        PAGES = "819-823"

AUTHOR = "Neal, J. G. and Thielman, C. Y. and Funke, D. J.
                  and Byoun, J. S.",
        YEAR = 1989,
        TITLE = "Multi-Modal Output Composition for Human-Computer Dialogues",
        BOOKTITLE = "Proceedings of the 1989 IEEE AI Systems
                     in Government Conference",
        ADDRESS = "George Washington Univ., Wash. D.C.",
        PUBLISHER = "IEEE",
        PAGES = "250-257"      }

AUTHOR = "Neal, J. G. and Thielman, C. Y. and Dobes, Z.
                  and Haller, S. M. and Shapiro, S. C.",
        YEAR = 1989,
        TITLE = "Natural Language with Integrated Deictic
                 and Graphic Gestures",
        BOOKTITLE = "Proceedings of the DARPA Speech
                     and Natural Language Workshop",
        PUBLISHER = "Morgan Kaufmann",

AUTHOR = "Neal, J. G. and Thielman, C. Y. and Dobes, Z. and
                  Haller, S. M. and Glanowski, S. and Shapiro, S. C.",
        YEAR = 1989,
        TITLE = "{CUBRICON}: A Multi-Modal User Interface.
                {P}resented at the {GIS/LIS} '89 {C}onference",
        ADDRESS = "Orlando, Florida",

AUTHOR = "Jeannette G. Neal and Stuart C. Shapiro",
        YEAR = 1991,
        TITLE = "Intelligent Multi-Media Interface Technology",
        BOOKTITLE = "Intelligent User Interfaces",
        EDITOR = "Joseph W. Sullivan and Sherman W. Tyler",
        PUBLISHER = "Addison Wesley",
        ADDRESS = "Reading, MA",
        PAGES = "11-43"}

 =========================================================================
                        William J. Rapaport
                        Associate Professor of Computer Science
                        Adjunct Professor of Philosophy
                        and Center for Cognitive Science

226 Bell Hall                  | phone:  (716) 645-3180 x 112
Department of Computer Science | fax:    (716) 645-3464
SUNY Buffalo                   | email:  rapaport at cs.buffalo.edu
Buffalo, NY 14260              | web:    http://www.cs.buffalo.edu

--------------------------------------------------------------------------
LINGUIST List: Vol-6-243.