[Corpora-List] (New book) Sch=?iso-8859-1?Q?=E4fer_?=and Bildhauer: Web Corpus Construction

[Graeme Hirst]

BOOK ANNOUNCEMENT

Web Corpus Construction

by Roland Schäfer and Felix Bildhauer 
(Freie Universität Berlin, Germany)

Synthesis Lectures on Human Language Technologies #22 (Morgan &
Claypool Publishers), 2013, 145 pages

ABSTRACT:

The World Wide Web constitutes the largest existing source of texts
written in a great variety of languages. A feasible and sound way of
exploiting this data for linguistic research is to compile a static
corpus for a given language. There are several adavantages of this
approach: (i) Working with such corpora obviates the problems 
encountered when using Internet search engines in quantitative
linguistic research (such as non-transparent ranking algorithms).
(ii) Creating a corpus from web data is virtually free. (iii) The
size of corpora compiled from the WWW may exceed by several orders of
magnitudes the size of language resources offered elsewhere. (iv) The
data is locally available to the user, and it can be linguistically
post-processed and queried with the tools preferred by her/him. This
book addresses the main practical tasks in the creation of web
corpora up to giga-token size. Among these tasks are the sampling
process (i.e., web crawling) and the usual cleanups including 
boilerplate removal and removal of duplicated content. Linguistic
processing and problems with linguistic processing coming from the
different kinds of noise in web corpora are also covered. Finally,
the authors show how web corpora can be evaluated and compared to
other corpora (such as traditionally compiled corpora).

For additional material please visit the companion website:
sites.morganclaypool.com/wcc

Table of Contents: Preface / Acknowledgments / Web Corpora / Data
Collection / Post-Processing / Linguistic Processing / Corpus 
Evaluation and Comparison / Bibliography / Authors' Biographies


http://dx.doi.org/10.2200/S00508ED1V01Y201305HLT022


This title is available online without charge to members of
institutions that have licensed the Synthesis Digital Library of
Engineering and Computer Science.  Members of licensing institutions
have unlimited access to download, save, and print the PDF without
restriction; use of the book as a course text is encouraged.  To find
out whether your institution is a subscriber, visit
<http://www.morganclaypool.com/page/licensed>, or just click on the
book's URL above from an institutional IP address and attempt to
download the PDF.  Others may purchase the book from this URL as a
PDF download for US$30 or in print for US$40.  Printed copies are
also available from Amazon and from booksellers worldwide at
approximately US$40 or local currency equivalent.


_______________________________________________
UNSUBSCRIBE from this page: http://mailman.uib.no/options/corpora
Corpora mailing list
Corpora at uib.no
http://mailman.uib.no/listinfo/corpora