Web Corpus Construction

Nonfiction, Computers, Advanced Computing, Natural Language Processing
Cover of the book Web Corpus Construction by Roland Schäfer, Felix Bildhauer, Morgan & Claypool Publishers
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Roland Schäfer, Felix Bildhauer ISBN: 9781608459841
Publisher: Morgan & Claypool Publishers Publication: July 1, 2013
Imprint: Morgan & Claypool Publishers Language: English
Author: Roland Schäfer, Felix Bildhauer
ISBN: 9781608459841
Publisher: Morgan & Claypool Publishers
Publication: July 1, 2013
Imprint: Morgan & Claypool Publishers
Language: English
The World Wide Web constitutes the largest existing source of texts written in a great variety of languages. A feasible and sound way of exploiting this data for linguistic research is to compile a static corpus for a given language. There are several adavantages of this approach: (i) Working with such corpora obviates the problems encountered when using Internet search engines in quantitative linguistic research (such as non-transparent ranking algorithms). (ii) Creating a corpus from web data is virtually free. (iii) The size of corpora compiled from the WWW may exceed by several orders of magnitudes the size of language resources offered elsewhere. (iv) The data is locally available to the user, and it can be linguistically post-processed and queried with the tools preferred by her/him. This book addresses the main practical tasks in the creation of web corpora up to giga-token size. Among these tasks are the sampling process (i.e., web crawling) and the usual cleanups including boilerplate removal and removal of duplicated content. Linguistic processing and problems with linguistic processing coming from the different kinds of noise in web corpora are also covered. Finally, the authors show how web corpora can be evaluated and compared to other corpora (such as traditionally compiled corpora). For additional material please visit the companion website: sites.morganclaypool.com/wcc Table of Contents: Preface / Acknowledgments / Web Corpora / Data Collection / Post-Processing / Linguistic Processing / Corpus Evaluation and Comparison / Bibliography / Authors' Biographies
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
The World Wide Web constitutes the largest existing source of texts written in a great variety of languages. A feasible and sound way of exploiting this data for linguistic research is to compile a static corpus for a given language. There are several adavantages of this approach: (i) Working with such corpora obviates the problems encountered when using Internet search engines in quantitative linguistic research (such as non-transparent ranking algorithms). (ii) Creating a corpus from web data is virtually free. (iii) The size of corpora compiled from the WWW may exceed by several orders of magnitudes the size of language resources offered elsewhere. (iv) The data is locally available to the user, and it can be linguistically post-processed and queried with the tools preferred by her/him. This book addresses the main practical tasks in the creation of web corpora up to giga-token size. Among these tasks are the sampling process (i.e., web crawling) and the usual cleanups including boilerplate removal and removal of duplicated content. Linguistic processing and problems with linguistic processing coming from the different kinds of noise in web corpora are also covered. Finally, the authors show how web corpora can be evaluated and compared to other corpora (such as traditionally compiled corpora). For additional material please visit the companion website: sites.morganclaypool.com/wcc Table of Contents: Preface / Acknowledgments / Web Corpora / Data Collection / Post-Processing / Linguistic Processing / Corpus Evaluation and Comparison / Bibliography / Authors' Biographies

More books from Morgan & Claypool Publishers

Cover of the book Project Management for Engineering Design by Roland Schäfer, Felix Bildhauer
Cover of the book Relativity, Symmetry and the Structure of the Quantum Theory by Roland Schäfer, Felix Bildhauer
Cover of the book Neutron Stars, Black Holes, and Gravitational Waves by Roland Schäfer, Felix Bildhauer
Cover of the book Introduction to Logic by Roland Schäfer, Felix Bildhauer
Cover of the book An Introduction to the Formalism of Quantum Information with Continuous Variables by Roland Schäfer, Felix Bildhauer
Cover of the book Ada's Legacy by Roland Schäfer, Felix Bildhauer
Cover of the book Quantifying Measurement by Roland Schäfer, Felix Bildhauer
Cover of the book Crystal Engineering by Roland Schäfer, Felix Bildhauer
Cover of the book A Journey into Reciprocal Space by Roland Schäfer, Felix Bildhauer
Cover of the book Logic for Physicists by Roland Schäfer, Felix Bildhauer
Cover of the book Nonlinear Optics of Photonic Crystals and Meta-Materials by Roland Schäfer, Felix Bildhauer
Cover of the book Modern Analytical Electromagnetic Homogenization by Roland Schäfer, Felix Bildhauer
Cover of the book Extragalactic Astrophysics by Roland Schäfer, Felix Bildhauer
Cover of the book Advanced Tokamak Stability Theory by Roland Schäfer, Felix Bildhauer
Cover of the book The Butterfly in the Quantum World by Roland Schäfer, Felix Bildhauer
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy