본문 바로가기
KERD
논문KCI 등재

The advantages and challenges of “big data”: Insights from the 14 billion word iWeb corpus

0

조회

0

다운로드

4

인용

0

참고문헌

키워드

주제분류언어학

초록

The iWeb corpus contains nearly 14 billion words from 22 million web pages, and it has been designed in a way that allows users to quickly and easily create “Virtual Corpora”, in order to focus on websites that are related to their areas of interest. The data from this very large corpus provides very detailed information on syntactic, morphological, lexical, and semantic phenomena, in ways that would never be possible with a small 100 million or 500 million word corpus. In addition, the corpus provides a number of features that are not available with other large corpora, such as the ability to perform advanced searches of the top 60,000 words in the corpus, and to see a wealth of information on each of these words – definitions, links to images and audio, translations, detailed frequency information, related topics, collocates, word clusters, re-sortable concordance lines, and much more. Finally, we discuss the challenges of large corpora, and how the corpus architecture that is used for iWeb has uniquely been designed to address these challenges.

Abstract

The iWeb corpus contains nearly 14 billion words from 22 million web pages, and it has been designed in a way that allows users to quickly and easily create “Virtual Corpora”, in order to focus on websites that are related to their areas of interest. The data from this very large corpus provides very detailed information on syntactic, morphological, lexical, and semantic phenomena, in ways that would never be possible with a small 100 million or 500 million word corpus. In addition, the corpus provides a number of features that are not available with other large corpora, such as the ability to perform advanced searches of the top 60,000 words in the corpus, and to see a wealth of information on each of these words – definitions, links to images and audio, translations, detailed frequency information, related topics, collocates, word clusters, re-sortable concordance lines, and much more. Finally, we discuss the challenges of large corpora, and how the corpus architecture that is used for iWeb has uniquely been designed to address these challenges.

참고문헌 (13)

  1. Barbieri, Federica, "Quotative 'be like' in American English: Ephemeral or here to stay?", English World-Wide, 30, pp.68~90 (2009)
  2. Buchstaller, Isabelle, "Localized globalization: A multi-local, multivariate investigation of quotative 'be like'", Journal of Sociolinguistics, 13, pp.291~331 (2009)
  3. Davies, Mark, "Historical shifts with the into-causative construction in American English", Linguistics, 57, pp.29~58 (2019)
  4. Goldberg, Adele, "Grammatical constructions: Their form and meaning", pp.29~53 (1997), Clarendon Press
  5. Israel, Michael, "Conceptual structure, discourse and language", pp.217~230 (1996), CSLI
  6. Kim, Jong-Bok, "The into-causative construction in English: A construction-based perspective", English Language and Linguistics, 20, pp.55~83 (2016)
  7. Mair, Christian, "Three changing patterns of verb complementation in late modern English: A real-time study based on matching text corpora", English Language and Linguistics, 6, pp.106~131 (2002)
  8. Rohdenburg, Gunter, "Functional constraints in syntactic change: The rise and fall of prepositional constructions in early and late modern English", English Studies, 88, pp.217~233 (2007)
  9. Rudanko, Juhani, "Corpora and complementation: Tracing sentential complementation patterns of nouns, adjectives, and verbs over the last three centuries" (2000), University Press of America
  10. Rudanko, Juhani, "The Oxford Handbook of the History of English", pp.222~232 (2012), Oxford University Press
  11. Stange, Ulrike, "You’re so not going to believe this: The use of genx so in constructions with future going to in American English", American Speech, 92, pp.487~524 (2017)
  12. Tagliamonte, Sali, "He's like, she's like: The quotative system in Canadian Youth", Journal of Sociolinguistics, 8, pp.493~514 (2004)
  13. Vosberg, Uwe, "Insights into Late Modern English", pp.197~220 (2003), Peter Lang

관련 논문AI추천

이 간행물의 다른 논문 (7건)