Web as Corpus
This site will ultimately move to a new provider. You will get faster, more dependable service at this temporary URL:
http://22.214.171.124/ . When testing is complete,
http://webascorpus.org will point to the new site.
- Web Corpus
- English-language corpora compiled from the Web in 2006 and 2007.
2007 still under development, currently 3,123,996 types and
518,129,710 tokens; target size at least 1,000,000,000 tokens; will be
tokens and 950,087 types; 1-6-grams; wildcard searchable; the original texts and URLs are no longer available
due to a hard drive failure.
- Search these Web Corpora
Web Concordancer details below; feedback welcome
alternate site if response slow
- Search the Web directly for concordances of words and phrases in 34 different languages.
The Web Concordancer service ceased functioning on 1 August 2012 when the Bing API was retired. I have not yet identified an alternative service
which meets all the requirements to replace Bing. I sincerely regret this inconvenience to all Web as Corpus users (and to me).
Register for notification when Web Concordancer service is restored
- This new release (last update: 24 May 2010)
adds support for selecting
which documents to include in the zipfile, preselection based on document
metrics, combining all textfiles into a single document for importing into kfNgram or a
concordancer, and conversion from UTF-8 into more widely-supported
encodings. If it does not work properly for your language, please let me know.
- Temporarily unavailable due to changes at Bing Count Matching Webpages
- Count how many hits Bing and Yahoo! report for a word or phrase, expressed
both as an absolute number and as number of matches per million webpages.
Multiple search terms can be entered and queried at the same time, and
numbers can be either formatted for easier reading or left unformatted
for copying and pasting into a spreadsheet or database.
As you can see by comparing results
from these two search engines, such counts must be interpreted with extreme
caution! Bing numbers per million pages are generally smaller
than those from Yahoo!, probably due to an over-optimistic estimate of the
total number of pages in Bing's database.
- Latest Changes
- Wiki detailing additions and tweaks to this site
- Web as Corpus Wiki
- Wiki with links to web as corpus events, sites and code
- Find Search Terms
- Search by wildcard in various databases for single-word English search terms (e.g. morphological variants) for pasting into the Advanced Query field
Ready-made frequency lists from the Web
Web Corpus 2006 – 100 or more HTML
- HTML version of list of 30,524 types occurring 100 or more times
in this corpus
Web Corpus 2006 – 100 or more TAB
- Tab-separated text version of list of 30,524 types occurring 100 or
Web Corpus 2006 – 10 or more TAB
- Tab-separated text version of list of 104,675 types occurring 10 or
Dutch & Afrikaans
Major Search Engines did not distinguish between Dutch and
Afrikaans: except for Google, they do not provide for searching only for pages in Afrikaans, and
searches for pages in Dutch usually return some pages in Afrikaans as well.
National domains (.nl, .be / .za) are only a rough guide to location.
International domains like .com, .net, .biz, .info etc. provide no clue to
the source. These lists were compiled to test various algorithms to
distinguish Afrikaans from Dutch pages.
Dutch Web Corpus 2006 –
- HTML version of list of 102,770 types occurring in a pilot corpus of
1,605,346 tokens (6.4 MB)
Afrikaans Web Corpus 2006 – 1-grams
- HTML version of list of 62,785 types occurring in a pilot corpus of
1,263,509 tokens (3.9 MB)
Some of my ancient papers in which there has been a renewed interest
'Blood-hot', 'stone-good': a preliminary report on adjective-specific intensifiers in Dutch
- Leuvense Bijdragen, 69 (1980), 445-472. (PDF, 12.6 MB)
launched 7 February 2007, updated 19 November 2012
Background: driftwood, Dares Beach, Maryland –