The Crawlers Accellerate.
Maciej Ceglowski moved his blog spider results to BlogCensus.net. 479k weblogs crawled so far, and just starting to explore the LiveJournal universe. Dave Sifry's Technorati crawled 402k so far, and growing fast. A nice post by Andrew Anker extrapolated Technorati's coverage to 6 million blogs by year end. Off the cuff, there are at least 3 million active blogs, so I expect:
- Accellerating coverage growth until it ...
- Slows as their maps cover the territory, map growth matching blogosphere growth, followed by ...
- Bursts as new isolated or intranet clusters are discovered, and ...
- Huge spikes as nations come online and gateway blogs are discovered.
Questions:
- Do they agree on the technical definition of a weblog?
- Do they agree on what is an active weblog?
- On what percent of their sites do they overlap?
- Are there obstacles to crawling and recognizing non-western language weblogs and diaries?
<< Home