Search Engine Spiders

By Site Admin
In SEO  

Print Post Print Post Email Post Email Post    ADD TO STUMBLEUPON Sphinn It ADD TO DEL.ICIO.US  Tweet This

I’ve been conducting some experiments with search engines, spiders and getting indexed. The tests were conducted on three new domains that didn’t exist until 3 days before.

  • The only inbound links were comments from popular heavily traffic blogs.

  • I made 3 comments on 3 different blogs for 3 different domains.
  • For each of the domains Google was the first to spider the pages, followed by Yahoo.
  • MSN has only visited two out of the three domains.
  • Google listed one of the domains first, Yahoo the other.
  • Google and Yahoo have listed two of the domains MSN still hasn’t listed any.
  • Google and Yahoo have a single line listing no page text and no cached version is stored.
  • No internal pages have been spidered.

In a previous experiment using popular blog directories only, it took 7 days to get listed. However listing was more comprehensive as it was in all three major engines.

If you’re curious that’s a King Baboon Tarantula.

tags: ( | | | | | )

Related posts:

  1. How to Turn Off Personalized Search in Google Chrome With the impending arrival of Google OS I’ve been spending...
  2. How TED Helped Me Understand Personalized Search Long time readers here will know that I’m not a...
  3. How to Add Search Shortcuts to Google Chrome. Last week Danny Sullivan twittered he was looking for a...

Crazyegg Link Tracking

Comments on this entry are closed.