Search Engine Spiders

If you're new here, you may want to subscribe to my RSS feed. Read my top posts or learn more about Michael Gray. Want more frequent updates follow me on Twitter. Thanks for visiting!

I’ve been conducting some experiments with search engines, spiders and getting indexed. The tests were conducted on three new domains that didn’t exist until 3 days before.

• The only inbound links were comments from popular heavily traffic blogs.

• I made 3 comments on 3 different blogs for 3 different domains.
• For each of the domains Google was the first to spider the pages, followed by Yahoo.
• MSN has only visited two out of the three domains.
• Google listed one of the domains first, Yahoo the other.
• Google and Yahoo have listed two of the domains MSN still hasn’t listed any.
• Google and Yahoo have a single line listing no page text and no cached version is stored.
• No internal pages have been spidered.

In a previous experiment using popular blog directories only, it took 7 days to get listed. However listing was more comprehensive as it was in all three major engines.

If you’re curious that’s a King Baboon Tarantula.

tags: (search engine optimization | seo | google | yahoo | msn | search engine spiders )

Sphere It

Comments are closed.