Search Engine Spiders


I’ve been conducting some experiments with search engines, spiders and getting indexed. The tests were conducted on three new domains that didn’t exist until 3 days before.

  • The only inbound links were comments from popular heavily traffic blogs.

  • I made 3 comments on 3 different blogs for 3 different domains.
  • For each of the domains Google was the first to spider the pages, followed by Yahoo.
  • MSN has only visited two out of the three domains.
  • Google listed one of the domains first, Yahoo the other.
  • Google and Yahoo have listed two of the domains MSN still hasn’t listed any.
  • Google and Yahoo have a single line listing no page text and no cached version is stored.
  • No internal pages have been spidered.

In a previous experiment using popular blog directories only, it took 7 days to get listed. However listing was more comprehensive as it was in all three major engines.

If you’re curious that’s a King Baboon Tarantula.

tags: ( | | | | | search engine spiders )

tla starter kit

Related posts:

  1. Redirect Single Page for Search Engine Query So if anyone reading this is an htaccess expert and...
  2. The Lisa – Search Engine Conference Clothing from Lisa Barone Are you tired of wearing the some old dud’s to...
  3. Search Engine Glossary Review SO I was asked to take a look at Aaron...
  4. What Search Engine Conferences Should I Attend One of the questions I get asked frequently is “which...
  5. Does W3C compliance and accessibility impact your Search Engine Optimization Douglas Karr sent me a question that I get asked...

Advertisers:

  1. Text Link Ads - New customers can get $100 in free text links.
  2. BOTW.org - Get a premier listing in the internet's oldest directory.
  3. Ezilon.com Regional Directory - Check to see if your website is listed!
  4. Need an SEO Audit for your website, look at my SEO Consulting Services
  5. Directory Journal - Get permanent deep links in a search engine friendly directory
  6. LinkWheel SEO - Get Web 2.0 Backlinks
  7. TigerTech - Great Web Hosting service at a great price.
  8. Article-Writing-services.org - Article Writing Services creates quality content for websites and blogs at no cost to site owners.
  9. Link Building Services - Hire WeBuildLink.com for well-planned advanced link building campaigns. Very affordable. Contact us now for a FREE evaluation.
  10. Join 500+ top agencies & publishers who rely on The HOTH every day. US based, enterprise-grade support. High quality, contextually relevant links. 100% money back guarantee. Try it now.
  11. Professional website designs - Get a unique brand image with website designs that sets you apart and convert your visitors into customers. Make a brand, not just a website

See my disclaimer about advertising and affiliate links