Posts tagged as:

crawling

How To Figure Out What Parts of Your Website Aren’t Being Crawled

September 10, 2008

When Google took away the supplemental index last year, they killed one of the key diagnostic tools in the SEO’s toolbox, the ability to identify which parts of a site were unimportant (and being infrequently crawled) in a search engines eyes. However with the use of some structured text and clever searches I’m going to [...]

Read the full article →