Comments on: Google Sitemaps for Large Scale Sites http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/ Michael Gray rants on SEO the internet and media Sun, 25 Oct 2009 18:58:50 -0500 http://wordpress.org/?v=2.8.6 hourly 1 By: Mad http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-54556 Mad Fri, 09 Mar 2007 15:11:26 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-54556 How do you get a sitemap size of ower 40mb, that's crazy. Then you have only duplicates of the links. How do you get a sitemap size of ower 40mb, that’s crazy. Then you have only duplicates of the links.

]]> By: Janusz http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-49481 Janusz Thu, 15 Feb 2007 08:41:36 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-49481 I use the apckage from: http://www.xml-sitemaps.com/ and works fine. I produce sitemaps of 40Mb+ each week. It would be larger but all the permutations of pages on my site go into millions so asked the software to hold it at a level (4 links deep) of 4 i.e. http://www.site.com/1/2/3/4/ I use the apckage from: http://www.xml-sitemaps.com/ and works fine. I produce sitemaps of 40Mb+ each week.

It would be larger but all the permutations of pages on my site go into millions so asked the software to hold it at a level (4 links deep) of 4 i.e. http://www.site.com/1/2/3/4/

]]> By: AhmedF http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-15902 AhmedF Wed, 25 Oct 2006 19:56:19 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-15902 You just need to create a sitemap index that then 'links' to all your other sitemaps. The other sitemaps can then be broken down by id (eg sitemap_1.xml is id 1 to 25000, sitemap_2.xml is 25001 to 50000, etc), by category (blue.xml, red.xml, etc). You just need to create a sitemap index that then ‘links’ to all your other sitemaps. The other sitemaps can then be broken down by id (eg sitemap_1.xml is id 1 to 25000, sitemap_2.xml is 25001 to 50000, etc), by category (blue.xml, red.xml, etc).

]]> By: SeoRookie http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-14793 SeoRookie Wed, 18 Oct 2006 13:25:14 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-14793 I was going to email you off line but.. I crawl the site with Xenu. Sometimes I will crawl the actual site and other time I will crawl it on my local server. I then export to a tab file. You can use Excel along with some clever find/replaces and cell split/merges to come up with a sitemap. Remember you're only interested in Type=text/html I also have an Excel spreadsheet with a Macro to automate the entire process. I found it at DP. I was going to email you off line but..
I crawl the site with Xenu. Sometimes I will crawl the actual site and other time I will crawl it on my local server.

I then export to a tab file. You can use Excel along with some clever find/replaces and cell split/merges to come up with a sitemap. Remember you’re only interested in Type=text/html

I also have an Excel spreadsheet with a Macro to automate the entire process. I found it at DP.

]]> By: Paul http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-14719 Paul Wed, 18 Oct 2006 00:45:28 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-14719 I would be very interested in how people do this. I have a few big non-wordpress sites for which I would like to create a sitemap. I would be very interested in how people do this. I have a few big non-wordpress sites for which I would like to create a sitemap.

]]> By: Michael Gray http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-14664 Michael Gray Tue, 17 Oct 2006 17:08:01 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-14664 It's a non wordpress site that grows somewhat frequently. I'm really leaning toward creating a small bunch of mini-sitemaps just so I can keep it manageable. It’s a non wordpress site that grows somewhat frequently. I’m really leaning toward creating a small bunch of mini-sitemaps just so I can keep it manageable.

]]> By: tony rocks http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/comment-page-1/#comment-14640 tony rocks Tue, 17 Oct 2006 16:20:50 +0000 http://www.wolf-howl.com/ideas/google-sitemaps-for-large-scale-sites/#comment-14640 I don't but Mike, I've gotta ask you...what's better, using the Sitemap plugin for Wordpress or using GSite Crawler and manually submitting the sitemaps? I don’t but Mike, I’ve gotta ask you…what’s better, using the Sitemap plugin for Wordpress or using GSite Crawler and manually submitting the sitemaps?

]]>