Google SiteMaps Cripples Web Server
Source Title:
Google Sitemap Horror
Google Sitemap Horror
Source Url:
http://www.incendiary.ws/node/94
http://www.incendiary.ws/node/94
Story Text:
If you were thinking of running Google's recently launched SiteMaps utility, you might want to think twice. Theodore Smith apparently ran Google's python script, and totaled his server. The post itself shows some worrying system stats before and after the python script was started...
If you were thinking of running Google's recently launched SiteMaps utility, you might want to think twice. Theodore Smith apparently ran Google's python script, and totaled his server. The post itself shows some worrying system stats before and after the python script was started...
- Y! MyWeb

Much safer to write your own
Much safer to write your own scripts which dynamically spit out the live XML / urllist.
Shri I was thinking the same
Shri I was thinking the same thing. Have something you can run offline and point anywhere you choose, no need for it to be on the same box.