Google SiteMaps Cripples Web Server

Source Title:
Google Sitemap Horror
Story Text:

If you were thinking of running Google's recently launched SiteMaps utility, you might want to think twice. Theodore Smith apparently ran Google's python script, and totaled his server. The post itself shows some worrying system stats before and after the python script was started...


Much safer to write your own

Much safer to write your own scripts which dynamically spit out the live XML / urllist.

Shri I was thinking the same

Shri I was thinking the same thing. Have something you can run offline and point anywhere you choose, no need for it to be on the same box.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.