Okay, so Nick does not like promoing threads he starts, but having used a CMS that I liked but didn't spider worth a darn, I found this list of CMS scripts that will spider well very useful.