Spider Squishing
Submitted by jim on Thu, 05/22/2003 - 10:45
Tags:
Listology gets a huge amount of traffic each day, mostly from automated search spiders that index this site. I just made a change that I hope will greatly curtail their abuse of my bandwidth. It shouldn't affect any of you, but if you suddenly find yourself unable to access any pages at Listology, please let me know! Of course, if you have that problem you probably won't see this message, but you should see a different message to similar effect.
Jim, I don't know what time you posted this front page message but I noticed that right after I read it (around 12:30pm EST) all of the pages are loading very slowly. I have no idea if the two are related or not but I thought I'd let you know.
Thanks for the heads-up! I can't imagine the two are related, so I'm thinking it's just a coincidental slowdown. Please let me know if it persists and is still occurring tomorrow.
Things seem fine now. I think it might have been an issue with my Internet connection at work. Sorry to alarm you! :-)