Unblocked some bots

Post by **Red Squirrel** » Sun Sep 18, 2005 10:50 pm

I unblocked some bots including slurp (which eats up TONS of bandwidth) so if you see more guests it's most likely bots. I'll give them a couple of weeks to crawl new data for search engines and if I notice any rediculously eating bandwidth I'll block them again.

Archived topic from Iceteks, old topic ID:3714, old post ID:30148

richardj · Post by **richardj** » Mon Sep 19, 2005 1:36 am

What do they do?

WHy do I feel afraid??

Archived topic from Iceteks, old topic ID:3714, old post ID:30150

Post by **Red Squirrel** » Mon Sep 19, 2005 10:25 am

Nah they just crawl the site and index the content for searching. But some bots like Yahoo's slurp eat up tons of bandwidth so I had them blocked.

Archived topic from Iceteks, old topic ID:3714, old post ID:30155