Flooding or Crawling type of attack - non-RN site.

registered · Posted: Fri Nov 20, 2009 2:00 pm

Hello Everyone, this was on one of my non-RN sites. Any idea or suggestions anyone? I had this message from my hosting company:

"This account has been suspended as it took the whole server down with very high loads."

It appears the site was under attack with some type of flooding or crawling. They were all showing different IP's yet all my last log entries were similar to this except the IP number:

Quote:

Host: 24.151.205.76

*
/index.php/accordion-a/about-huatulco/about-merida/images/destinationwedding/weddings/Palace_Resorts_Brides_Ma
Http Code: 404 Date: Nov 20 13:03:53 Http Version: HTTP/1.1 Size in Bytes: -
Referer: -
Agent: Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620

*

/index.php/accordion-a/about-mexico/yucatan-mayan-tours/about-merida/about-colonial-tours/classical-colonial-t
Http Code: 404 Date: Nov 20 13:03:54 Http Version: HTTP/1.1 Size in Bytes: -
Referer: -
Agent: Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620

*

/index.php/accordion-a/about-huatulco/images/yootheme/yoogallery/images/yootheme/yoogallery/yootheme/mexico.ht
Http Code: 404 Date: Nov 20 13:04:00 Http Version: HTTP/1.1 Size in Bytes: -
Referer: -
Agent: Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620

*

/index.php/accordion-a/about-ixtapa-zihuatanejo/images/yootheme/yoogallery/about-riviera-nayarit/about-mexico/
Http Code: 404 Date: Nov 20 13:04:08 Http Version: HTTP/1.1 Size in Bytes: -
Referer: -
Agent: Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620

*

/index.php/accordion-a/about-los-cabos/images/yootheme/yoogallery/about-cancun/about-mexico.html
Http Code: 404 Date: Nov 20 13:04:18 Http Version: HTTP/1.1 Size in Bytes: -
Referer: -
Agent: Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620

Thanks in advance!
jc

registered · Posted: Sat Nov 21, 2009 6:50 am

80legs.com is a spider. Their service is supposed to follow robots.txt. Here is a link that should help.
http://80legs.pbworks.com/FAQ#Howdoes80legscrawlwebpages

Scroll al the way to the bottom and it will give you a contact link and the code to block them in robots.txt.