| Forum Home | ||||
| Press F1 | ||||
| Thread ID: 72120 | 2006-08-31 00:26:00 | Googlebot taking up 1.8Gb Bw and other searchbot queries | Morgenmuffel (187) | Press F1 |
| Post ID | Timestamp | Content | User | ||
| 481552 | 2006-08-31 06:25:00 | . webmasterworld . com/forum23/4556 . htm" target="_blank">www . webmasterworld . com the CPanel interface says we have used over than 5 gigs just for this month! this site is a phpbb forum . i know about the trouble that the bot can run when crawling forums, but is this normal? Sounds like you're serving session ID's up with your URL's . That would be the first thing to check . This thread . webmasterworld . com/forum30/30268 . htm" target="_blank">www . webmasterworld . com the reader asked google to stop hitting them so hard . Google agreed, now the bot never visits at all :) June 26: (me to Google) "Please stop it . " June 28: (Google to me) "We've reduced the load on your servers" July 3: (me to Google) "Your bots now do not crawl my site at all . " July 6: (Google to me) "we see no cause for concern at this time" IMO, we can trust that Googlebot has good behavior in crawling the World Wide Web . In rare occasion it may run wild but I would not bother in asking Google to slow the bots down as it is more prudent to have it fixing itself in natural way . In all cases, overloading is only temporarily in a very short term and things then return normal . No hassle . [quote] |
netchicken (4843) | ||
| 481553 | 2006-08-31 06:32:00 | Nigel > I will send you that file back latter on tonight :) | stu161204 (123) | ||
| 481554 | 2006-09-02 00:13:00 | Nigel > I have sent you back that file :) | stu161204 (123) | ||
| 1 2 | |||||