| Forum Home | ||||
| Press F1 | ||||
| Thread ID: 87781 | 2008-03-03 23:48:00 | Tools to analyse webserver logs, or how to parse log into txt file | Morgenmuffel (187) | Press F1 |
| Post ID | Timestamp | Content | User | ||
| 646024 | 2008-03-03 23:48:00 | Hi Ok Google has used 200Mb of bandwidth on a site i look after in just 4 days, i want to be able to tell what pages google is visiting, i can download the raw log, but it is 45mb (unzipped) after just 4 days, Is there an off line tool i can use that will filter only the google bot lines so i can view them I'm currently using the command line findstr "oogle" h:\log\logfile.txt >bob.txt Which gets me to a 3mb file which is much more handleable, but i'm wondering if there is an easier way |
Morgenmuffel (187) | ||
| 646025 | 2008-03-04 00:27:00 | There's probably no "easier" way. I'd suggest using findstr /i and the full "Google" search string because you might be getting extra log entries from other domains with the "oogle" part (e.g. cQoogle). There might be a logging option in the web server to track a particular "user". That would be a nice thing to have. ;) |
Graham L (2) | ||
| 646026 | 2008-03-04 00:35:00 | I use the comprehensive Google Analytics (www.google.com) (need Gmail account) for one some of my sites, and specifically use "Goals" (based on "funnels", where you input url's to find where traffic is coming from - say from referral, other sites, social sites, to your specific site pages to complete a conversion (e.g. to a sign up page, purchase, etc). Additionally the program also can display direct visited pages, locations, unique visits, keywords used, etc, plus many other useful features. Bit comprehensive, but if customized carefully, you can get targeted relevant site statistics. You can set up results to be emailed daily... Snapfiles freeware has server log analyzers (www.snapfiles.com), which might have what you specifically want... |
kahawai chaser (3545) | ||
| 646027 | 2008-03-05 22:11:00 | There's probably no "easier" way. I'd suggest using findstr /i and the full "Google" search string because you might be getting extra log entries from other domains with the "oogle" part (e.g. cQoogle). There might be a logging option in the web server to track a particular "user". That would be a nice thing to have. ;) hi graham I'm not up on all my old dos commands the reason I used oogle was i was unsure whether the search was case sensitive or not, also when using an option like /i am i not supposed to add a colon on there somewhere? past experience tells me no, but something at the back of the brain is just verblling that the command doesn't look quite right I use the comprehensive Google Analytics (www.google.com) (need Gmail account) for one some of my sites, and specifically use "Goals" Snapfiles freeware has server log analyzers (www.snapfiles.com), which might have what you specifically want... I'm signed up for google analytics, however the client is pretty uninterested in that side of things the provided awstats is about as interested as they get, it's more a case of figuring out whats using the bandwidth |
Morgenmuffel (187) | ||
| 1 | |||||