Forum Discussion
Leslie_South_55
Nimbostratus
NimbostratusCollecting website statistics
Greetings DevCentral,
So the challange was to be able to gather website statistics (client IP, pages hit, spiders, crawlers, search text, etc, etc, etc). There is seemingly useful tool call...
Leslie_South_55Nimbostratus
NimbostratusI'm going to try your suggestions, and yes we will have to do additional post processing on the log file without the date/time stamp, I guess I could pull the LTM time stamp, as you mention, and just insert it in the correct place?
I am getting a value for [HTTP::[payload length], here is a sample from my output - see line 5, the response was a 200 and the value for payload length is 107, all other requests were 304's
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 1.1.1.1 - - [02/Apr/2008:15:59:06 -0500] "GET /i/v/t/10.gif HTTP/1.1" "http://www.somesite.com" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)" 304 0
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 2.2.2.2 - - [02/Apr/2008:15:59:06 -0500] "GET /i/v/t/10.gif HTTP/1.1" "http://www.somesite.com" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)" 304 0
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 3.3.3.3 - - [02/Apr/2008:15:59:06 -0500] "GET /i/v/t/header.gif HTTP/1.1" "http://www.somesite.com" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; InfoPath.1)" 304 0
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 4.4.4.4 - - [02/Apr/2008:15:59:06 -0500] "GET /common/v/Tags.js HTTP/1.1" "http://www.somesite.com" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)" 200 1298
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 5.5.5.5 - - [02/Apr/2008:15:59:06 -0500] "GET /i/v/t/corner.gif HTTP/1.1" "http://www.somesite.com" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9b4) Gecko/2008031318 Firefox/3.0b4" 200 107
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 6.6.6.6 - - [02/Apr/2008:15:59:06 -0500] "GET /h/n HTTP/1.1" "" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506)" 404 1386
Apr 2 15:59:06 tmm tmm[29667]: Rule rule_awstats_log : 7.7.7.7 - - [02/Apr/2008:15:59:06 -0500] "GET /i/v/t/header.gif HTTP/1.1" "http://www.somesite.com" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; InfoPath.1)" 304 0
I'm going to have to play with the perl script to try to manipulate the time stamp a bit, I will update you with my progress...BTW if there is another way of doing what I am trying to do, please let me know.
Thanks
-L