LiveZilla Live Help

You are here

What tools can be used to analyze, generate reports from safesquid logs?

Sample Log Reports

Log Reports

SafeSquid Logs are produced in three distinct formats.
We traditionally name them as access.log (Access Log Format), extended.log (NCSA / Extended log format) and safesquid.log (Native Log Format).

The access.log has been traditional favorite, because it can be used by a variety of log analyzers like Calamaris, SARG, Squint, SquidTailD, etc.
The reports produced by these log analyzers reveal useful details of the overall usage and the pattern of access of the application.

The extended.log (NCSA / Extended log format) records maximum details of each request handled by the proxy application.
Log Analyzers like Sawmill can generate analysis reports using the extended log, and give lots more information, than the ones using access.log (see screen-shots and sample reports below).

SafeSquid's native log format records various functional aspects like REQUESTS, SECURITY, REDIRECT etc. that are effected by the various features and their configuration.

 

Sample Log Reports

AWStats
AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or mail server statistics, graphically. This log analyzer works as a CGI or from command line and shows you all possible information your log contains, in few graphical web pages. It uses a partial information file to be able to process large log files, often and quickly. It can analyze log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy, wap, streaming servers, mail servers and some ftp servers.

AWStats can be customized to parse SafeSquid extended.log to generate good reports, but unlike Sawmill, which can drill-down to the minutest detail, AWStats can only generate summary, and not per-user reports.

View sample report
Installing and configuring AWStats

 

Calamaris
Calamaris parses the logfiles of a wide variety of Web proxy servers and generates reports about peak-usage, request-methods, status-report of incoming and outgoing requests, second and top-level destinations, content-types, and performance.

View sample report
Installing and configuring Calamaris

 
Sarg
Sarg - Squid Analysis Report Generator is a tool that allow you to view "where" your users are going to on the Internet.
Sarg provides many information about proxy users activities: times, bytes, sites, etc...

View sample report
Installing and configuring Sarg
Scripts for generating dalily / weekly / monthly reports
 
Sawmill
Sawmill is a SafeSquid Combined/Extended log analyzer (it also supports 827 other log formats). It can process log files in SafeSquid Combined/Extended format, and generate dynamic statistics from them, analyzing and reporting events. Sawmill can parse SafeSquid Combined/Extended logs, import them into a SQL database (or its own built-in database), aggregate them, and generate dynamically filtered reports, all through a web interface.

View Screen-shots (Top 10, Security Breaches & Bandwidth Usage Reports)
View sample report
 
Squid-graph
Squid Graph is a free, simple, yet powerful Squid v2 native logfile analysis tool that generates reports with graphical representation of the proxy server's traffic, somewhat like the popular MRTG tool.

View sample report
 
Squint
squint is a Squid proxy log analyzer that generates a detailed report of who is spending the most time and resources browsing the Internet. The top offenders in terms of data transfer, number of files transferred, and on-line time are reported.

View sample report
 
Webalizer
The Webalizer is a fast, free web server log file analysis program. It produces highly detailed, easily configurable usage reports in HTML format, for viewing with a standard web browser.

View sample report