Squid: Logfile Analysis


Calamaris By Cord Beermann is a tool to analyse Squid’s access.log. It generates ascii or html-reports. For a full list of features, please visit the Calamaris home page.

The Webalizer Its a fast, free web server log file analysis program. It produces highly detailed, easily configurable usage reports in HTML format, for viewing with a standard web browser.

Squidalyser
(local copy) Squidalyser is a squid traffic analyser, designed to allow per-user scrutiny and analysis of squid logfiles. The program runs from a Unix system via a web browser.

Squeezer by Maciej Kozinski, gathers information abount Squid’s internal performance and eficiency of relationship, finds bottlenecks, shows data transfer speed from particular sources.

Squeezer2 by Andrew Fresh is derived from Squeezer, but with more features, including running from a chroot environment.

SCALAR SCALAR (Squid Cache Advanced Log Analyzer & Reporter) produces many detailed reports, such as: Time Based Load Statistic, Extensions Report, Content Report, Object Sizes Report, Request Methods Report, Squid & HTTP Result Codes Report and Cache Hierarchy Reports – most of reports are splitted on Requests, Traffic, Timeouts and Denies statistic. SCALAR is highly customizable tool/script written on AWK – all setting can be defined inside script header. SCALAR developed by Yuri N. Fominov.

Squidview Squidview is an interactive program Which monitors Squid’s access.log and displays it in a nice fashion. It has searching and reporting functions. Squidview is a console program which also runs in an xterm. It has been tested on several distributions of Linux and is available under the GPL.

bt-LogAnalyzer This utility, by Burstek, parses logfiles from Squid and other caching products. It can generate combined reports for all logs and also includes email usage. The software runs on Windows 2000/XP.

squid-graph Squid Graph is a free, simple, yet powerful Squid v2 native logfile analysis tool that generates reports with graphical representation of the proxy server’s traffic. It is distributed under the GNU General Public License (GPL). Squid Graph runs on Unix systems with Perl version 5.6.0 or later.

squint squint generates a little report of who is spending the most time and resources browsing the internet via your squid proxy server. The top offenders in terms of data transfer, number of files transferred and on-line time are reported. squint now also generates a detailed history for each person which can be viewed with a browser.

logrep Logrep is a framework for extraction and presentation of information from various logfiles. It now supports snort, squid, postfix, apache, IIS and viruswall. HTML-reports, 2D analysis, overview page, ssh communication and bar charts are available.

Squid-Log-Analyzer Squid-Log-Analyzer is a small Perl script that analyses Squid’s access.log.

squidclients by Nico Tranquilli.

squidtimes By Nico Tranquilli generates a report of average transfer times.

Sarg By Pedro Lineu Orso Squid Analysis Report Generator is a tool that allows you to view “where” your users are going to on the Internet.

ModLogAn The modular logfile analyzer tool is able to analyze logfiles from 15 different servers (http, ftp, mail, streaming, etc.), including Squid. Its template engine generates XHTML based on usersupplied themes which makes it possible to provide look & feel of your own wishes.

Seafood
(local copy) Brought to you by the DFN-Cache and TERENA projects, Seafood collects log file statistics into a relational database (such as Postgres and Oracle).

Squij By Mark Nottingham, is a Python application that analyzes Squid log files, in conjunction with squid.conf. It can tell you when your cache serves stale or fresh responses.

WebLog By Mark Nottingham, is a set of Python classes for parsing Web logfiles, including one for Squid.

pwebstats By Martin Gleeson includes support for Squid’s native log format. In particular squid2common.pl will convert it to the common httpd log format.

squidsites is a tool that parses Squid access log file and generates a report of the most visited sites, sorting by hit count or by bytes count. It has a GPL license.

Squidtaild By Maurice Smiley is a Perl daemon designed to tail the squid log file and report user activity in real time based on user definable filter matches. Output generated by squidtaild is sent to an html page showing you how many filter matches, what they were and what ip address matched the filter. [Squidtaild used to be at http://trailer.linuxatwork.at/, but that site is now gone.]

ip2fqdn.pl by Martin Gleeson translates IP addresses to hostnames.

generic filters from LBL also translate IP addresses to hostnames.

proxy_stats.gawk By Richard Huveneers produces a different kind of report for an access.log.

access-times.awk By Andrew Richards shows access times for various categories of requests.

cache-stats By Iain Lea produces daily usage statistics for Netscape and Squid caches.

PY_Squid_Stats By David Ramahefason, this is a set of graphical stats tools for squid log files, written in python.

squidARG & squidltc squidARG is a program that generates reports from the Squid access.log. squidltc is the Squid Access Log Time Convertor.

NLANR Here are the old and difficult scripts that we use on our own caches.

SRG – Squid Report Generator SRG is a fast log analyser that creates detailed output reports right down to the individual URLs visited. SRG has strong support for integration with authentication systems to allow granular access to the reports.

Internet Access Monitor for Squid Internet Access Monitor is a software for monitoring the efficiency of your company’s Internet bandwidth usage. Using this product you can easily find out who, when, where to, where from and what accessed the Internet.

rotilia by Mehdi Adibi. Rotilia is a web-based logfile analyzer, written in PHP.It is distributed under the GNU General Public License (GPL).It able to calculate the total time that the cache server was busied, total size of packages and the list of sites visited by the users, also report all of these per user in any period of time.

Kraken Reports Kraken Reports is a log analyser written in C# for the .NET platform. It allows Administrators to do analysis on what users have been doing on their systems and filter users based on key words.

Stone Steps Webalizer Supports IIS and custom Apache log formats; CSS2-based HTML reports; run-time configurable languages; native DNS support (Windows & Linux);

SAcc Squid log analyser & accounting system

LightSquid LightSquid – lite log analizer for squid proxy small size (~45k) and fast parser😉 small disk usage generate many report type

.Traf (dotTraf) .Traf is a simple but complete proxy server log analyzer, for Windows 98/ME/NT/2000/2003/XP, supporting actually squid native log file (squid-cache proxy server). .Traf can generate html reports and/or browse all entries from its GUI

ManageEngine Firewall Analyzer ManageEngine Firewall Analyzer is a web-based log analysis tool that collects, correlates, and reports on logs from enterprise-wide firewalls, proxy servers, and Radius servers. Features include threshold-based alerting, log archiving, historical trending, and more.

Logfile Analyzer for Squid (LFA) very simple logfileanalyzer written in PHP, it is curently unter develop and will get more features in future. this software is available in german language, but you can change it if you like it😉

MySAR MySQL Squid Access Report is a dynamic database-based squid log analysis software, designed to be both flexible and easy to use.

squish Squish maintains a per-user record of proxy traffic and time on-line. (ab)Users exceeding configured quotas are squished (added to a blacklist acl). (Licence GPL)

ProxCube Squid log file analyser with comprehensive interactive reports. Drill down on most fields – user, client IP, response codes etc. Commercial software with 30 day trial.

S.L.A.E. (Squid Log Analyzer Express) S.L.A.E. is a platform, developed using C# and the .NET Framework 1.1 (and Mono), for analyze the Squid’s log file. The project’s aims are: be an OpenSource project, support for Windows and Linux (using Mono), support for rich and web client, support for SQl, MySQl and Access database, provide a rich class’s sets for database’s access and manage, provide OLTP and OLAP database, analyze and import “BIG” access.log file, manage multiple server and log’s file

OSSEC OSSEC is an open source project for security log analysis that supports squid, web, auth and mail logs. Some of the things you can detect by analyzing your squid logs are presented in the following document: http://www.ossec.net/en/loganalysis.html

Cache+ Cache+ is a squid-cache based product and SQL Based squid reporting. Technical Features: WCCP, MS Active Directory Auth, Radius Auth, Access Control List, URL brolcking, Detail Log Analyzer (with database)

Cyfin Reporter Cyfin Reporter is a scalable logfile analyzer that supports 95 different logfile formats, including Squid logfiles. From these logfiles, Cyfin produces Web-use reports that are detailed, accurate and easy to read. Customizable features fit any organization’s Web-use policy. Supports Windows 2003/XP/2000/NT, Red Hat Linux, Solaris SPARC and Active Directory. Free 30-Day Trial.

20 comments

  1. koq gak di sediann sama cara installasinya???

  2. Wah…. pengen belajar linux sih, cuman, mau dimulai darimana masih bingung

  3. […] to tail the squid log file …. 1, Mei 2007 6, April 2007 15, Maret 2007 9, Februari 2007 2 …https://bayuart.wordpress.com/squid-logfile-analysis/Alphabetical Index for ConsoleInstall-Sendmail 5.4. Installwatch 0.5.6. InstantWAP 1. InterBase […]

  4. terlalu banyak bozz…. bingung milihnya😀

  5. Hi!
    My name is Jessika!

  6. Hello !😉
    My name is Piter Kokoniz. oOnly want to tell, that I like your blog very much!
    And want to ask you: is this blog your hobby?
    Sorry for my bad english:)
    Thank you!
    Your Piter

  7. Hi, Guys!
    We can
    manually submit your website
    hand made web links.
    To clarify any your questions, just send us email at info@avazo.com
    Be in touch

  8. mantabs gan.. ini dia yg dicari2
    Thx🙂

  9. […] Squid: Logfile Analysis August 2007 10 comments 5 […]

  10. Unfortunately many of the links are not alive right now. For Example “Rotilia” and “Log File Analizer for Squid (LFA)”

  11. […] Untuk memonitor squid, bisa menginstall beberapa tools, diantaranya bisa dilihat disini […]

  12. […] Untuk memonitor squid, bisa menginstall beberapa tools, diantaranya bisa dilihat disini […]

  13. […] Untuk memonitor squid, bisa menginstall beberapa tools, diantaranya bisa dilihat disini […]

  14. my name is janjan, i’m new blogger,,,^^

    jelmoli meubles

  15. […] memonitor squid, bisa menginstall beberapa tools, diantaranya bisa dilihat disini LD_AddCustomAttr("AdOpt", "1"); LD_AddCustomAttr("Origin", "other"); […]

  16. […] memonitor squid, bisa menginstall beberapa tools, diantaranya bisa dilihat disini Referensi yang bagus dibaca […]

  17. […] Untuk memonitor squid, bisa menginstall beberapa tools, diantaranya bisa dilihat disini […]

  18. […] Spisak programa koji analiziraju Squid logove : spisak […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: