Analog: Helper applications

• Configuration tools
• Configuration files
• Pre-processing
• DNS lookups
• Post-processing
• Scheduling and automation
• Form interface

Configuration tools

Analog Helper

Analog Helper is a graphical configuration tool for the Mac which allows you to specify your analog and Report Magic settings via a GUI.
Sig Software, shareware, US$39.
http://www.sigsoftware.com/analoghelper/

A-Soft Analog Shell

A-Soft Analog Shell is another graphical configuration tool, this one for Windows (95 and above).
A-Soft Technologies, shareware, US$49.95.
http://www.A-SoftTech.com/Startup/AnalogShell2.html

Analog Picker

Another graphical configuration tool for Windows. Also adds the date to logfile lines that are missing it. Version 1.1 handles DNS lookups and larger logfiles.
Utility Software, NZ$20 (c. US$10), 30 day free trial.
http://www.utilitysoft.co.nz/

RixWeb

Fill in your choices on a web form, and have a configuration file or Windows BAT file emailed back to you.
RixWeb, free service.
http://www.rix-web.com/analyzer/

Analog Configurator

Another site where you can fill in your choices, and get a configuration file. Auch auf Deutsch.
Andreas Schmidt, free service.
http://www.hillschmidt.de/ger/analog.cfg_form.htm

Analog Crawler

Crawls your web site to find the titles of all your web pages, and produces an analog configuration file so that the page titles will be displayed in the analog report.
Wadsack-Allen Digital Group, freeware.
http://www.wadsack-allen.com/products/analog.html

analog-fiscal-year.pl

Makes it easy to produce an analog report coinciding with the fiscal year instead of the calendar year.
Peter Murray, freeware.
http://www.pandc.org/peter/work/projects/analog-fiscal-year/

Configuration files

SEARCHENGINE commands

Two different lists of SEARCHENGINE commands, more comprehensive than the one is included in the distributed configuration file.
Israel Hanukoglu and Mike Shor
http://www.science.co.il/analog/SearchQuery.txt
http://mba.vanderbilt.edu/Mike.Shor/diversions/analog/

ROBOTINCLUDE commands

A more comprehensive list of ROBOTINCLUDE commands than is included in the distributed configuration file.
Jeremy Wadsack
http://wadsack-allen.com/products/robot-list.html

TYPEALIAS commands

A more comprehensive list of TYPEALIAS commands than is included in the distributed configuration file.
Rene Krauss
http://www.screenfox.de/analog_typealias/

Pre-processing

psLogger

If you don't have access to your logfiles, but can run scripts on your server, this script will create a logfile for you so that you can run analog.
Don Becker, freeware.
http://pscripts.psyon.org/pslogger/index.shtml

adddates.pl, logfix.vbs and convlog

Analog can't process logs which have the time on each line but the date only in a header, because it has no way to tell if the date has changed during the logfile.
So here are two scripts to add the date to every line of an extended format log. The first uses Perl, and the second uses the Windows Scripting Host.
Please read the warnings at the top of each program or you might get wrong data: they both assume that there are no 24-hour gaps in the logfile. Neither of these may be true in practice (especially on intranets). The convlog program comes with the Microsoft IIS server and will do a similar job, but also has to make these assumptions. So it is much better to log the date on every line initially.
http://www.wadsack-allen.com/products/analog.html by Wadsack-Allen Digital Group, freeware.
logfix.vbs by Aengus Lawlor, freeware.

LogTran

LogTran is a program for Mac which translates logfiles from lots of different formats into combined format. This is an alternative to writing LOGFORMAT strings for some formats which analog doesn't have built-in knowledge of.
Summary.Net, shareware, US$25.
http://www.summary.net/soft/logtran.html

logpatch

If you have extra quote-marks in your referrer or browser field, this program will fix them so that analog can read those lines. Written in C.
Luchezar Georgiev, freeware.
logpatch.c

maillog2commonlog

This converts mail logs in sendmail, postfix, smail or qmail format to the common log format, so that analog can process them. It comes with a configuration file and language file to make analog report the results in a more helpful way.
Joey Hess, freeware.
maillog2commonlog, analog_mail.conf, mail.lng, licence.

sendmail log analyser

Produces reports from sendmail logs, or converts them to web server-like logs for analog to read.
(NB Joey Hess's language file mail.lng advertised above may also be useful here.)
Jarkko Turkulainen, freeware.
http://www.klake.org/sma/

dnsparse.pl

Converts BIND name server logs to web server-like logs so that analog can read them.
Phil White, freeware.
http://network.itmagic.ltd.uk/opensource/dns/

fwanalog

This program converts firewall logfiles (in ipf or iptables format) into a form analog can understand, and runs analog on them.
Balázs Bárány, freeware.
http://tud.at/programm/fwanalog/

anonlog

anonlog "anonymizes" your logfile by encoding sensitive information.
Stephen Turner, freeware.
http://anonlog.sourceforge.net/

DNS lookups

DNSTran

DNSTran is a DNS lookup tool. It can go through your logfile, replacing numerical IP addresses with resolved names, or it can write a DNS cache file for analog to use. Versions for Mac, Linux (x86), Sun & IRIX.
Summary.Net, freeware.
http://www.summary.net/soft/dnstran.html

QuickDNS

QuickDNS is another tool to do all the DNS lookups before you run analog. Win32.
AnalogX, freeware.
http://www.analogx.com/contents/download/network/qdns.htm

logresolve

logresolve.c and logresolve.pl come with Apache and do the same job.
Apache group, freeware.
http://httpd.apache.org/

fastresolve

fastresolve is similar again, for Unix/Linux. It can even call analog when it's finished!
David MacKenzie, freeware
http://www.pix.net/staff/djm/sw/fastresolve/

ip2host

And another one. This one is designed as a plug-in replacement for the logresolve.pl script included with Apache.
Maurice Aubrey, freeware
http://www.lovelyfilth.com/~maurice/scripts/ip2host

jdresolve

Another one. This one's distinctive feature is that it constructs a fake address for unresolvable addresses based on resolving the parent domain.
John Rowell, freeware
http://www.jdrowell.com/

reverse-dns-lookup.pl

This one's page is in German.
Björn Höhrmann, freeware
http://www.bjoernsworld.de/perl/reverse-dns-lookup.html

LookupIP

Another one. For Windows.
Carsten Clasholm, freeware
http://www.clasohm.com/lookupip/

RDNSLOGS

Based on LookupIP, but also understands multiple logfiles and compressed logfiles. For Windows.
Antonio Silvestri, freeware
http://faculty.stcc.mass.edu/silvestri/rdnslogs/

adnslogres

adns is really a library for C programs. But it comes with andslogres as a standalone program.
Ian Jackson, freeware
http://www.chiark.greenend.org.uk/~ian/adns/

trimdns

trimdns goes through your DNS cache file, removing all but the most recent lookup for each IP address.
Andrew McCarthy, freeware.
trimdns.pl

xdns

xdns merges DNS files, removes old entries, and warns if one address has had two names.
Marco Bernardini, freeware
http://www.taggiasca.com/perl/xdns.htm

minidns

minidns does a DNS resolution of any IP addresses that make it in to the final report. This is an alternative to analog's full DNS resolution.
Michael Kennedy, freeware.
minidns.pl

fixdns

fixdns repairs your DNS file if it has corrupt entries, for example names with spaces in them. For Windows.
Lucian Wischik, freeware.
http://www.wischik.com/lu/programmer/analog-stuff.html

Post-processing

Report Magic for Analog

Turns analog output into pretty graphs.
Wadsack-Allen Digital Group, freeware.
http://www.reportmagic.org/

anaml

anaml is an analog to XML converter, putting each of analog's reports into a separate file. This could encourage more flexible output styles.
chocolateboy, freeware.
anaml.pl

Scheduling and automation

crontab.sh

This is a Unix shell script, intended to be run from a cron job, which can create reports daily, weekly and/or monthly.
Rebecca Minarik, freeware.
crontab.sh

webloganalysis.pl

Creates a configuration file for each virtual domain and runs analog. Would have to be adapted to other sites. Written for Windows, but should be easily adaptable to other platforms.
Peter Tapolyai, freeware.
webloganalysis.pl

LogFileManager

Reads all the logfiles in a folder, and uses analog to produce full reports and a summary report.
Server Automation Tools, shareware, US$39.95.
http://www.serverautomationtools.com/tools/1.5.html

runanalog

Perl program to automate daily Analog runs for one or more hosts and build an index page for them all. Generates one-month summaries through time and a month-to-date summary each day.
Dean Pentcheff, freeware.
http://www.biol.sc.edu/usage/

MISSA

Produces reports for several virtual hosts, and rolls over Apache logfiles. Unix shell scripts.
Jaume Teixi, freeware.
http://www.teixi.Net/missa/

Auto stats

Generates statistics for each IIS web site configured on a server. Can also optionally start Report Magic and delete the old logfile. Written in VBScript.
Cédric Caron, freeware.
http://www.orchid-management.com/download/stats.zip

multi.pl

Runs reports for a range of months, and displays pairs of months side-by-side for comparisons.
Marco Bernardini, freeware.
http://www.taggiasca.com/perl/multi.htm

Logwrangler

Runs analog (and optionally Report Magic and DNSTran) for multiple sites. Also generates a summary table for all sites. Perl script.
Chris Pepper, freeware.
http://www.reppep.com/~pepper/analog/logwrangler/

PHP scripts for analog

A collection of scripts that create configuration files for different virtual hosts, and run analog using all the configuration files in a directory. Adaptable to your site if you know PHP.
James Linden, freeware.
http://analog.lindensys.net/

ftpget

A Windows utility that fetches logfiles by ftp and adds the server name so that they can all live in the same directory.
Eric Jorgensen, freeware
ftpget.zip (10kb)

Analog_Run

VBScript program for Windows that runs daily, weekly or monthly reports. Can be easily run through the Windows Task Scheduler.
Christopher Lewis, freeware
http://www.christopherlewis.com/CodeSamples.htm

Form interface

myanalogform

A prettier and more comprehensive form than the one included in the analog distribution.
Ralph Mellor, freeware
http://www.ralphmellor.com/40/

anlgform.exe

A precompiled executable version of anlgform.pl, the form interface in version 4 of analog. For Windows 95/98/NT.
Wadsack-Allen Digital Group and Aengus Lawlor, freeware.
http://www.wadsack-allen.com/products/analog.html