Monthly Archives: October 2014

Version 3 Sneak Peek #2: Log files caching

 

Part #1: Redesigned reports and 30% discount
Part #3: Beta available and Hybrid analysis

On several occasions in the past, users have asked why we don’t import data from log files into some kind of database. The answer is still the same: using any kind of database actually significantly reduces performance, even with some of fast libraries like SQLite. Sure, it would be much easier to develop, but the trade-off on the users’ end would be enormous, if we want to follow the original idea of web log analyzer capable for free on-the-fly filtering and creating ad-hoc reports.

So Web Log Storming utilizes series of our own algorithms to:

  • Parse and analyze text log files as fast as possible
  • Organize data in complex model, so it doesn’t take any more memory than it’s necessary
  • Provide fast routines to search and filter reports “on-the-fly” by any available data

 

It is clear that any of third-party libraries, database or other, cannot be more optimized for specific tasks that Web Log Storming requires, then those developed by ourselves from the scratch.

Still, starting with version 3, we have introduced a small improvement with optional log files caching. Basically, Web Log Storming will now analyze text log files, convert to numbers, dates, IP addresses, etc, and then the new step: save parsed data to cache files in format suitable for further usage. Next time when you analyze same log file, software will check if cache exists and read a prepared cache, instead of parsing text file again.

Log files cache options

Naturally, in case caching is enabled, first reading will be slower for the exact time needed to save data to the disk, but each next reading will be significantly faster for the time needed to convert texts to operable data. The speed change will depend on various factors, such is the typical size of individual log files and your preference if you want to keep cache compressed or not, etc. According to our tests, here’s a approximate rough speed comparison:

 

No caching  Uncompressed  Compressed
First analyzing 100% 100-120% 120-150%
Each future analyzing 100% 50-70% 70-90%
Combined first +4 future
100% 60-80% 80-102%
Combined first +9 future 100% 55-75% 75-96%
Combined first +49 future
100% 51-71% 71-91%
Additional space on the disk 0% 100% 10-15%

Typically, for moderate sized log files, you can expect a better performance (closer to lower ranges). For very small individual files (up to few kilobytes) or very large files (hundreds of megabytes or more), caching might not be such a good choice.

As you can see, best total speed improvement is with uncompressed cache, but at the cost of the additional disk space. By setting a caching options, you can decide what works best in your case.

Upgrade policy and “Early Bird” 30% discount

As our users probably already know, we switched to subscription upgrade model years ago. That’s why we don’t specifically charge for major updates like this one: update is free for anyone who bought or upgraded within at least a year before a release day or for anyone who bought a lifetime license.

So feel free to download and try current version and, if you decide to buy even today, you will get version 3 for free. As a special promotion, you can use this coupon for 30% discount:

WLS89445EARLYBIRD

The coupon applies to any purchase (new license or an upgrade) and will be valid until v3.0 is released.

* * *

Feel free to send us your thoughts regarding version 3, either by commenting here or by using a contact form. We’ll be happy to hear your opinion.

Version 3 Sneak Peek #1: Redesigned reports and 30% discount

 

Part #2: Log files caching
Part #3: Beta available and Hybrid analysis

We are heavily working on version 3.0 of our web log analyzer software, which will, we are certain, be a pleasant surprise for all users. In that regard, in next several posts we will talk about of some of more important additions.

Redesigned reports

Honestly, having different types of reports (lists, trends and pies) is something we are not happy with for some time. Discrepancies were not big so far either, but small inconsistencies could disrupt an usual workflow. Yes, some analytics reports should be naturally presented as histograms (bar or line charts) and some as pies, but should they really be different functionally? Also, plain and visually unappealing list reports in Web Log Storming analyzer are far more useful and precise when it comes to data analysis (if you used Web Log Storming at least a bit, you know why).

 Log analyzer - pages report chart  Log analyzer - pages report list
 Log analyzer - visitors report chart  Log analyzer - visitors report list

So we have decided to bring those three types closer to each other. The main idea: (almost) all reports should have both, list and chart representations and consistent right-click menus. Changes include:

  • You will be able to see any list report as chart now (as pies or as horizontal bars, depending on report)
  • Old Pie report become both list and chart reports
  • Old Trend reports will be also presented as a sortable lists, with additional columns for averages and goals

Additional browsing capability

How many times you clicked on item in report to get related sessions, then immediately right-click on left-hand report tree and choose “Keep parameters and select”, to see another report based on selected item? (If you didn’t, you are seriously missing one of unique features of Web Log Storming.) You will be happy to hear that, from the next version, you can do the same by right-clicking on list item (or bar or pie slice) and choose any of available reports or bookmarks directly.

Log analyzer - referrer report browsing

Optimized code

In the process, we’ve re-inspected and changed lot of program code, keeping in mind typical hardware differences compared to years back. As a result, some parts of underlying analysis routines are better optimized, faster and more stable.

Upgrade policy and “Early Bird” 30% discount

As our users probably already know, we switched to subscription upgrade model years ago. That’s why we don’t specifically charge for major updates like this one: update is free for anyone who bought or upgraded within at least a year before a release day or for anyone who bought a lifetime license.

So feel free to download and try current version and, if you decide to buy even today, you will get version 3 for free. As a special promotion, you can use this coupon for 30% discount:

WLS89445EARLYBIRD

The coupon applies to any purchase (new license or an upgrade) and will be valid until v3.0 is released.

* * *

Feel free to send us your thoughts regarding version 3, either by commenting here or by using a contact form. We’ll be happy to hear your opinion. And stay tuned for the next Sneak Peek.