CHANGE TRACKING
Monday, April 13th, 2009
Change tracking is as important in web analytics as the data. So much so that it should be seen as an integral element of the ongoing performance optimisation process.
By now Christmas will be a very distant memory and for some online retailers it will be happier than for others. For almost all, the first few months of the New Year are a time to reflect on past sins committed over the Christmas period in the rush to capitalise on the annual consumerfest.
For the more well organised and generally larger e-commerce operations all major development on their sites will have been locked down since the end of September last year, October at the latest; other smaller outfits may still have been making final tweaks right up into the first and second weeks of December. For everybody the more fluid nature of online marketing means that this activity can be changed tactically right up to the final few days before pre-Christmas delivery deadlines make it impractical to spend any more money on acquisition.
All of this means that, waiting to be analysed in the first few months of the New Year, there is a wealth of information about the site and acquisition performance that will reveal which strategies and tactics on the web design and acquisition front worked best. Or is there….?
There have been occasions when I have shown trended data to a client indicating a step change in performance either one way or the other and followed up with the question, “what did you change then?” (…for a web analyst cannot know everything!!) This is often followed by a little head scratching and then sometimes a blank. Working on the basis of cause and effect, if the cause isn’t known, the effect which may be apparent is almost worthless if it can’t be either replicated or eliminated depending on whether it was good or bad. It is surprising then how often change tracking is forgotten about.
Change tracking is the responsibility of many different stakeholders within the organisation ranging from marketing, e-commerce and web development to merchandising and individual product managers. However many differing departments and stakeholders there are, each has a responsibility to log the changes they make in the implementation of their strategies and tactics where they are likely to have directly measurable effects on the performance of the website and business.
It is often a good idea to set up a central location where all change tracking information can be stored and accessed by everybody. Ultimately as long as it’s being tracked and can be plotted against data over time, it will become usable and subsequently have a significant impact on the ability to improve performance. Experience often leads to improvement and it’s easy to look back in hindsight with 20/20 vision if you put in a bit of effort on the way.

