Home > Web Analytics, Web Strategy Consulting > Get Agile with Web Analytics: Part 2

Get Agile with Web Analytics: Part 2

April 30th, 2010

In Part 1 we set the stage for a adopting an agile web analytics methodology and looked at goal setting, KPI definition, closing data gaps, and creating your “to review” list.

In this post we’ll discuss data automation (and why it’s not the end-all-be-all), reporting strategies, insight brainstorming sessions, and the relative importance of data accuracy.

To Automate or Not to Automate?

The fully automated analytics dashboard is sort of a holy grail of marketing. The concept is having one place to check that shows performance data across all of your digital (and perhaps even offline) marketing, automatically updated as new data comes in.

Many vendors and agencies will claim this can be setup for you, (and some can take this concept very far such as Omniture, albeit at significant cost) however the devil is often in the details. One thing likely all can agree on is that online marketing continually evolves and it is evolving at a faster and faster pace. This means that your marketing objectives, content, campaigns, and the tools in your toolbox will be in a constant state of flux.

With data coming in from your primary web analytics tool (i.e Google Analytics), Facebook, Twitter, various other social media properties, email marketing, surveys, rating and feedback systems, search marketing, CRM systems, and more, the task of staying on top of the data each tool creates and funneling it into your dashboard accurately is daunting to say the least. Many of these systems will tout an API (application programming interface) however each one is different and is subject to change.

By committing to keep all of your various data sources integrated and automated, you’re adding a complex technical layer that may significantly increase your time to insight. When a decision is made to change the site, switch to a different social media platform, create or modify campaigns, you’ll likely have to submit an IT request to ensure your dashboard remains accurate. By the time this is completed, you may have already moved on to the next iteration of your strategy. Not exactly agile.

Instead, simply keep and update brief instructions next to each important metric about where and how to get the data. You may be able to link directly to a specific report. When your strategy or site changes, you only need to update text and/or a link. Follow your own instructions and you’ll have your answer in seconds. You can manually enter the number or metric to track over time, or simply look to see if it changed significantly. The level of effort you go to will depend on where you’re focusing your marketing efforts that month or that quarter. If you know nothing’s changed, why measure it?

Less Reporting, More Insight

If you want to ensure your web analytics initiative does NOT improve the overall company condition do this:

Create the same reports every month, exported into spreadsheets or PDFs, and distribute to top stakeholders. Wait for their feedback.

If on the other hand, you want results, a more hands-on collaborative process is in order. Try the following:

  1. Using your agile, not-necessarily-automated inventory of metrics, review the data that matters based on business goals and current marketing efforts. Identify significant improvements or problems in those areas.
  2. Draft a summary of the most important issues, highlighting the ones that likely contributed to the significant rise or fall of a major KPI. Create a list of the top 10 high priority initiatives (listed in order of importance/opportunity) you feel the company should take as a result of recent data.
  3. Organize a meeting of the top stakeholders in your organization (executive, marketing, customer service, technical) and use your summary of issues and opportunities as an agenda.
  4. Prior to the meeting, make sure you have the proper facilities and presentation equipment to bring up analytics tools on the fly during the meeting to illustrate your points and to reference the company website and/or social media properties to provide context.
  5. During the meeting walk through the issues and opportunities step by step, bring up data and representative screens to support your assertions.
  6. For each step, solicit direct feedback from the stakeholders and get each unique department’s perspective on what the data is revealing. Have there been major changes in strategy, technical updates, or content updates that the rest of the group wasn’t fully aware of? What are their plans for the immediate future?
  7. As responsibilities become clear, immediately assign them to the proper stakeholder. It may be a good idea to update your online collaboration tool’s task list (SharePoint, Basecamp, activeCollab, etc.) right then and there.
  8. After the meeting, go back and update your top 10 high priority initiative list and publish to the stakeholders. Also update your metric inventory based on revised goals and shifted marketing focus.
  9. At the next session, measure current progress against this updated set of metrics and new agenda.
  10. Lather, rinse, repeat, and progress.

Use web analytics data and A/B and multivariate tests to settle arguments. End the opinion loop and learn to take action as an organization regularly and rapidly.

Data Accuracy Matters…Mostly

We all want to be sure that the data we’re looking at is correct. Of course, we should take all reasonable precautions to ensure that it is. Properly tagging your site with tracking code tags, filtering out internal traffic, understanding how your web analytics tools tracks vists, sessions, events, etc. are crucial.

However, the more tools you use, inevitably, the more discrepancies you’ll see in terms of visit counts, referrals, views and so on. This is simply because they all track data differently and always will.

You can lose hair trying to reconcile all of these data sources, or you can act based on trends you see across the tools. Google Analytics may be telling you one thing about referrals from Facebook, Facebook may be telling you another, and your CRM system may be telling you something else. However, if each system is proportionally telling you that conversions from traffic driven by Facebook decreased significantly, then act. If you wait for 100% data confidence, you’ll miss the boat.

For more on freeing yourself from data accuracy dependency, see Avinash Kaushik’s blog post on the subject.

You Are Ready, Grasshopper

By integrating the points above (and from Part 1) into your web analytics process, you’ll decrease time to insight, and learn to act quickly to keep pace with the rapidly evolving digital landscape.

As always, comments are encouraged. What steps in your company’s data review process should stay or go? What challenges are you experiencing in the effort to end opinion loops and become a data-driven organization?

Web Analytics, Web Strategy Consulting , , , ,

  1. May 9th, 2010 at 16:50 | #1

    Brian
    A good post as I think this is something all of us in the business struggle with. That is how can we efficiently produce meaningful reports for our clients and stake holders.
    I think this search for the holy grail of automated reporting goes way beyond simply web analytics. The reason is measuring performance against KPIs and trending in all aspects of a business are crucial to success.
    Over the years I have often seen the first reaction to problems of this nature is one of two things. Hire more people or automate.
    From my perspective the first steps that need to be taken is pull together what you need using whatever tools you currently have even if it is time consuming. Then if you see that what you have is useful over the long haul then is the time to consider the value of automating certain tasks.
    Using an Agile approach to these problems is right on target it because it forces you to determine what is of greatest value and go from there.

  2. Molstad Consults
    May 10th, 2010 at 07:19 | #2

    Thanks for the comment, Jim.

    So true that businesses should take stock of the data and tools already at their disposal (or readily available at low or no cost). This minimal up-front technology investment allows them the time to get their strategy formulated, familiarize themselves with web (and other data source) analytics methods, and concretely define where they are and where they want to be. Once that new level of sophistication is reached, they are in a far better position to determine which metrics truly matter, and what technology will help rather than hinder insight generation.

    For those internal teams seeking increased budgets for analytics (and supporting technology), this approach allows them to demonstrate quick wins and a clear plan to senior management.

  1. May 5th, 2010 at 06:11 | #1
You must be logged in to post a comment.