By now, you’ve probably seen all the top-rated ads either during the game itself or afterward online and picked your favorites.  Most of the ads had some sort of mention of their web address, but not all of those sites greeted you with anything special upon arrival.  Here are four that went the extra mile to create experiences to make the most out of their massive Super Bowl ad expenditure.

Boost Mobile - boostmobile.com/shuffle

Right or wrong, Boost brings back the 1985 Bears in an odd (to put it mildly) spot featuring McMahon in a motorized chair getting a spray tan and other antics.  The site is in all Flash for which it loses some points from an analytics perspective, but at least it’s a unique URL which makes it easy to segment their traffic.  There’s also an ever-present banner that calls out Boost’s unlimited mobile plan so users can take the next step toward conversion.

Among the fun features are:

• An extended version of the ad as well as behind the scenes clips.
• Downloads and Fun Stuff including wallpapers, ringtones and a Ditka-shaped waffle currently for sale on Ebay!
• McMahon’s Headband: links to McMahon’s Twitter accounts
• Mike Singletary Party Police:  During the game and soon after you could rat out your friends for their faux pas during the game (asking what the score is, touching all the wings, etc.).  You pick a message and a recorded Mike Singletary would call their number (after the friend approves this via an email link).  The feature is no longer live, but here’s a screenshot.

You might have the shuffle song stuck in your head along with some weird imagery for a while, but it’s still a fun and engaging site and does a good job of integrating the brand.

Dove Men Care - DoveMenCare.com

While not as entertaining as the Boost Mobile campaign, a vanity URL directs you to a well-designed, targeted site which features the ability to play the ad along side prominent links to product, overview information, and special offers.  The site is a nice blend of Flash and XHTML/CSS to maximize both look and feel yet still provide quick page load times and easier tracking of key metrics such as product pages view, social media sharing, and offer signups.  It’s clear you’re in the right place if you visit the site as a result of seeing the ad, but the Dove smartly doesn’t allow the ad to take up all of the valuable screen real estate.  There’s also a nicely done shower curtain effect and a Drew Brees cameo.

Volkswagen PunchDub – VW.com

The automaker’s call to action in the ad is to play PunchDub on VW.com.  Sending  traffic straight to VW.com/PunchDub would have helped them with entry page analysis to segment ad-driven traffic, but that’s a minor negative compared with the overall quality of the site’s execution.  Upon arriving at VW.com, the normal site remains intact, but the presentation/branding area showcases the PunchDub game and a video player to watch the commercial.  VW dealers are getting into the act with “PunchDub Days” special offers and deals that are “So good it hurts.” Ouch.

In a new twist on share with a friend, the game lets you “punch” a friend by selecting a model, choosing a photo, and then picking your attack type and reaction sound.  You then connect with Facebook and send the pain on to one of your friends.  Give it a try, it’s well done, and you might find yourself up on the “Leaderboard” which is a stock ticker-style run down of the most punches, weekly winners, and top vehicles.

For back story you can learn from Sluggy Paterson, the outspoken man who started the whole punching tradition (it was initially the face, not the shoulder!) and even follow him on Twitter.

Overall, VW offers a seamless integration and a great user experience.

HomeAway - HomeAway.com

Everyone remembers the Griswolds and HomeAway brings them back with gusto.  A prominent callout on the homepage leads to an immersive experience that still keeps the site’s main navigation easily accessible.  You could spend half a day watching videos and playing with all the features but here are some of the highlights:

• Of course, the ad itself, but also a newly-created, 2-part short film (with smartly-placed quick 10-second pre-roll ads from HomeAway), as well as clips from the classic films.
• Win a Dream Vacation contest by submitting your own hotel vacation stories.  Entries from others are featured on the site which can be rated.
• Impressively designed Flash video game featuring the Griswold’s Truxter station wagon.

These are just a few examples of good executions tied to the Big Game.  Which ads do you feel were best supported on the web and took customer engagement to the next level, or were just plain fun?

Expert Review, Flash, Interactive Industry News & Events, Internet Marketing, Social Media, User Interface Design, Web Analytics Flash, Internet Marketing, Social Media, Super Bowl, User Interface Design, Web Analytics, Web Graphic Design

Martha Coakley’s failed Senate run has led many to review the key differences in strategy between her campaign and Scott Brown’s.  It’s pretty clear that Brown took the web seriously and Coakley seemed to largely ignore many of the social media and web analytics strategies and tactics that swept Obama into office.

Ad Age and Social Media Today have taken a look at (and criticized) Coakley’s overall digital and social media’s approaches.  This post narrows in and serves as a reminder of web analytics best practices which can mean the difference between coming in first or a distant second.

The Obama campaign tracked digital metrics obsessively yet ingeniously with great success.  The techniques they used are just as applicable today as they were over a year ago.

Dan Siroker was a Google employee, who in December of 2007 decided to take a leave from Google and assist the Obama campaign in setting up a web analytics methodology.  He was there for a month, came back to Google for a stint, then in July quit permanently to join the campaign full time through to the general election as director of web analytics.

As a measure of their success, of the $656 million raised by the Obama campaign, $500 million of that was raised online compared to $201 million the McCain campaign raised overall. ($201 million does not include the federal campaign funds McCain accepted).

In November of 2009, Siroker gave a presentation at Google about his experiences and the campaign’s web analytics wins.  In it, he outlined five key lessons learned, which are excellent guidelines for any web analytics initiative be it for a political campaign or business marketing.

Lesson 1: Define Success with QUANTIFIABLE Success Metrics

Setting goals such as, “drive traffic via PPC” or “use the email channel to maintain a dialogue with our audiences” are not specific enough to gauge success.

Instead, Siroker’s team set quantifiable goals related to cost per click, signup rates, money raised per email recipient, and many more.  He said, “We always had more to do than we had man hours to do it.”  As such, having very targeted goals was essential to ensure time expenditures could be justified.

Lesson 2: Question Assumptions

The team utilized Google Website Optimizer to determine which landing pages and creative content pulled its weight.  As an ad-hoc survey, Siroker asked the audience of a series of images and calls to action, which combination they thought was best received by splash page viewers and resulted in the most sign ups.  It turns out the audience’s assumptions were wrong (so were the analytics team’s originally) and it required multivariate testing to get to the truth (“Learn more” and the “Family Image” were the winners).

Getting the version right meant over 4 million more people signed up for the email list between the time they ran the experiment and the election!

Lesson 3: Divide & Conquer

This lesson demonstrates the power of segmentation.  As Avinash Kaushik puts it, segment or die!  Data takes on a whole new meaning when you can know as much as possible about the people who generated it.

This was illustrated by the team’s donation button experiment.  In it, they sent donation solicitations and tested different donation button verbiage (Donate Now, Please Donate, Why Donate, Donate and Get a Gift, and Contribute) with each audience (never signed up, signed up but never donated, previously donated). The results varied significantly based on who the visitor was when they got there.

Winning combinations:

• Never signed up: Donate and Get a Gift
• Signed up, never donated: Please Donate
• Previously donated: Contribute

Monetary results: tens of millions of dollars in additional donations.

Lesson 4: Don’t Reinvent the Wheel

This lesson goes to show that it’s not how much you spend on technology; it’s how much you invest in talent.  One would think that a presidential campaign which broke all sorts of war chest records would use its means to select the most robust and most expensive analytics tools on the market.  In fact, Siroker’s team used many free and open source tools.  These included Google Analytics, Website Optimizer, Trends, and App Engine, TextMate, Open Reports, and DbVisualizer.

Lesson 5: Take Advantage of Circumstances

After Sarah Palin made a remark at the Republican National Convention in an attempt to undermine the perceived value of being a community organizer, the Obama campaign immediately sent out an email to their list protesting this notion.

The recipients responded.  From that one email the campaign raised $10 million.

Think of your own organization.  How close are you to putting these lessons into practice?  Do you have examples of challenges or success stories?

Don’t pull a “Choke-ley” and underestimate the power and benefits of digital marketing, social media, and web analytics.  Know where you stand before you’re passed up by a Brown blur.

Interactive Industry News & Events, Internet Marketing, Social Media, Uncategorized, Web Analytics, Web Strategy Consulting Email Marketing, Google Analytics, Google Website Optimizer, Internet Marketing, Social Media, Web Analytics, Website Testing

With all that can be learned from clickstream web analytics tools such as Google Analytics, Yahoo! Web Analytics, and Omniture Site Catalyst, it’s important to remember those tools reveal the “what” of your site visitor sessions, but not much about the “why.” Did your visitors see the pages they wanted to see? Were they able to complete their tasks? Is a high page-per-visit rate a result of an engaged visit, or visitors unsuccessfully browsing through pages not finding what they’re looking for? Voice of customer tools are an important component to any website and web analytics initiative and can provide valuable “Aha!” moments.

In this post we’ll take a look at some of the most popular tools and the best ways to utilize them.

SURVEYS

We’re all familiar with surveys, however they come in all shapes and sizes and selecting the right one can be challenging. Some do a great job of collecting and segmenting results, others are annoying and drive your visitors crazy! It’s very important to evaluate not only the technical capabilities of your survey tool, but its user experience as well.

When redesigning a site, ensure survey integration is part of the overall technology set. The benefits of making surveys readily available include:

• They can be always on and serve as a continuous listening methodology. Surveys don’t always need to be sent out. They can be prominently featured on the site so visitors know they can leave feedback if they’re so inclined.
• Both qualitative and quantitative data can be collected
• Feedback can come in real-time so you can evaluate the positive or negative impact of newly-added site features or content
• A small sample size of responses can still yield valuable insights
• Surveys have evolved beyond the simple pop up to use cookies and conditional logic as well as integrate with clickstream data

Site-Level Surveys

You’ve likely come across these types of surveys that often fall under the “annoying” category. They are presented either as a popup, or pop under window and ask general questions about your overall experience using the site. Another option is the permission based survey. Upon entering a site, you’re presented with an invitation to take a short survey at the end of your visit.

If you use this approach, be sure to select a vendor that utilizes cookies so that repeat visitors are not invited each time they come to the site. For instance, visitors should only be invited to take the survey once every three months.

iPerceptions offers a great free site-level survey tool called 4Q which asks only the following four crucial questions:

1. What is the purpose of your visit to our website today?
2. Were you able to complete your task?
3. If you were not able to complete your task today, why not?
4. Based on today’s visit how would you rate your site experience overall?

With answers to these questions, you get a great macro-level view of your site’s performance. Also, you can calculate a valuable metric: Task Completion Rate by Purpose of Visit. There’s almost no clearer indication of whether your site’s doing what it’s supposed to do.

Also, consider prompting users to take the survey from locations other than just the homepage. Be contextual and get segmented data by creating surveys for specific sections of the site. You’ll be more likely to get responses from visitors who have a vested interest in the quality of content and/or features that they use regularly. Used this way, site-level surveys can function closer to (often preferable) page-level surveys.

Other great site-level survey tools include:

• Survey Monkey
• CRM Metrix
• ForeSee

Page-Level Surveys

Page-level surveys courteously sit in not-too-obtrusive places waiting for a user to take advantage of them. They often sit at the end of a browser, either on the right or left side or in a bottom corner. They are less likely to annoy visitors and provide the excellent benefit of highly contextual feedback which is the key to actionable data. You’ll hear from your most engaged or upset visitors and will be able to directly attribute their comments to specific elements of your website. This is a great compliment to A/B and Multivariate testing (another form of “what”).

An important thing to remember whether you’re using site-level or page-level surveys is to keep them short! The longer your survey, the less likely your visitors will complete it. Value your users’ time and only ask the questions they need in order to submit feedback.

Great page-level tools include UserVoice and Kampyle.

POLLS

Polls are essentially mini page-level surveys. These are great for quickly taking the temperature of your customers and visitors. They can be easily embedded in a sidebar or even within an email. The best polling tools allow someone to see the results of the poll after taking it. For example, a poll can be displayed in a user account area to solicit votes on which potential features would be most appreciated.

Polling tools:

• PollDaddy
• Constant Contact
• MicroPoll

RATING SYSTEMS

While most commonly featured on ecommerce sites in the form of product ratings, these tools can be used on non-transactional sites as well. A simple YES/NO answer to the question, “Did this [article/FAQ/video] help you?” can quickly let you know if certain content isn’t pulling its weight. More sophisticated sites use this information to dynamically sort content so the best rises to the top of lists.

A nice and inexpensive rating tool is RatingSystem.

Whatever tool or approach you select, make sure it’s appropriate for your site visitors and takes users, content, and context into account. Balance the “what” of your data with the “why” for truly actionable insights.

Let your voice be heard here! What tools, methods, and approaches have brought you success or challenges?

Internet Marketing, Social Media, User Interface Design, Web Analytics, Web Development Polls, Surveys, User Interface Design, Voice of Customer, Web Analytics

Continuing to tread on the territory of the major paid analytics vendors, Google Analytics just announced a number of new features that raise it to yet another level. These powerful, time-saving additions allow you to spend more time analyzing and interpreting your site’s performance, and less time foraging though the data.

Among the major additions are; automated and custom alerts based on significant changes in your data, advanced table filtering, expanded mobile reporting, the ability to share advanced segments, and more.

What do these new features mean for your business? Quite a bit. Read on for the details.

Engagement Goals

You’ve always been able to set goals for transactions such as purchases, downloads, leads and so on, and then determine which traffic sources or site content are top performers. However, sometimes a site’s goals are simply to increase engagement with the site and are not transactional in the traditional sense.

Now you can measure the engagement and branding success of your site by setting thresholds for Time on Site and Pages per Visit.

Example: For your software product marketing site you determine that a Page per Visit rate of 10 or more indicates high engagement with your content and significant interest in your product. With this Page per Visit threshold set, you’re now able to monitor whether recent content cross promotion efforts are positively or negatively affecting this new and important metric.

View the Google video:

Expanded Mobile Reporting

With mobile marketing maturing rapidly, and applications growing in number exponentially, this is a very timely addition.

Google Analytics has allowed you to track visits to your main website from mobile operating systems, but now you can track the performance of your mobile-optimized sites on any mobile device regardless of the device’s ability to run JavaScript.

iPhone and Android app developers, rejoice! You’ll be able to use your favorite free analytics tool to gauge your apps performance as well.

Example: You’ve just launched a new location-based app, which makes restaurant recommendations. Until recently, you could only track downloads and general feedback. Now you can uncover usability issues, and the most popular screens and features within the app to guide its improvements.

Advanced Analysis Features

Want to know which organic keywords are your top performers? The introduction of the advanced segments feature made this task easier, but the new Advanced Table Filtering makes narrowing down a lot of data on the fly a snap.

You can now filter any table of data by custom parameters, quickly narrowing down the results and removing the noise.

Example: When viewing the Network Locations reports, you want to see which organizations sent visits but filter out all the telecommunications companies which don’t help your analysis. Further, you want to see which organization showed high engagement and are repeat visitors. While it’s possible to set up an advanced segment to accomplish this, this type of filter can be done on the fly from any list report.

View the Google video:

Unique Visitor Metric

Good news for custom reports. Now “Unique Visitors” has been added so you can see how many actual visitors (people) are represented in each report as opposed to just overall visits.

Sharing Segments and Custom Report Templates

Very convenient new feature! Formerly, if a new advanced segment were created it would only be available via the profile it was originally created for. Now, just click the “Share” button and a URL is generated which you can easily send to a colleague. Advanced segments can also be copied so you can build upon existing ones rather than starting from scratch. This is also a huge plus for agencies, which utilize the same rough segments for multiple clients.

Analytics Intelligence

Here’s the big one that many were waiting for. Google Analytics is now much smarter! It proactively monitors for events that are significant and then issues alerts. The events could include a spike or drop in traffic, or any major change in goals or behavior patterns.

There is even a slider control that lets you adjust the sensitivity. Move it further to the right and more events will be flagged. Move it to the left and events will need to be more significant to register.

Example: Your site experiences a 250% increase in average referrals from Facebook on a given day. This is logged in Google Analytics automatically and is retained so you can look back overtime for patterns or responses to campaigns. You can also elect to have this alert emailed to the appropriate people.

Custom Alerts

As the title suggests, you can tell Google Analytics to watch for the events that are important to your business. Daily, weekly, and monthly alerts are possible and can also be viewed in the interface or emailed directly.

Example: A hardware ecommerce site manager wants to be alerted when the average order size for lumber drops 20% or more for the contractor segment. Once set, the manager can be alerted of this event instantly.

View the Google video:

Some of the features are live now, others will be rolled out in the coming weeks. It’s great to see Google Analytics continue to mature. These features offer more actionable and meaningful data with powerful options analysts will appreciate.

Interactive Industry News & Events, Internet Marketing, Social Media, Web Analytics, Web Strategy Consulting Google Analytics, Internet Marketing, Web Analytics

Everybody knows that money talks. It’s no different in the world of web analytics. When dollar values are assigned to site behaviors and other key metrics, the value of user actions and traffic sources becomes immediately clear.

Monetization isn’t just for ecommerce sites. Even user actions that have no immediate financial value such as contact form submissions, file downloads, page views, and email newsletter signups are excellent candidates.

If it’s your job to convince stakeholders to take action, or if you’re an executive looking for more clarity in your KPIs, this post will offer you some ammunition and help get you started.

Monetization’s Impact on Language

Monetized language is much more effective than un-monetized when communicating to decision makers why a certain site update should be undertaken.

Take this example for instance:

Un-monetized: “After mapping user traffic trends to goal completions for our site’s primary lead generation form, I found that the percentage of site visitors who find their way to the lead generation form is low and the conversion rate of visitors who access the form itself is less than optimal. We should work to improve these metrics.”

Monetized: “We’re leaving money on the table. With minor adjustments, we could significantly increase the number of leads we get through the website. Our web analytics and past order data shows that each lead we get through the site is worth $730. With some minor changes, we can increase our visitor-to-lead conversion rate by 10%, conservatively speaking. This would mean an additional $190,000 per month or $2.3 million a year in revenue. We should act soon. If we wait three months, we’ll be passing up $570,000.

Which example gets your attention?

The Benefits of Monetization

Here are some reasons why your organization should take a monetized approach to your data gathering and reporting.

1. Concretely know the impact of web development efforts and missed opportunities
2. Clearly prioritized initiatives sorted by those that drive revenue
3. Less time spent on updates that don’t impact the bottom line
4. Removal of internal politics and guesswork from decision making
5. Knowledge of your site’s true ROI

Examples of Monetized Behaviors

Lead generation is the most commonly monetized behavior and rightly so. This is the bread and butter of sites that complete their sales through reps or agents.

The calculation of a lead value is as follows:

(leads closed x average revenue per sale) / total leads = avg. lead value

For example, if your site produces an average of 500 leads per month, and 100 of them result in sales with an average of $2,000 each, then each lead is worth $400.

Customer Service also provides a strong opportunity. With an average cost of between $3.50 and $10 per call, many organizations place reducing call center costs by improving website help areas near the top of their list. Use unique phone numbers and track those calls that originated from the website. The conversion rate (to be reduced) here is those visits to the support section that resulted in a call center call. Use this data to frame any proposed improvements to the support section in clear dollar terms.

With ecommerce, it’s obvious to begin optimizing the checkout process, however increases in other actions such as views of product detail pages can also be monetized. The more users view product detail pages, the more likely they are to complete a sale. By analyzing clickthrough data patterns and ultimate purchase rates, you should be able to determine the value of a visit that includes 1 or more product detail page views. Once that is established it will be clearer which proposed improvements that drive traffic to detail pages (such as internal ads, better search results, etc) are worth the effort.

Show Them the Money

Here are some tips on how to present a monetized forecast to stakeholders. In your document, include the key metrics: monthly visits, the number of visits that result in a desired action, the conversion rate, the value of the desired action, and the current monthly value from that behavior.

Then show how incremental increases (or reductions in the case of customer service) will impact the bottom line. Show monthly profit impact as well as annual.

Another great attention-getter is presenting the cost of delay. With each incremental conversion rate change, show how much money is left on the table by not acting for three months. Ears will perk up regardless of whether the decision maker is benefit or loss-driven.

Take advantage of monetization to create powerful reports that get noticed and acted upon. Then get ready to calculate the financial benefits of vastly shorter prioritization meetings and fewer internal debates.

Web Analytics, Web Strategy Consulting Internet Marketing, KPIs, Monetization, Web Analytics

Website testing and optimization involves the utilization of software to compare the performance of two or more versions of a page or process to determine which version is the most effective in driving desired user behavior.  Tools such as Google Website Optimizer and more robust options geared toward the sophisticated enterprise such as SiteSpect, are available to automate (as much as possible) the process of conducting A/B or multivariate online tests.

Web analytics expert, Eric T. Peterson of Web Analytics Demystified and website optimization software creator, SiteSpect, recently teamed up to release a white paper entitled, “Successful Web Site Testing Practices.”  This must-read document provides a road map for setting up and leading a web testing team within an organization and leveraging it to yield definitive and dramatic results.  Below is our take on some of the highlights of their recommendations.  However, we strongly recommend you read the document in its entirety and take full advantage of case studies, testimonials, and direct examples including a sample test plan approval form (highly useful)!

Best Practice #1: Form a Great Testing Team
Your testing team must have a mandate for improvement.  This means they need to be charged with improving the website’s condition in a measureable way and be able to clearly demonstrate and communicate results to stakeholders.  It’s crucial to include your organization’s top talent in this team; those folks with the clout and track record to spark enthusiasm and buy-in throughout the company.

Eric T. Peterson labels the project manager and the executive sponsor as the two most important roles within the team.  We couldn’t agree more.  Without a carefully managed process and unwavering support from executive management, objectives can be unclear and the powerful force of entropy can take hold quickly.   Of course, without a key executive at the helm of this initiative, team members will find themselves, as Eric puts it, dead in the water.

The author also values the ability of the project manager to think from the perspective of an end user.  After all, it’s the user interface that’s being optimized, and without a firm grasp of user’s needs and the distinct problems or challenges they face when using the site, tests will be misguided and ineffective.

The efforts, updates, successes and even failures of the testing team should be broadcasted throughout the organization.  Allow for a platform for team members to showcase their results.  Ensure this is not merely one-way communication.  Follow the lessons of social media and allow for comments and suggestions in a structured way.  Demonstrating top-level commitment of both time and critical resources communicates the importance of the initiative.  The changes that incrementally occur to the site as a result of testing won’t be alarming to departments.  They’ll appreciate being informed and involved, and will be far more likely to lend their support.

Best Practice #2: Get Your Stakeholders On Board
Like any website redesign, web analytics, or social media endeavor, without management’s support for your testing initiative, you can essentially guarantee failure.

Be sure to work with management from the very start.  Illustrate to them exactly what you wish to achieve and the results you can expect, communicated in bottom-line financial predictions.  Communicate that a data-driven culture is one that strives to make web improvement decisions based on performance and demonstrated merit rather than assumptions.  As a result, an organization is better able to compete in the marketplace.

Best Practice #3: Write a (Formal) Testing Plan
There needs to be a structure through which requests for testing are considered.  Without this, individuals may try to “skip in line” to push their desired updates through based on their own agenda. They need to understand that a prioritized queue exists and suggested tests must be justified by answering the following questions:

1. What is being tested?
2. Why is it being tested?
3. What are the expectations for the test?
4. What are the measures of the success for the test?
5. What are the risks associated with running the test?
6. What internal resources are required to run the test?
7. Who is requesting the test?
8. By when are the results needed?

As mentioned earlier, the white paper authors have included a valuable sample test plan intake form that expands on the above questions.

Best Practice #4: Think about Measurement
Your web testing program should integrate and collaborate closely with your overall web analytics efforts.  This takes extra consideration and possibly technical expertise to ensure data available through analytics tools (such as audience segments) can be applied to tests.  Metrics and KPIs that have been established within a web analytics program should dictate to a large extent which tests should be undertaken.  Make sure one hand is talking to the other.

Also consider how your tests impact more complex measurements such as “return visitation rate” and “lifetime customer value” beyond just clickthrough metrics.

Best Practice #5: Clearly Define “Success” and “Failure”
Success means different things to different stakeholders.  It can range from obvious financial gains, to user engagement, to fewer support calls.  An important point that the author points out is that even a “failed” test yields some measure of success.  That is, you now know more about what doesn’t work thereby narrowing the field of possible creative or interface options getting you closer to the winner.  Don’t view missing the objective as a failure, but rather a learning experience which has actually moved the process forward.  The only real failure is a test that is not properly designed, carefully executed, done within a vacuum, or without executive buy-in.

Best Practice #6: Test Your Test
With this best practice, the author reminds us that while testing is absolutely worthwhile and a potential boon to any company, it’s also “hard.”

Be aware that expectations must be set.  This isn’t going to solve all the issues of the website in a month, quarter, or even year.  This is a long-term shift in the thinking of the company to become data-driven.  Certain technical implementations of tests may be trickier than others and will involve the IT department.  Legacy systems can affect the types of tests that can be conducted.  SEO initiatives can be impacted.  Other departments may push back due to perceived technical or business risks.

Be aware of these challenges, but don’t let them discourage you.  Things of great value don’t come easily, yet are worth the effort.  Set expectations to mitigate disillusionment.

Also, make sure testing periods are long enough to yield a statistically significant sample size.  Isolating factors (individual changes) sufficiently so one can determine which is responsible for better results is crucial as well.

Best Practice #7: Clarify Your Testing Timeline
Testers often forget to take day parts and weekends into account.  To ensure you’re not giving too much weight to lunchtime, early morning, late night, or weekend visitors, allow for enough time to collect a representative sample.  The author recommends a 7+1 strategy so you test over an entire week, but also add one day at the beginning of the test before you actively track results.  This allows the test versions to take hold online across the sample and for any last-minute changes.

Those with more time available can opt for a two week test, in this case a 14+1 timeline.   Good things come to those who wait.

Best Practice #8: Communicate Your Test Results with Actionable Analysis
Some great points here.  As always, it’s best to customize one’s report based on the audience.  When communicating the results to the stakeholders who originally requested the test, go into significant detail.  Reiterate the purpose of the test, the timeline, resources used and extensive information on the results.  If external events occurred during the test such as a major news mention or campaign, illustrate how the results were affected.

The rest of the organization should receive a broad overview.  A big picture, clear summary of the results and the impact on the website and company is sufficient to foster a sense of involvement and ongoing support.  Whenever possible, communicate the financial impact of the test.  As Mr. Peterson puts it, a phrase like, “and we expect this change to result in an estimated $20,000,000 in incremental revenue every year” is hard to ignore.

Also, check out the white paper to see a ready-to-use email example of how to broadcast test results to the organization.

In addition, in-person presentations are always best.  Follow these meetings up with postings to your communication platform be it a blog, wiki, online project management tool, or even Google Wave.  Allow enthusiasm for the results to go viral.

Above all, include actionable recommendations along with your results.  Clearly state what next action steps should be taken to capitalize on the success of the test.  Use this opportunity to suggest additional tests to keep the optimization ball rolling.

Best Practice #9: Test Different Audience Segments
The most revealing tests will be those that utilize targeted audience segmentation.  Knowing that a certain change increased conversions by 5% for all visitors is somewhat helpful, but knowing that same change resulted in a 20% increase for a key target audience is far more valuable.  Next action steps are more obvious in light of this information and those steps are more likely to have greater impact.

Directly reference audience segments when presenting test results to stakeholders to better grab their attention.

Best Practice #10: Mine for Deeper Opportunities
Once the testing program is up and running, and the team has a few wins under its belt, in-depth data analysis and statistical modeling is the next level to strive for.  Companies that are already utilizing robust applications such as SAS, or SPSS have an advantage, but this is not an absolute requirement.

Analysis and comparison of offline data or qualitative voice-of-customer data alongside test results can yield insights that are not immediately obvious through the testing or web analytics tools alone.  The author points out that a significant competitive advantage will be had by those companies who truly leverage their online data.

Your Experience?
We’d love to hear your thoughts on web testing and optimization.  Have you recently formed a team or are you considering it?  What methods and/or tools have brought you success?  What real world challenges has your organization overcome (or is still struggling with)?

Interactive Industry News & Events, Internet Marketing, User Interface Design, Web Analytics, Web Project Management, Web Strategy Consulting Google Website Optimizer, User Interface Design, Web Analytics, Web Project Management, Website Testing

By now, most companies are aware that there is a discussion about their brand going on. They also know that they can track and monitor this discussion via a wide variety of tools such as Radian6, Techrigy’s SM2, Twitter Search, Twitalyzer, Social Mention, and many more. The question now is, “What should I pay attention to? Which metrics will actually tell me something about my business?”

Certainly not easy questions, but some trends have evolved that help indicate whether you’re effectively promoting your business online and if you’re being showcased in a positive light. Here are some metrics to watch regularly.

Overall number of mentions or volume: Watch this top-level metric for significant spikes or dips in mentions across all social media especially during major campaigns or events.

Brand mentions: This is social media monitoring 101. What’s the buzz surrounding your company name? A great place to start, but strive to expand beyond this basic metric (more on this below).

Most popular topics: Moving beyond basic brand mentions to specific product names, promotions, and campaigns. These should change on a regular basis and keep pace with your company’s activities.

Share of voice: A term used by SM2, which channels (blogs, microblogs, Facebook, video/photo sharing, etc.) generate the most discussion? How do these metrics match up with recent efforts to increase your Twitter or Facebook reach? Are you gaining traction in the Blogosphere?

Top competitors: Monitor your competitors’ buzz. Be as detailed in tracking their social media reach, as you are with your own. Build off of their success by learning of new channels for adoption.

Demographics: It’s possible to obtain a high-level picture of the gender and age of your audience. Depending on the tool you use, a measurement of contributors’ popularity or influence scores is attainable. This in particular provides a great opportunity to reach out to those that run high-traffic sites or have a large number of Twitter followers. Developing and maintaining content sharing, and cross-promotional strategies with these folks should be an ongoing goal.

Top advocates and detractors: As mentioned above, popularity and influence can be determined. Pair this with sentiment statistics (see some guidelines on sentiment from Radian6) and you have a picture of your cheerleaders and your saboteurs. Join forces with the supporters and reach out to the detractors to determine the cause of their frustration. Pay special attention to setting up automated alerts of negative comments by the influential.

Geography: Running promotions or releasing product in a particular region? Track local impact and target the influences in that region. Stay on top of customer support efforts and respond to those that are expressing concern.

Number of comments: Here’s an easy one to gauge the popularity of your blog. Track overall numbers as well as a ratio of posts to comments.

Number of social bookmarking actions: How many people bookmark your content and what sites/systems do they use? Find out which content resonates and continue to generate that content which encourages viral sharing. Tools such as ShareThis make this easy by providing usage statistics including most popular content and the channels most utilized.

RSS feed subscriptions: This is a healthy barometer of how interested your audience is in your blog. These are the folks that are devoted enough to be notified when you post new content. As you modify frequency, average post length or strategy, watch this metric closely. Run your feed through Feedburner (now a Google product) to maximize insight.

User reviews and average rating: If you run an ecommerce site, seriously consider adding this functionality if you haven’t already. Studies have shown that inclusion of customer reviews helps move product in addition to allowing you to keep your finger on the pulse of customer sentiment. Watch for negative reviews, but don’t jump into the conversation unless a review surfaces that is significantly damaging. Instead, contact the customer privately if possible to resolve the issue. Keep an eye on average rating per product and product category.

Facebook, Twitter, and LinkedIn performance: Each of these is complex enough to warrant entire books on the subject and beyond the scope of this post. Here are some resources to get you started:

• Facebook: The Missing Manual by E. Vander Veer
• Facebook for Dummies by Carolyn Abrams
• The Twitter Book by Tim O’Reilly
• Twitter Power: How to Dominate Your Market One Tweet at a Time by Joel Comm
• See our previous post about Twitalizer
• How to Really Use LinkedIn by Jan Vermeiren
• I’m on LinkedIn–Now What??? by Jason Alba

Want to know who’s buzzing about you right now? Take advantage of the explosion of real-time search options:

• Twitter Search
  
• Scoopler
• Collecta
• Topsy
• Crowd-eye

A few best practices:

• Take benchmarks of your own efforts. Understand what changed and analyze the cause. Use this insight to set goals for the short, mid, and long term.
• Involve key stakeholders when it comes to the keywords you’ll be tracking and ensure they’re kept in the loop when reporting is generated. In addition to tracking obvious terms such as brand, promotions, and competitors by name, evolve your terms to include the categories your business operates in. Also monitor specific customer experiences such as quality, satisfaction, speed, and even anger to lead to actionable data.
• Setup real time alerts and have processes in place to respond accordingly. ReadWrite Web offers some options.

The amount of data that can be collected from social media is limitless. Use the above metrics as a starting point and a way to filter through the noise to track what matters.

Social Media, Web Analytics Blogging, Ecommerce, Internet Marketing, Social Media, Web Analytics

Podcasts remain one of the best ways to keep up with the latest trends and to learn new methods and approaches.  Whether listening while getting ready in the morning, during commutes or business travel, or even while working, there are more options than ever before as the medium has truly matured.  Even better, the vast majority are free.  Make the most of your downtime (in this economy, there may be more than usual), and never stop learning.

Below are some of the best podcasts that we “keep an ear” on:

INTERACTIVE INDUSTRY & TECHNOLOGY

Boxes and Arrows (Site | iTunes)
As the preeminent website for information architecture and user experience design professionals, it should come as little surprise that their podcasts are highly valuable as well.  Regular interviews with IAs, authors, and a variety of professionals can be heard along with full recordings of conferences and keynote speeches by some of the best in the biz.  Save money on air fare and conference fees.

CNET News Daily Podcast (Subscribe options)
Daily updates on all things tech.  Get insight on the latest Google inventions, what Apple is up to next, Twitter news, the top gadgets, and much more.

Marketing Edge (Subscribe options)
Albert Maruggi, a 25-year marketing veteran from Provident Partners has been publishing this podcast since 2005.  Each episode is around 30 minutes and features a combination of interviews, insights, and analysis related to internet marketing and social media in particular.  Recent topics include, Is there money in Communities? and Using Experts to Get Better Media Coverage.

Internet Marketing (iTunes)
Hailing from the UK, Andy White of Wire World Media hosts this monthly podcast which goes into a fair amount of detail on specific tools and tactics.  You’ll benefit from latest SEO trends, Google Analytics tips, and blog and podcast promotion to list a few.  We’ve only recently picked up this one, but it’s becoming a favorite.

Boagworld Web Design Advice (Subscribe options)
Another British podcast, Boagworld is info-heavy with minimal fluff.  Episodes tend to lean more toward development topics, but marketing strategies and tactics are also regularly covered.  Prepare yourself for some pretty heavy accents.  It’s a bit like Spinal Tap delivering the latest interactive news and tips.  This podcast goes to eleven!

Internet Marketing This Week (Subscribe options)
Mostly informal, this podcast requires a bit of sifting through conversational chatter, however there are always some good nuggets to be discovered. Four marketing experts scattered across the country Skype and conference call in each week to review the top stories.

BusinessWeek: CEO Guide to Technology (Blog | iTunes)
With varying frequency (most often monthly), this podcast highlights important technologies affecting business, with only the details top management needs to know.  Rachael King, the regular host, is by-the-numbers, and a little stale, however the guests she interviews spice things up and and are knowledgeable experts from a variety of industries.

BusinessWeek: Technology and You (RSS | iTunes)
Steve Wildstrom has been publishing this column in BusinessWeek since 1994 and every week offers this engaging podcast.  Steve puts all the latest gadgets and software to the test and his breadth of experience yields some great reviews.  The iTunes page for this podcast shows some bad reviews, however these are old (from 2007) and the issues they raise (mostly in terms of production quality) have since been resolved.

NPR: Technology Podcast (Subscribe options)
A handy-dandy summary of all related technology coverage across NPR over the last week.  It doesn’t get any more convenient than this.

Marketing Yak (Marketing Sherpa) (iTunes)
Most of us are aware of the great tutorials and reports from MarketingSherpa.  Here’s its closely related podcast.  They seem to be on hiatus right now (last publishing from November of 2008), but the past episodes are still available and worthwhile.  Hopefully they’ll ramp things up again soon.

BUSINESS & PRODUCTIVITY

Here are a couple general podcasts that are worth your time.

BusinessWeek
Behind This Week’s Cover Story with Executive Managing Editor, John Byrne offers in-depth interviews with the writers of the latest cover story.  If you read BusinessWeek, this is must-listen material.  Also, The Business Week hosted by Assistant Managing Editor, Jim Ellis, give you a summary of the week’s major business events along with interviews with the publication’s major columnists.  The Business Week is available in both audio and video.

David Allen Company Podcast (Subscribe options)
Getting Things Done personal productivity guru, David Allen serves up highly actionable tips every week to help you organize your hectic life.

HUMOR

All work and no play…  Be sure to throw some laughs into your podcast mix:

Car Talk (Subscribe options)
Resist the urge to set your car on fire and blow off steam with Click and Clack.  Test your brain with the weekly puzzler and laugh along as the two brothers poke insults at one another, read hilarious fan emails, and occasionally help people with their car troubles.

The Onion Radio News (Subscribe options)
America’s Finest News Source is hilarity at its finest, now in podcast form.  Don’t miss hard hitting stories such as “McDonald’s Unveils New All-Beef Bun.”

The above list is a just small sampling of what’s out there.  What’s on your iPod?  We’d love to hear about your favorites.

Information Architecture, Interactive Industry News & Events, Internet Marketing, Social Media, User Interface Design, Web Analytics, Web Development, Web Graphic Design, Web Project Management, Web Strategy Consulting Information Architecture, Internet Marketing, Podcasting, Social Media

Released in October of 2008, advanced segments for Google Analytics did more to bring the free tool up to speed with established paid tools like Omniture and Web Trends than any other single previous feature.  It gives users the ability to define audience segments quickly and easily, and then apply those segments to any report in Google Analytics.   The result is vastly more actionable reports.

Now you can quickly know:

• The percentage of “branded” search engine traffic (visitors who reached your site by searching for you by name) and their specific activities
• The traffic sources that are delivering quality traffic such as those that demonstrate engagement or directly convert
• The top content viewed by members of a specific audience segment such as visitors from California or New York, new visitors or repeat visitors, paid search or organic search visitors, or those driven via a specific email blast.
• The behavior of visitors who access your site via an iPhone or other mobile device
• The most common actions taken by those who access the site directly
• The most popular products across each key audience segment mapped to traffic source or landing page

The above is just a small sample of what can be revealed.  Examples of criteria used to set up a segment might include, page title, organic keywords, paid keywords, internal search terms, network location, campaigns, entry page or exit page, product categories or even individual product purchases.

Fully utilizing advanced segments provides true context to your data so you can easily evaluate your site’s ability to communicate to and convert specific groups.  It should be among the first steps of any web analytics initiative.  Your segments should be regularly reviewed and updated to take into account new abilities to more clearly identify a segment.  However, when updating segments, be sure to keep track of when those updates took place and factor this in as data totals may shift up or down.  For instance, adding a new traffic source to a segment can markedly increase visit totals.

Start using advance segments today and watch your reports take on a whole new meaning.

Internet Marketing, Web Analytics Google Analytics, Internet Marketing, Web Analytics

APIs (Application Programming Interface) have a way of turning things on their head and shaking things up.  When you open up a major platform to developers, very interesting things can happen.  Think about the Google Maps mashups, or the iPhone app store.

Google’s changing the game again, and giving paid analytics vendors a serious run for their money,  this time by releasing an API for Google Analytics.

Many companies have already leapt on this integrating Google Analytics data within their tools.  Using campaigns in Google Analytics to track email marketing performance has been possible, but requires separate tagging of URLs.  Using the API, MailChimp (great email tool), now allows for a single checkbox selection to add tracking code to all email links.  Clickthoughs of these links are tracked using Google Analytics, and then sent right back into your Mail Chimp account reporting.  If you’ve also setup Google Analytics ecommerce features and/or goal tracking, Mail Chimp will be able to report on email marketing performance in terms of ROI for the campaign, revenue created, average value per visitor, goals completed, and conversion rate.

ShufflePoint is particularly impressive in that they’ve already integrated Google Analytics with Excel and PowerPoint.  This takes things one step closer to creating truly custom dashboards and custom calculations (major differentiating features within Omniture) with very little financial investment.  Using ShufflePoint, you define the custom calculations, pulling specific metrics straight from your Google Analytics profile(s).  Then, each time you open the Excel spreadsheet or PowerPoint presentation, a simple click of a refresh button updates all data instantly.  A massive timesaver in terms of data entry, as well as a professional presentation to stakeholders with automatically updated data.

Other integration examples include, mobile phone apps, a variety of apps from YouCalc, content management systems, and more.

Many developers currently feel like kids in a candy store and are getting started by diving into Google Code, joining the developer community and keeping updated via the email list.

We look forward to integrating these new methods and tools into our own services and plan to blog about the best-in-class inventions as they spring up.  Stay tuned!

Interactive Industry News & Events, Internet Marketing, Web Analytics API, Web Analytics