Magic Metrics and Measuring Success- Clicks and Conversions Never Tell the Complete Story
Monday, July 20th, 2009At Lotame, we are constantly striving to stay ahead of the curve and innovate. Since our inception, we have aggressively sought out and developed new, valuable metrics to measure the success of individual online advertising campaigns, as we do not believe (and have never believed) that clicks and conversions tell the complete story.
After much exploration, research, and analysis over the past few years, we have also realized there is no “magic metric”. In other words, there is not one individual metric that has the capability of measuring success for all campaigns. A key reason for this is due to each advertiser or campaign having a different goal. Some advertisers just want users to become familiar with their brand; others want users to purchase their product; while others want users to watch their television show or movie. One metric cannot accurately accomplish measuring each of these goals at the same time.
A year ago, we created our own single, unified metric for every campaign. It was a combination of every metric we look at in measuring the success of the campaign. However, there was an issue with creating such a metric – how does an advertiser compare the performance of their campaign by media buy/site? If only one buy/site uses the metric, then you cannot compare it across all buys/sites. Since the metrics we use incorporate our technology, it is not always easy to reproduce for other buys.
As a result, we measure the performance for each campaign individually, which also allows us to customize what we measure and report on for each campaign/advertiser. At Lotame, we have always prided ourselves on being 100% customizable for advertisers. We create completely customizable targets – no buckets. Therefore, creating completely customizable performance measurements seemed like a natural progression. While there are typically only a few possible end goals of a campaign (awareness, conversions/purchases/intent to buy, intent to view, buzz generation), many advertisers have smaller, intermediate goals. These smaller goals are fairly unique to each campaign. Therefore, we measure each of these goals as well as analyze the other metrics we deem to be valuable for their end goal. We want to stress that the smaller goals only exist as a means to measure the larger, end goals. And that is where our knowledge and experience at measuring the end goals comes into play. For instance, an advertiser may run a campaign asking users to upload photos for a contest. The likely reason behind running such a campaign is to generate awareness of the product/brand. We will not only measure the performance of the contest entries, but also various other metrics (i.e. Lotame’s patented Time Spent metric, the amount of time a user spends on the micro-site and/or the number of pages consumed on the micro-site, the responses to one-question in-banner surveys, and various engagement metrics with the creative) to get a more complete picture of awareness. The advertiser should understand that their contest is only one small portion of measuring the awareness of their product/brand. Lotame will complete the story with our knowledge, technology, and customized performance metrics.
We will continue to strive to identify and evangelize the best metrics possible to enable our clients to set appropriate goals for their campaigns and gain optimal insight into campaign performance. In doing so, we may find our way back to some uber-metrics, entirely new metrics or most likely, combinations of metrics which can be customized to match the specific requirements of each campaign. We’re fortunate to have great partners in this quest – our forward-thinking brand, agency, and publishing partners and companies including Vizu and Dimestore. Ultimately, the continuous development of new and scalable metrics will provide our clients with the best approaches for guiding and measuring their online advertising campaigns.
Written by: Doug Pollack is a Senior Business Analyst with Lotame Solutions. Doug has been responsible for the development of leading, and innovative Key Performance Indicators as well as new metrics for digital media. Prior to Lotame, Doug worked for a division of the Army where he leveraged his statistics background to analyze the aging of tanks operating in Iraq and Afghanistan. Doug is available at doug [at] lotame [dot] com.
one-question in-banner surveys: Surveys have gotten a bad reputation recently – mainly due to poor response rates and inaccurate results. However, the surveys we run are not affected by these issues. The types of surveys that are affected are the long surveys that force users to stray away from the website they were on. Users, especially those on social community sites (like Facebook, MySpace, and Bebo), do not want to be taken away from the websites they are on. These long, in-depth surveys do just that. They take the user away from the sites for a very long time, as they typically have 10 to 20 pages of questions. Therefore, the response and completion rates of the surveys are quite poor, leading to limited responses. With limited responses, results are typically inaccurate. However, the quick, in-banner, one question surveys we run solve these problems. Users can quickly take the survey without leaving their community. This leads to higher response rates, more responses, and more accurate results. In fact, Lotame has just finished a study testing the accuracy of the results of the surveys. We ran a survey measuring intent to view, which asked users if they planned on watching the season premiere of a popular TV show. We then re-surveyed the users who responded with a 2nd survey asking if they actually watched the premiere. 83.3% of users who responded to the 1st survey saying they would “Definitely” watch the premiere, did tune-in and watch the premiere. 74% of users who responded to the first survey saying they would either “Probably” or “Definitely” watch the premiere, did tune-in to the premiere.
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=04d5dec5-d156-4850-af7b-1ea72a535c89)
On Monday June 1st 2009, Lotame’s very own ![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=a04337f1-7be3-4e63-8f7c-fe458fe11b71)



![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=d1b48260-98a0-483a-ba77-8117e3afb656)
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=28006874-60d9-4834-b4e0-479b06320664)
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=7b0c0852-4f7c-45ee-8c76-11097ce50ad0)

