Online advertising’s standardized metrics and ad formats may be the slowest developing web technology of the last 15 years. Doubleclick was founded in 1994 and over that time, ads have tuned their targeting, become visually richer and interactive and, of course, been embedded into search results. But overall, not much has changed in advertising’s strategy, styling or approach.
Compare this with the web where the pace of disruption has been much faster. Technologies like AJAX and Flash have made sites more interactive, application APIs have made them more open, CDN’s have made them much faster and cheaper. In general, the web has become more social, open and interactive. This fast pace of innovation is one reason why the top websites of 1997 like Geocities and Excite are unrecognizable today.
Conservatism would be warranted if online advertising was living up to its potential, but it’s not. One statistic is that 2/3rds of the $180B spent on advertising fits into the “branding” category but just $7 billion of is spent online. Those who have attempted to defend the status quo haven’t been doing a good job of it. Take this recent study by the Online Publishers Association which touts the success of brand advertising:
Even a cursory look at this study shows that it’s little more than evangelism under the guise of science. Let’s look at a few slides:
Slide 11: purporting to show that people exposed to brand campaigns visit the advertiser’s site most often:

Diagnosis: this slide is meaningless because it only shows the results of the experimental group. An experimental finding is only interesting if the results of an experimental group, exposed to advertising, were different than control group who was not. But they don’t show the control group here. Since the “experimental sample” in this study is 86 million, it seems like the control group is amazingly small.
Slide 17: purports to show that users exposed to ads spent significantly more on e-commerce

Diagnosis: aha, we have a control group with with little information about it.
So we should be asking some question like:
Does the methodology make any sense? I’d say no. The chart indicates that the statistic represents spending on all of the 53 brands sites if the customer was exposed to any of their ads. So, a visitor might have been exposed to the Allstate campaign but have spent nothing on Allstate.com and they will still be counted in the “exposed” sample. Chances are if you look at this data at an advertiser-specific level, you get much less convincing data. Yet this is exactly what you want to do since obviously the quality of execution and a brand’s product should make a great deal of difference. You can’t just invent a brand, throw up a lousy ad, take the customer to an uninteresting site and expect to get something out of the advertising.
Is the control sample otherwise identical to the experimental? If the groups were targeted ads because they are of different incomes or have different online behaviors, that’s the cause of their differential e-commerce spending not the ads themselves.
Are the results statistically significant? When I see a study that says “significant” without the statistical before it, I wonder if they’re trying to talk around something. The sample size is fine, but we need to know the standard deviation of consumer purchases to determine whether $242 is “significantly different” than $227 statistically speaking.
Do the numbers make any sense? The average individual in this study spends about $234 per month on e-commerce. That’s $2800 per year. Multiplied across the 220MM US Internet population, that’s a market size of $617 Billion or 4.5% of total US GDP. E-Commerce is not nearly that big of a deal, it’s probably about $150 Billion.
Now don’t get me wrong, I’m a huge advocate for online advertising, analytics and branding. I just think that using data mining and Powerpoints to prove your point isn’t going to do anybody much good.
The work that people like David Blum of Butler, Shine, Stern and Partners have done for Chipotle on the MyChipotle.com campaign presents a much better example of how to meld brand with response, online and offline to delight customers. It’s integrated marketing with a mission that stands out to anyone who sees it. It’s the product of the unity of creativity and technology with a call-to-action that’s right on brand.
Is it an online branding success? I’ll speak to how I might evaluate that later. One thing’s for certain: any analysis should map to basic marketing principles and avoid generalizations based entirely upon undifferentiated panels like ComScore which only track online behavior like looks, clicks and buys.