A little press notice this week reported a January 20 announcement from Ogilvy North America of “strategic alliances” with marketing automation software vendor Unica and marketing database integrator Pluris. On its face, this seemed to suggest a change in strategy for all three firms, moving towards a database marketing agency approach that combines technology, marketing strategy, data and analytics. But close reading of the press release shows this is just an agreement to make referrals. When I asked one of the players involved, they confirmed that’s all there is.
Nevertheless, the announcement prompted a little flurry of speculation in the Twittersphere / blogosphere (we need a new term -- blabosphere?) about changes in the role of traditional advertising agencies. Even though the database marketing agency model has been held a relatively small niche for decades (pioneers like Epsilon were founded in the late 1960’s), the thought seems to be that it will soon become the dominant model.
I’m skeptical. In some ways, the basic technologies for customer management have actually become more accessible to non-specialist companies. In particular, the hardest part, building a customer database, has largely been taken over by customer relationship management systems. Once that’s in place, it’s not much more work to add a serious marketing automation system. In fact, all you do is buy software like Unica’s—which is why a firm like Ogilvy doesn’t need to build its own, or to have a particularly intimate relationship with Unica itself. Yes, Ogilvy and other agencies need database marketing competencies. But all they really need to do is manage a firm like Acxiom doing the actual work. This takes expertise but much less capital and human investment than doing it yourself.
So, if database marketing has become easier, there is even less need than in the past for an integrated database marketing agency. Database marketing has remained a small part of the industry because its scope is too limited, particularly in dealing with non-customers (who mostly are not in your database). (Yes, the credit card industry is an exception.)
But the Internet is changing the equation substantially. Advertising agencies marginalized database marketing because customer management is not their core business. But advertising agencies exist to buy ads, and Internet advertising is now too important for them ignore. Plus, Internet advertising is much closer to agencies’ traditional core business of regular advertising, so it’s much easier for them to conceive it as a logical extension of their offerings. Even though many specialist agencies sprung up to handle early Internet advertising, the traditional agencies are now reasserting their control.
Now here’s the key point: managing Internet ads is not the same as managing traditional advertising. Ad agencies will develop new skills and methods for the Internet, and those skills and methods will eventually spread throughout the agency as a whole. Doing a good job at creating, buying and evaluating Internet advertising requires vastly more data and analysis than doing a good job at traditional mass media. It will take a while for the agencies to develop these skills and procedures, but these are smart people with ample resources who know their survival is at stake. They will keep working at it until they get it right.
Once that happens, those skills and methods won’t stop at the door of the Internet department. Agencies will recognize that the same skills and methods can be applied to other parts of their business, and frankly I expect that they’ll find themselves frustrated to be reminded how poorly traditional marketing has been measured. Equipped with new tools and enlightened by a vision of how truly modern marketing management, agency leaders will bring the rest of their business up to Internet marketing standards of measurement and accountability. It’s like any technology: once you’ve seen color TV, you won’t go back to black and white.
We’re already seeing hints of this in public relations, where the traditional near-total lack of performance measurement is rapidly being replaced by detailed analyses of the impact of individual placements. In fact, the public relations people are even pioneering quantification of social network impact, perhaps the trickiest of all Internet marketing measurement challenges.
So, yes, I do see a great change in the role of advertising agencies. I even expect they will resemble the integrated strategy, technology, analytics and data of today’s database marketing agencies. But it won’t happen because the ad agencies adopt a database marketing mindset. It will happen because they want to keep on making ads.
Friday, February 6, 2009
Sunday, February 1, 2009
Razorfish Study Measures Direct Response to Social Media
I’ve been spending more time than I should recently on Twitter (follow me at @draab). It provides a fascinating peek into the communal stream-of-consciousness, which would be pretty horrifying (“Britney…Brad…Jen…Obama…groceries…Britney…Britney…Britney”) if you couldn’t choose the people and search terms you follow. This filtering (which I do via a great product called Tweetdeck) turns Twitter into a very efficient source of information I wouldn’t see otherwise.
Naturally, my interest in Twitter also extends to how you measure its business value, and by extension the value of social media in general. Since the people I follow on Twitter are both marketers and Twitter users, they discuss this fairly often. One recent post (technically a “tweet” but the term seems so childish) pointed to a study Social Media Measurement: Widgets and Applications by interactive marketing agency Razorfish.
The study turns out to be a very brief and straightforward presentation of two projects, both involving creation of downloadable widgets. One was promoted largely through conventional media and the other through widget distribution service Gigya. For each project, we’re told the costs, number of visitors and/or downloads, how much time and money they spent, and the return on investment. The not-very-surprising findings were that people who spent more time also spent more money and, more broadly, that “social media may be used effectively as a way of engaging users and potential customers.” A less predictable and potentially more significant finding from the first project was that people who were referred by a friend downloaded more often and spent much more money than people who were attracted by the media. The numbers were: downloads, 23% vs. 8%; spend any money, 9% vs. 1%; and amount spent, $23.00 vs $3.14. But the study points out that the numbers were very small—only 216 individuals arrived at the landing page as a result of a friend’s email, vs. 41,599 from media sources. These figures are drawn only from the first project because the second project couldn’t be measured this way.
From a marketing measurement standpoint, none of this seems break any new ground. Visitors are tracked by their source URLs and subsequent behavior is tracked through cookies. The ROI is calculated on straight revenue (it really should be profit) and seems to include only immediate purchases. This is particularly problematic for the second project, which promoted a $399 product with very limited supply that sold out in one minute. (The study doesn’t say, but based on this award citation it seems to be a special edition Nike Air Jordan shoe.) Clearly the point of such Air Jordan promotions isn’t immediate revenue, but brand building at its hard-to-measure best. The real challenge of evaluating social media is measuring this type of indirect impact. This study makes no claim to do that, but I’ll keep my eyes out for others that do.
Naturally, my interest in Twitter also extends to how you measure its business value, and by extension the value of social media in general. Since the people I follow on Twitter are both marketers and Twitter users, they discuss this fairly often. One recent post (technically a “tweet” but the term seems so childish) pointed to a study Social Media Measurement: Widgets and Applications by interactive marketing agency Razorfish.
The study turns out to be a very brief and straightforward presentation of two projects, both involving creation of downloadable widgets. One was promoted largely through conventional media and the other through widget distribution service Gigya. For each project, we’re told the costs, number of visitors and/or downloads, how much time and money they spent, and the return on investment. The not-very-surprising findings were that people who spent more time also spent more money and, more broadly, that “social media may be used effectively as a way of engaging users and potential customers.” A less predictable and potentially more significant finding from the first project was that people who were referred by a friend downloaded more often and spent much more money than people who were attracted by the media. The numbers were: downloads, 23% vs. 8%; spend any money, 9% vs. 1%; and amount spent, $23.00 vs $3.14. But the study points out that the numbers were very small—only 216 individuals arrived at the landing page as a result of a friend’s email, vs. 41,599 from media sources. These figures are drawn only from the first project because the second project couldn’t be measured this way.
From a marketing measurement standpoint, none of this seems break any new ground. Visitors are tracked by their source URLs and subsequent behavior is tracked through cookies. The ROI is calculated on straight revenue (it really should be profit) and seems to include only immediate purchases. This is particularly problematic for the second project, which promoted a $399 product with very limited supply that sold out in one minute. (The study doesn’t say, but based on this award citation it seems to be a special edition Nike Air Jordan shoe.) Clearly the point of such Air Jordan promotions isn’t immediate revenue, but brand building at its hard-to-measure best. The real challenge of evaluating social media is measuring this type of indirect impact. This study makes no claim to do that, but I’ll keep my eyes out for others that do.
Labels:
brand value,
marketing measurement,
social media
Wednesday, January 21, 2009
Tealium Measures Response to Social Media
The Internet promises marketers an exquisite measurability: you can tell precisely where each Web site visitor came from, and what people from each source do after they arrive. But non-advertising media such as blogs, online news articles, YouTube, Facebook and Twitter are a blind spot because many references to a company don’t contain a clickable link. (Tealium, whose solution I’ll discuss shortly, put the figure at 80% in one study.) Without a link, users either must type the destination URL into their browser or find the site through a search engine. Either way, the visit is not associated with the original source. Therefore, marketers who want to know, say, how many site visits were prompted by a particular YouTube video have no direct way to find out.
Tealium, a developer of specialized Web analytics tools founded last year by veterans of WebSideStory/Visual Sciences, offers Tealium Social Media as a solution. It first builds a list of Internet references to a product, based on automated searches of sources such as Google News and Blogsearch, YouTube, Bloglines, Twitter, etc., plus any other RSS source you might have available. The system then checks whether visitors to a company Web site have previously visited one of these references by checking the cache of the visitor’s browser. If a match is found, the visit is attributed to that source.
I’m going to stop right here and say that this struck me as raising a significant privacy issue. I hadn’t really given the matter any thought but had assumed my browser history was private. But a Google search on "read browser history" shows that a method to check whether someone has visited a specified URL is widely known. This is what Tealium does and it isn’t as invasive as simply reading everything. More important, Tealium doesn't track individuals: rather, it reports how many people come from a given source. This is little different from conventional Web analytics, so I guess there is no particular privacy objection to the product. And, yes, you can always clear your browser cache or shorten the retention period. Quick show of hands: how many of you have actually done that? I thought so. End of sermon.
Tealium’s approach won’t be 100% accurate, since some people really do clean out their browser caches,. A few people will also access a site from a different computer or browser than the one where they saw the reference. Nor will Tealium capture referrals, such as an email I sent you with a product’s name after reading an article about it. But most of these problems apply to other Web analytics techniques, and on the whole the data should be accurate enough to be useful. It will certainly give a good measure of the relative power of different sources.
The system must also choose how to assign credit if the visitor’s cache contains more than one of the reference items. Tealium handles this by ranking the items on popularity and recency, and assigning the match to the highest ranked item. This seems reasonable.
Of course, Tealium can only measure Web-based activities. This almost goes without saying, but it's worth reminding ourselves every so often that there are still plenty of non-Web interactions taking place.
Tealium originally intended to present its social media results in a stand-alone interface. But the vendor decided a couple of months ago to instead feed them into existing Web analytics products, and Google Analytics in particular. This reduced the work Tealium had to perform (no reporting or data storage), hence lowering development and operating costs. From the client viewpoint, it integrates the social media results with other Web analytics, allowing direct comparisons between paid and unpaid media. In addition, downstream measures such as conversions or purchases automatically become available for the Tealium-derived sources. This was a very wise move.
What Tealium won’t provide is measures of sentiment, such as whether a particular social media reference was praise or criticism, of comments on particular subjects, or of changes in customer attitudes. Nor does it claim to. There are of course many other systems in this field; see last week’s post on reputation monitoring systems for a pointer to a detailed list.
Pricing of Social Media starts at $2,000 for implementation plus $250 per month with a one year contract. Price grows slightly as users add keywords and data feeds but is not related to actual traffic volume. The system has been in beta test with six clients until recently, and is being formally launched today.
Social Media is Tealium’s third product. The other two are WebToCRM, which captures Web visitor data and posts it to a CRM system, and Universal Tag, which lets a single page tag feed visitor data to multiple Web analytics systems.
Tealium, a developer of specialized Web analytics tools founded last year by veterans of WebSideStory/Visual Sciences, offers Tealium Social Media as a solution. It first builds a list of Internet references to a product, based on automated searches of sources such as Google News and Blogsearch, YouTube, Bloglines, Twitter, etc., plus any other RSS source you might have available. The system then checks whether visitors to a company Web site have previously visited one of these references by checking the cache of the visitor’s browser. If a match is found, the visit is attributed to that source.
I’m going to stop right here and say that this struck me as raising a significant privacy issue. I hadn’t really given the matter any thought but had assumed my browser history was private. But a Google search on "read browser history" shows that a method to check whether someone has visited a specified URL is widely known. This is what Tealium does and it isn’t as invasive as simply reading everything. More important, Tealium doesn't track individuals: rather, it reports how many people come from a given source. This is little different from conventional Web analytics, so I guess there is no particular privacy objection to the product. And, yes, you can always clear your browser cache or shorten the retention period. Quick show of hands: how many of you have actually done that? I thought so. End of sermon.
Tealium’s approach won’t be 100% accurate, since some people really do clean out their browser caches,. A few people will also access a site from a different computer or browser than the one where they saw the reference. Nor will Tealium capture referrals, such as an email I sent you with a product’s name after reading an article about it. But most of these problems apply to other Web analytics techniques, and on the whole the data should be accurate enough to be useful. It will certainly give a good measure of the relative power of different sources.
The system must also choose how to assign credit if the visitor’s cache contains more than one of the reference items. Tealium handles this by ranking the items on popularity and recency, and assigning the match to the highest ranked item. This seems reasonable.
Of course, Tealium can only measure Web-based activities. This almost goes without saying, but it's worth reminding ourselves every so often that there are still plenty of non-Web interactions taking place.
Tealium originally intended to present its social media results in a stand-alone interface. But the vendor decided a couple of months ago to instead feed them into existing Web analytics products, and Google Analytics in particular. This reduced the work Tealium had to perform (no reporting or data storage), hence lowering development and operating costs. From the client viewpoint, it integrates the social media results with other Web analytics, allowing direct comparisons between paid and unpaid media. In addition, downstream measures such as conversions or purchases automatically become available for the Tealium-derived sources. This was a very wise move.
What Tealium won’t provide is measures of sentiment, such as whether a particular social media reference was praise or criticism, of comments on particular subjects, or of changes in customer attitudes. Nor does it claim to. There are of course many other systems in this field; see last week’s post on reputation monitoring systems for a pointer to a detailed list.
Pricing of Social Media starts at $2,000 for implementation plus $250 per month with a one year contract. Price grows slightly as users add keywords and data feeds but is not related to actual traffic volume. The system has been in beta test with six clients until recently, and is being formally launched today.
Social Media is Tealium’s third product. The other two are WebToCRM, which captures Web visitor data and posts it to a CRM system, and Universal Tag, which lets a single page tag feed visitor data to multiple Web analytics systems.
Labels:
public relations,
reputation monitoring,
software,
vendor list
Thursday, January 15, 2009
Interesting Conference on Real Time Communications; Great List of Tools for Reputation Monitoring
I spent yesterday morning at a conference on “Real-Time Communications” presented by the Business Development Institute and sponsored by PR Newswire. Not surprisingly, given the sponsor, this turned out to be mostly by and for public relations professionals. This group’s main concern seemed to be reacting to public criticism, and “real time media” meant primarily blogging and Twitter. There was heavy representation from the pharmaceutical industry in particular, which, as several speakers mentioned with obvious frustration, is highly constrained by regulatory rules from making proactive comments. Beyond reacting to immediate crises, it seems the main media relations strategy of this group is to reach out to better educate the press about industry issues, so any reporting will be based on a reasonably accurate understanding of the situation. Apparently even this basic approach is somewhat revolutionary in the industry: keynote Ray Kerins of Pfizer said that until he took over as VP Worldwide Communications two years ago, the company policy was to simply ignore the first phone call from any reporter. Interesting attitude, that.
Kerins also provided perhaps the most intriguing factoid of the day, which was that 15,000 journalists lost their jobs in 2008. (I traced this figure to the Web site Paper Cuts , which tracks reports of newspaper layoffs and buyouts. Apparently the total includes all newspaper employees, not just newsroom staff. But either way, it’s a big number.) Kerins’ comment was that many of the people being let go are well-trained and experienced reporters, who provide “context and analysis”. They are being replaced in many cases by bloggers and other non-professional observers who offer “speed” but are often not as knowledgeable, thorough or objective. This is a big issue, particularly for someone in a complicated industry such as pharmaceuticals.
Another, related point came from Morgan Johnston, Corporate Communications Manager of JetBlue, who described a situation where a customer complained while at the airport to 10,000 online readers about not being compensated properly when her baggage didn’t show up—only to have it appear 15 minutes later. (I’m not clear whether this was on Twitter or a conventional blog.) His point was that the damage was done, even if she posted a follow-up message saying that all was well. The original complaint will live on more or less forever, and people may not notice the final resolution. The particular moral here was the need to respond very quickly to such complaints so the company’s reaction becomes part of the permanent record.
From my own perspective, I was struck by the focus on reacting to other people’s comments in real-time media, as opposed to using those media for a company’s own marketing programs. I suppose the outbound programs are run by marketing rather than public relations.
On the specific issue of marketing measurement, no one at the conference seemed to feel they could meaningfully measure the return on investment of blogging and other projects. From the reactive PR perspective, it’s largely about being defensive and preventing damage to reputation, so it’s probably something you can’t afford not to do. The very little discussion I heard about proactive programs mentioned that it’s occasionally possible to count the direct leads or revenue, but there isn’t much of a way to measure the long-term financial value. This matches my own observations, mostly because the impact of these programs is usually too small to isolate from other factors that also affect performance. There might however be non-financial measures that are more sensitive, like Web site traffic by source.
One very specific and highly valuable product of the conference was a casual remark by one panelist to look at a Web post by Dan Schawbel at Mashable.com for tools to measure brand reputation online. I tracked this down and found two extremely valuable posts, one describing free brand monitoring tools and another describing paid reputation monitoring tools (many of which are very inexpensive). There’s no point to my listing the products here, since you can just read the posts themselves. But this is very useful information – indeed, it made the whole morning worthwhile.
Kerins also provided perhaps the most intriguing factoid of the day, which was that 15,000 journalists lost their jobs in 2008. (I traced this figure to the Web site Paper Cuts , which tracks reports of newspaper layoffs and buyouts. Apparently the total includes all newspaper employees, not just newsroom staff. But either way, it’s a big number.) Kerins’ comment was that many of the people being let go are well-trained and experienced reporters, who provide “context and analysis”. They are being replaced in many cases by bloggers and other non-professional observers who offer “speed” but are often not as knowledgeable, thorough or objective. This is a big issue, particularly for someone in a complicated industry such as pharmaceuticals.
Another, related point came from Morgan Johnston, Corporate Communications Manager of JetBlue, who described a situation where a customer complained while at the airport to 10,000 online readers about not being compensated properly when her baggage didn’t show up—only to have it appear 15 minutes later. (I’m not clear whether this was on Twitter or a conventional blog.) His point was that the damage was done, even if she posted a follow-up message saying that all was well. The original complaint will live on more or less forever, and people may not notice the final resolution. The particular moral here was the need to respond very quickly to such complaints so the company’s reaction becomes part of the permanent record.
From my own perspective, I was struck by the focus on reacting to other people’s comments in real-time media, as opposed to using those media for a company’s own marketing programs. I suppose the outbound programs are run by marketing rather than public relations.
On the specific issue of marketing measurement, no one at the conference seemed to feel they could meaningfully measure the return on investment of blogging and other projects. From the reactive PR perspective, it’s largely about being defensive and preventing damage to reputation, so it’s probably something you can’t afford not to do. The very little discussion I heard about proactive programs mentioned that it’s occasionally possible to count the direct leads or revenue, but there isn’t much of a way to measure the long-term financial value. This matches my own observations, mostly because the impact of these programs is usually too small to isolate from other factors that also affect performance. There might however be non-financial measures that are more sensitive, like Web site traffic by source.
One very specific and highly valuable product of the conference was a casual remark by one panelist to look at a Web post by Dan Schawbel at Mashable.com for tools to measure brand reputation online. I tracked this down and found two extremely valuable posts, one describing free brand monitoring tools and another describing paid reputation monitoring tools (many of which are very inexpensive). There’s no point to my listing the products here, since you can just read the posts themselves. But this is very useful information – indeed, it made the whole morning worthwhile.
Thursday, December 18, 2008
Aberdeen Reports Show Varied Roles for Performance Measurement
Our friends at Aberdeen Group apply a highly standardized research process to technology issues. They take a survey that asks companies about their business performance and the business processes, organization, knowledge management, technologies and performance measures related to a technology. They then divide the companies into leaders (“best-in-class”), laggards and industry average based on their business performance, and compare replies for the different groups. The not-quite-stated implication is that the differences in performance are caused by differences in the other factors. This is not necessarily correct (the ever-popular post hoc ergo propter hoc fallacy) and you could also wonder about the sample size (usually around 200) and how accurately people can answer such detailed questions. But so long as you don’t take the studies too seriously, they always give an interesting look at how firms at different maturity levels manage the technologies at hand.
It so happens that three of the Aberdeen studies have been sitting on my desk for some time, so I had a chance to look at them together. The topics were Lead Nurturing, Trigger Marketing and Cross-Channel Campaign Management. All are currently available for free although the sponsors may contact you in exchange.
Since the Aberdeen reports all follow a similar format, it’s easy to compare their contents. From the perspective of marketing performance measurement, they contain two elements of interest. These are the performance measures highlighted as distinguishing best-in-class companies, and the role of measurement among recommended strategic actions. Here’s a brief look at each of these in the three reports:
Lead Nurturing. The report highlighted number of qualified leads and lead-to-close ratio as critical performance measures, and found that 77% of best-in-class companies were tracking them. It also recommended tracking revenue associated with leads, although it found only 35% of best-in-class companies could do this. But otherwise, it didn’t see performance measurement as a central issue: the primary focus was on matching marketing messages to the prospect’s current stage in the buying cycle. Other important strategies were leveraging multiple channels, identifying prospect buying cycle and needs, and using automated lead scoring to move customers through the cycle.
Trigger Marketing. This report did not identify particular marketing measures as critical, although it did say that having defined performance goals for trigger marketing programs is important. It reported the most common measure is change in response rates, used by 69% of all respondents. (The next most common measure, change in retention rates, was used by just 54%.) I take this as a sign of immaturity (among the respondents, not Aberdeen), since response rate is a primitive measure compared with profitability and return on marketing investment, which were used by 43% and 42% respectively. This is consistent with another finding: the most common strategic action is to “link trigger marketing activities to increased revenues and other business results” (32%). I interpret that as meaning people are just learning to do make that linkage and are simply using response rate until they figure it out. It might be worth noting that the Aberdeen analyst highlighted digital dashboards as next step for best-in-class companies wishing to do still better, although I didn’t see a particularly compelling case for selecting that over other possible activities. But I’m all in favor of dashboards, so I’m glad to see it.
Cross-Channel Campaign Management. Again, the report doesn’t specify particular performance measures. It does say that it’s important to optimize future campaigns based on past performance (pretty obvious) and highlight real-time tracking of results across channels (less obvious, although I’m not so sure I agree. Immediate results may not in fact correlate with long-term profitability). This report did include segmentation and analytics as a strategic actions. (I consider these as part of performance measurement.) In particular, it stressed that best-in-class companies were focused on identifying their high value customers and treating them uniquely. Most of the recommendations, however, were about building the infrastructure needed to coordinate marketing messages across channels, and then executing those coordinated campaigns.
So where does this leave us? I don’t draw any grand lessons from these three reports, except to note that financial measures (i.e., customer profitability and return on investment) don’t play much of a role in any of them. Even that probably just confirms that such measures not widely available, which we already knew. But it’s good to know that people are working on performance measurement and that Aberdeen is baking it into its research.
It so happens that three of the Aberdeen studies have been sitting on my desk for some time, so I had a chance to look at them together. The topics were Lead Nurturing, Trigger Marketing and Cross-Channel Campaign Management. All are currently available for free although the sponsors may contact you in exchange.
Since the Aberdeen reports all follow a similar format, it’s easy to compare their contents. From the perspective of marketing performance measurement, they contain two elements of interest. These are the performance measures highlighted as distinguishing best-in-class companies, and the role of measurement among recommended strategic actions. Here’s a brief look at each of these in the three reports:
Lead Nurturing. The report highlighted number of qualified leads and lead-to-close ratio as critical performance measures, and found that 77% of best-in-class companies were tracking them. It also recommended tracking revenue associated with leads, although it found only 35% of best-in-class companies could do this. But otherwise, it didn’t see performance measurement as a central issue: the primary focus was on matching marketing messages to the prospect’s current stage in the buying cycle. Other important strategies were leveraging multiple channels, identifying prospect buying cycle and needs, and using automated lead scoring to move customers through the cycle.
Trigger Marketing. This report did not identify particular marketing measures as critical, although it did say that having defined performance goals for trigger marketing programs is important. It reported the most common measure is change in response rates, used by 69% of all respondents. (The next most common measure, change in retention rates, was used by just 54%.) I take this as a sign of immaturity (among the respondents, not Aberdeen), since response rate is a primitive measure compared with profitability and return on marketing investment, which were used by 43% and 42% respectively. This is consistent with another finding: the most common strategic action is to “link trigger marketing activities to increased revenues and other business results” (32%). I interpret that as meaning people are just learning to do make that linkage and are simply using response rate until they figure it out. It might be worth noting that the Aberdeen analyst highlighted digital dashboards as next step for best-in-class companies wishing to do still better, although I didn’t see a particularly compelling case for selecting that over other possible activities. But I’m all in favor of dashboards, so I’m glad to see it.
Cross-Channel Campaign Management. Again, the report doesn’t specify particular performance measures. It does say that it’s important to optimize future campaigns based on past performance (pretty obvious) and highlight real-time tracking of results across channels (less obvious, although I’m not so sure I agree. Immediate results may not in fact correlate with long-term profitability). This report did include segmentation and analytics as a strategic actions. (I consider these as part of performance measurement.) In particular, it stressed that best-in-class companies were focused on identifying their high value customers and treating them uniquely. Most of the recommendations, however, were about building the infrastructure needed to coordinate marketing messages across channels, and then executing those coordinated campaigns.
So where does this leave us? I don’t draw any grand lessons from these three reports, except to note that financial measures (i.e., customer profitability and return on investment) don’t play much of a role in any of them. Even that probably just confirms that such measures not widely available, which we already knew. But it’s good to know that people are working on performance measurement and that Aberdeen is baking it into its research.
Labels:
marketing measurement
Thursday, December 11, 2008
Survey: Marketing Accountability Measures Remain Weak
Every year since 2005, the Association of National Advertisers and vendor MMA (Marketing Management Analytics) have joined forces to produce a survey on marketing accountability. Although the details change each year, the general results have been sadly consistent: marketers, finance executives and senior management are very unhappy with their marketing measurement capabilities.
In the 2008 study, released in July and just recapitulated in a new MMA white paper, only 23% of the marketers were satisfied with their metrics for marketing’s impact on sales, and just 19% were satisfied with metrics showing marketing impact on ROI and brand equity.
Furthermore, only 14% of the marketers felt their senior management had confidence in marketing’s forecasts of sales impact. And even this is probably optimistic: a separate MMA-funded study, also cited in the new white paper, found that only 10% of financial executives use marketing forecasts to help set the marketing budget.
The obvious question is why so little progress has been made. Marketers consistently rank performance measurement as their top priority (for example, see the CMO Council’s Marketing Outlook 2008 survey). Nor are marketers doing this out of the goodness of their hearts: they know that being able to show the impact of their expenditures is the best way to protect and grow their budgets. So marketers have every reason to work hard at developing performance measures that finance and senior management will accept.
And yet...when the ANA survey asked marketers to rank their accountability challenges, the top score (45%) went to “understanding the impact of changes in consumer attitudes and perceptions on sales”. This strikes me as odd, if the marketers’ ultimate goal is to understand the impact of marketing programs on sales. Measuring the impact of marketing programs and measuring the impact of customer attitudes are not the same thing.
Nor is this a simple fluke of the wording. A separate question showed the most common accountability investment was in “brand and customer equity models” (53%). These also measure the link between attitudes and sales.
One explanation for the disconnect would be that marketers can already measure the relationship between marketing programs and consumer attitudes, so they can complete the analysis by adding the link between attitudes and sales. This seems a bit optimistic, especially since it also assumes that marketers also understand the impact on sales of marketing programs that are not aimed at consumer attitudes, such as price and trade promotions.
A more plausible explanation would be that the link between attitudes and sales is the hardest thing to measure, so that’s where marketers put their effort. Or, maybe that relationship is the question that marketers find most intriguing because, well, that’s the sort of thing they care about. A cynic might suggest that marketers don’t want to measure the link between marketing programs and sales because they don’t want to know the answer. But even the cynic would acknowledge that marketers need a way to justify their budgets, so that can’t be it.
None of these answers really satisfies me, but let’s put this question aside. I think we can safely assume that marketers really do want to measure their performance. This leaves the question of why they haven’t made much progress in doing it.
One reason could be that they simply don’t know how. Marketing measurement is truly difficult, so that’s surely part of it.
Another possibility is that they know how, but lack the resources. Since good marketing measurement can be quite expensive, this is probably part of the problem as well. Remember that the resources involved will ultimately come from the corporate budget, so finance departments and senior management must also agree that marketing measurement is the best thing to spend them on. And, indeed, this doesn’t seem to be their priority. The white paper states that “the number of CEOs and CFOs championing marketing accountability programs within their firms remained negligible and unchanged from 2007.”
This is a pretty depressing conclusion, although to me it has the ring of truth. Fuss though they may, CEOs and CFOs are not willing to invest money to solve the problem. Indeed our friend the cynic might argue that they are the ones with a motivation to avoid measurement, since it gives them more flexibility to allocate funds as they prefer.
The white paper doesn’t dwell on this. It just lists lack of senior management involvement as one of many obstacles. The paper authors then go on to propose a four step process for developing an accountability program:
- assess and benchmark existing capabilities and resources
- define an achievable future state, in terms of the business questions to answer and the resources required to answer them
- work with stakeholders to align metrics with corporate goals and key business questions
- establish a roadmap with a multi-year phased approach
There’s not much to argue with here. The paper also provides a reasonable list of success factors, including:
- realistic stakeholders expectations
- agreement on scope at the start of the project
- cross-functional team with clearly defined roles, responsibilities and communication points
- simple math and analytics
- integration of analytics for pricing, ROI, and brand analysis
Again, it’s all sound advice. Let’s hope you can get the resources to follow it.
In the 2008 study, released in July and just recapitulated in a new MMA white paper, only 23% of the marketers were satisfied with their metrics for marketing’s impact on sales, and just 19% were satisfied with metrics showing marketing impact on ROI and brand equity.
Furthermore, only 14% of the marketers felt their senior management had confidence in marketing’s forecasts of sales impact. And even this is probably optimistic: a separate MMA-funded study, also cited in the new white paper, found that only 10% of financial executives use marketing forecasts to help set the marketing budget.
The obvious question is why so little progress has been made. Marketers consistently rank performance measurement as their top priority (for example, see the CMO Council’s Marketing Outlook 2008 survey). Nor are marketers doing this out of the goodness of their hearts: they know that being able to show the impact of their expenditures is the best way to protect and grow their budgets. So marketers have every reason to work hard at developing performance measures that finance and senior management will accept.
And yet...when the ANA survey asked marketers to rank their accountability challenges, the top score (45%) went to “understanding the impact of changes in consumer attitudes and perceptions on sales”. This strikes me as odd, if the marketers’ ultimate goal is to understand the impact of marketing programs on sales. Measuring the impact of marketing programs and measuring the impact of customer attitudes are not the same thing.
Nor is this a simple fluke of the wording. A separate question showed the most common accountability investment was in “brand and customer equity models” (53%). These also measure the link between attitudes and sales.
One explanation for the disconnect would be that marketers can already measure the relationship between marketing programs and consumer attitudes, so they can complete the analysis by adding the link between attitudes and sales. This seems a bit optimistic, especially since it also assumes that marketers also understand the impact on sales of marketing programs that are not aimed at consumer attitudes, such as price and trade promotions.
A more plausible explanation would be that the link between attitudes and sales is the hardest thing to measure, so that’s where marketers put their effort. Or, maybe that relationship is the question that marketers find most intriguing because, well, that’s the sort of thing they care about. A cynic might suggest that marketers don’t want to measure the link between marketing programs and sales because they don’t want to know the answer. But even the cynic would acknowledge that marketers need a way to justify their budgets, so that can’t be it.
None of these answers really satisfies me, but let’s put this question aside. I think we can safely assume that marketers really do want to measure their performance. This leaves the question of why they haven’t made much progress in doing it.
One reason could be that they simply don’t know how. Marketing measurement is truly difficult, so that’s surely part of it.
Another possibility is that they know how, but lack the resources. Since good marketing measurement can be quite expensive, this is probably part of the problem as well. Remember that the resources involved will ultimately come from the corporate budget, so finance departments and senior management must also agree that marketing measurement is the best thing to spend them on. And, indeed, this doesn’t seem to be their priority. The white paper states that “the number of CEOs and CFOs championing marketing accountability programs within their firms remained negligible and unchanged from 2007.”
This is a pretty depressing conclusion, although to me it has the ring of truth. Fuss though they may, CEOs and CFOs are not willing to invest money to solve the problem. Indeed our friend the cynic might argue that they are the ones with a motivation to avoid measurement, since it gives them more flexibility to allocate funds as they prefer.
The white paper doesn’t dwell on this. It just lists lack of senior management involvement as one of many obstacles. The paper authors then go on to propose a four step process for developing an accountability program:
- assess and benchmark existing capabilities and resources
- define an achievable future state, in terms of the business questions to answer and the resources required to answer them
- work with stakeholders to align metrics with corporate goals and key business questions
- establish a roadmap with a multi-year phased approach
There’s not much to argue with here. The paper also provides a reasonable list of success factors, including:
- realistic stakeholders expectations
- agreement on scope at the start of the project
- cross-functional team with clearly defined roles, responsibilities and communication points
- simple math and analytics
- integration of analytics for pricing, ROI, and brand analysis
Again, it’s all sound advice. Let’s hope you can get the resources to follow it.
Labels:
marketing measurement
Friday, December 5, 2008
TraceWorks' Headlight Integrates Online Measurement and Execution
I’ve been looking at an interesting product called Headlight from a Danish firm TraceWorks. Headlight is an online advertising management system, which means that it helps marketers to plan, execute and measure paid and unpaid Web advertising.
According to TraceWorks CEO Christian Dam, Headlight traces its origins to an earlier product, Statlynx, which measured the return on investment of search marketing campaigns. (This is why Headlight belongs on this blog.) The core technology of Headlight is still the ability to capture data sent by tags inserted in Web pages. These are used to track initial responses to a promotion and eventual conversion events. The conversion tracking is especially critical because it can capture revenue, which provides the basis for detailed return on investment calculations. (Setting this up does require help from your company's technology group; it is not something marketers can do for themselves.)
These functions are now supplemented by functions that let the system actually deliver banner ads, including both an ad serving capability and digital asset management of the ad contents. The system can also integrate with Google AdWords paid search campaigns, automatically sending tracking URLs to AdWords and using those URLs in its reports. It can also capture tracking URLs from email campaigns.
All Web activity tracking may make Headlight sound like a Web analytics tool, but it’s quite different. The main distinction is that Headlight lets users set up and deliver ad campaigns, which is well outside the scope of Web analytics. Nor, on the other hand, does Headlight offer the detailed visitor behavior analysis of a Web analytics system.
The campaign management functions extend both to the planning that precedes execution and to the evaluation that follows it. The planning functions are not especially fancy but should be adequate: users can define activities (a term that Headlight uses more or less interchangeably with campaigns), give them start and end dates, and assign costs. The system can also distinguish between firm plans and drafts. TraceWorks expects to significantly expand workflow capabilities, including sub-tasks with assigned users, due dates and alerts of overdue items, in early 2009.
Evaluation functions are more extensive. Users can define both corporate goals (e.g., total number of conversions) and individual goals (related to specific metrics and activities) for specific users, and have the system generate reports that will compare these to actual results. Separate Key Performance Indicator (KPI) reports show selected actual results over time. In addition, something the vendor calls a “WhyChart” adds marketing activity dates to the KPI charts, so users can see the correlation between different marketing efforts and results. Summary reports can also show the volume of traffic generated by different sources.
The value of Headlight comes not only from the power of the individual features but the fact that they are tightly integrated. For example, the asset management portion of the system can show users the actual results for each asset in previous campaigns. This makes it much easier for marketers to pick the elements that work best and to make changes during campaigns when some items work better than others. The system can also be integrated with other products through a Web Service API that lets external systems call its functions for AdWords campaign management, conversion definition, activity setup, and reporting.
Technology aside, I was quite impressed with the openness of TraceWorks as a company. The Web site provides substantial detail about the product, and includes a Wiki with what looks like fairly complete documentation. The vendor also offers a 14 day free trial of the system.
Pricing also seems quite reasonable. Headlight is offered as a hosted service, with fees ranging from $1,000 to $5,000 per month depending on Web traffic. According to Dam, the average fee is about $1,300 per month. Larger clients include ad agencies who use Headlight for their own clients.
Incidentally, the company Web site also includes an interesting benchmarking offer, which lets you enter information about your own company's online marketing and get back a report comparing you to industry peers. (Yes, I know a marketing information gathering tool when I see one.) At the moment, unfortunately, the company doesn't seem to have enough data gathered to report back results. Or maybe it just didn't like my answers.
TraceWorks released its original Statlynx product in 2003 and launched Headlight in early 2007. The system currently serves about 500 companies directly and through agencies.
According to TraceWorks CEO Christian Dam, Headlight traces its origins to an earlier product, Statlynx, which measured the return on investment of search marketing campaigns. (This is why Headlight belongs on this blog.) The core technology of Headlight is still the ability to capture data sent by tags inserted in Web pages. These are used to track initial responses to a promotion and eventual conversion events. The conversion tracking is especially critical because it can capture revenue, which provides the basis for detailed return on investment calculations. (Setting this up does require help from your company's technology group; it is not something marketers can do for themselves.)
These functions are now supplemented by functions that let the system actually deliver banner ads, including both an ad serving capability and digital asset management of the ad contents. The system can also integrate with Google AdWords paid search campaigns, automatically sending tracking URLs to AdWords and using those URLs in its reports. It can also capture tracking URLs from email campaigns.
All Web activity tracking may make Headlight sound like a Web analytics tool, but it’s quite different. The main distinction is that Headlight lets users set up and deliver ad campaigns, which is well outside the scope of Web analytics. Nor, on the other hand, does Headlight offer the detailed visitor behavior analysis of a Web analytics system.
The campaign management functions extend both to the planning that precedes execution and to the evaluation that follows it. The planning functions are not especially fancy but should be adequate: users can define activities (a term that Headlight uses more or less interchangeably with campaigns), give them start and end dates, and assign costs. The system can also distinguish between firm plans and drafts. TraceWorks expects to significantly expand workflow capabilities, including sub-tasks with assigned users, due dates and alerts of overdue items, in early 2009.
Evaluation functions are more extensive. Users can define both corporate goals (e.g., total number of conversions) and individual goals (related to specific metrics and activities) for specific users, and have the system generate reports that will compare these to actual results. Separate Key Performance Indicator (KPI) reports show selected actual results over time. In addition, something the vendor calls a “WhyChart” adds marketing activity dates to the KPI charts, so users can see the correlation between different marketing efforts and results. Summary reports can also show the volume of traffic generated by different sources.
The value of Headlight comes not only from the power of the individual features but the fact that they are tightly integrated. For example, the asset management portion of the system can show users the actual results for each asset in previous campaigns. This makes it much easier for marketers to pick the elements that work best and to make changes during campaigns when some items work better than others. The system can also be integrated with other products through a Web Service API that lets external systems call its functions for AdWords campaign management, conversion definition, activity setup, and reporting.
Technology aside, I was quite impressed with the openness of TraceWorks as a company. The Web site provides substantial detail about the product, and includes a Wiki with what looks like fairly complete documentation. The vendor also offers a 14 day free trial of the system.
Pricing also seems quite reasonable. Headlight is offered as a hosted service, with fees ranging from $1,000 to $5,000 per month depending on Web traffic. According to Dam, the average fee is about $1,300 per month. Larger clients include ad agencies who use Headlight for their own clients.
Incidentally, the company Web site also includes an interesting benchmarking offer, which lets you enter information about your own company's online marketing and get back a report comparing you to industry peers. (Yes, I know a marketing information gathering tool when I see one.) At the moment, unfortunately, the company doesn't seem to have enough data gathered to report back results. Or maybe it just didn't like my answers.
TraceWorks released its original Statlynx product in 2003 and launched Headlight in early 2007. The system currently serves about 500 companies directly and through agencies.
Labels:
marketing measurement,
reviews,
software
Subscribe to:
Posts (Atom)
