Escolar Documentos
Profissional Documentos
Cultura Documentos
47 Issue 5
Robert Heath
Bath School of Management
Pam Hyder
Marketing Consultant
This paper is about advertising that works on our emotions without necessarily
achieving high levels of attention or recall. We compare the most popular recall-
based metric – claimed ad awareness – against an approach that deduces
effectiveness from recognition, and find claimed ad awareness seriously
underestimates the effectiveness of the advertising tested.
Introduction
In 1961, in response to Vance Packard’s famous polemic The Hidden
Persuaders, Rosser Reeves (1961) declared: ‘There are no hidden persuaders.
Advertising works openly, in the bare and pitiless sunlight.’ Doubtless
there are some who believe that this is still the case, and that the way
advertising works is totally transparent. But we know a lot more about
how our minds and our brains work than we did 40 years ago, and what
we have learned confirms that advertising, indeed communication in
general, is a far more complex process than we used to think it was.
What complicates everything is not claims or brands or products, but
emotions — specifically, our emotions as consumers. When Rosser Reeves
made his pronouncement it was believed that emotions were a
consequence of our thoughts, and that if we understood what we were
thinking then we understood everything. But pioneers in psychology like
Robert Zajonc and Robert Bornstein shattered this illusion in the 1980s.
They showed that feelings and emotions have primacy over thoughts, and
that emotional responses can be created even when we have no awareness
of the stimulus that causes them. More recently, Antonio Damasio (1994)
has proved that our emotions are critical to decision-making; and in
another area of psychology, work by Daniel Schacter and others has
demonstrated that learning can take place even when we pay no attention
whatsoever, and that this learning can interact with our emotional memory
stores (Schacter 1996).
All this points to advertising having far more power than we think it
has. In general we do not think it affects us very much, if at all. A poll of
American consumers conducted by Cap Gemini Ernst & Young in 2003
found 82% of US consumers did not believe that advertising influenced
their decision to buy a car, which CGE&Y used as evidence that car
manufacturers are wasting money on ads (Financial Times 2003).
However, 13 years of IPA Advertising Effectiveness Awards have proved
beyond doubt that advertising affects us, whether we believe it or not. So
how is it that consultancies like CGE&Y can make such a patently naïve
claim, suggesting that what consumers believe represents the sum of truth
about how advertising works?
We think the explanation arises from the way in which advertising is
evaluated. Although our knowledge of how advertising works has changed
considerably, the measures we generally use to measure it have not. We still
rely on survey data that ask people their opinions of advertising. We still
use questions that invite people to recall things they have no reason at all
to remember. And in many cases we evaluate success using metrics whose
origins can be tracked back to the early part of the 20th century.
We believe it is time to initiate an investigation into the current approach
to advertising evaluation. We focus in this paper on recall measures, and
within these we investigate in detail one of the most commonly used
metrics: claimed ad awareness. We test this against a different approach to
measuring the emotional influence of advertising, and unearth some
interesting discrepancies. We would like to stress that neither of us has any
connection with any company in the research industry, and we present this
paper as research buyers not research sellers. We hope you will agree that
our investigation has produced some important conclusions.
468
International Journal of Market Research Vol. 47 Issue 5
469
Measuring the hidden power of emotive advertising
470
International Journal of Market Research Vol. 47 Issue 5
But has anyone actually checked how valid these recall-based metrics
are? Common sense suggests that advertising will work best if we
remember it, but does this mean that advertising works less well if we
don’t remember it? Evidence that we may be wrong to place so much faith
in these types of metrics comes from Leonard Lodish’s massive meta-
analysis of 389 split cable TV advertising experiments using the
Behaviorscan® panel. Lodish and Abraham concluded that, ‘It is unlikely
there is a strong relationship between standard measures of TV
commercial recall … and sales impact of the copy’ (Lodish & Abraham
1995).
So what is the case against the use of recall-based metrics? And, more
specifically, how well do they evaluate emotive advertising?
471
Measuring the hidden power of emotive advertising
472
International Journal of Market Research Vol. 47 Issue 5
473
Measuring the hidden power of emotive advertising
Processing Model, which caused confusion in the USA with models that
use involvement to refer to product or category involvement.
The Low Attention Processing Model can be summarised as follows.
474
International Journal of Market Research Vol. 47 Issue 5
475
Measuring the hidden power of emotive advertising
The value of using recognition is that it taps into both explicit and
implicit memory, which means we can get a much better idea of the actual
level of advertising exposure that has taken place. By identifying those
people who have seen the advertising and subsequently forgotten it we
should be able to test directly how effective recall is at evaluating emotive
advertising.
476
International Journal of Market Research Vol. 47 Issue 5
A single wave of research was run on the Taylor Nelson CAPI Omnibus
three weeks after national transmission of the advertising had started.
Favourability towards the brand was measured using a ten-point semantic
scale ranging from ‘very unfavourable’ to ‘very favourable’. Claimed ad
awareness was asked using the brand-name prompted question alluded to
earlier: ‘Have you seen any advertising on TV recently for (brand)?’ Those
who answered in the affirmative were then asked to describe anything they
could recall about the advertising. Recognition was measured by playing
the ad in full to respondents. In order to minimise overclaim through
expectation of the brand advertising, the ad was adapted to remove all
reference to the brand, and respondents were asked if the advertising had
been seen by them several times, once or twice, or not at all.
It should be noted that this definition of recognition differs from that
which is often quoted by ad research companies. For example, Max
Sutherland defines recognition as ‘People … shown photo-stills and asked
whether they have seen that ad’, an approach that can result in poor
recognition if a key element in the advertising is sound or music or action
of some sort (Sutherland 2000). Recognition can be accurately assessed
only by showing the entire ad as stimulus, and in our test we removed only
the brand references, which was necessary in order to preclude responses
based on an expectation that the advertising would have been seen.
Results
Because brand users rate their brands higher than non-users, analysis was
restricted to users of dog food who were non-users of the Butchers Dog
brand. This avoids errors due to different proportions of users and non-
users in each part of the sample. Thus all results shown are from users of
other brands.
The first step was to examine the exposure levels as predicted by the two
metrics, and a cross-tabulation of the sample of 318 respondents is shown
in Table 1.
477
Measuring the hidden power of emotive advertising
478
International Journal of Market Research Vol. 47 Issue 5
479
Measuring the hidden power of emotive advertising
saw the ad only once or twice (column B), or those who did not see the ad
at all (column A). Unfortunately the sample size of the cells A, B and C is
too small to allow significance to be tested. But if we combine columns A
and B we can compare those who did not see an ad or saw one only once
or twice with those who saw an ad several times. The differences are now
significant: an ANOVA reveals the difference in mean favourability
between these two groups (columns A + B and C) is significant at 99%
[F (468) = 7.24, p < 0.009].
The explanation is now clear. Those who claimed they had seen the
brand advertised comprised two different groups: one had been exposed to
the advertising once or twice or not at all, and had not been affected by it;
the other had been exposed to the advertising several times, and had been
affected by it. In summary, as the Low Attention Processing Model
predicts, claimed ad awareness produced a sample whose consistency in
respect of their actual exposure and response to the advertising was
seriously flawed.
This study was the first one conducted. In order to validate the findings
we decided to repeat the study, this time with advertising specifically
designed to exploit the Low Attention Processing Model in the way it
influenced consumers’ feelings.
480
International Journal of Market Research Vol. 47 Issue 5
CAPI results
The first wave of CAPI research was run 11 days after the start of
advertising. As in the pilot research our first step is to examine the sample,
which is shown in Table 5.
Once again it is evident that claimed ad awareness under-represents the
actual exposure of the campaign. Some 27% claimed that Standard Life
had been advertised on TV recently, compared with 65% who recognised
and can therefore be deemed to have actually seen the advertising. And
37% of those who claimed Standard Life had been advertising (18 out of
48 respondents) did not recognise the new campaign at all.
Next we analyse favourability among those who claim the brand has and
has not been advertised on TV recently. These results are shown in Table 6.
This time we see that the favourability score among those who claim the
brand had advertised recently is actually lower than among those who
claim the brand has not advertised recently. Again, the clear implication is
that the advertising has not worked.
Now compare these results to the analysis of recognition, in Table 7.
481
Measuring the hidden power of emotive advertising
Again we see that those non-users who recognise the advertising are
more favourably disposed towards Standard Life than those who do not.
In this case, however, the favourability among those who have seen the ad
several times is not higher. The conclusion is that this advertising either
works very quickly, or perhaps needs a longer exposure period than the
dog food advertising. We address this point later on.
The final analysis of the CAPI data is a cross-tabulation of those who
claim the brand was advertised recently against recognition, and the
results are shown in Table 8.
Again we see that the low favourability score among those who claimed
that the brand had been advertising on TV recently is caused by the 37%
who had not actually seen the advertising. Their mean favourability is
4.99, compared with a mean favourability of 6.21 among those who
recognised the ad.
CATI results
By running a telephone survey alongside the CAPI survey we were able to
see how the recognition, claimed ad awareness and favourability changed
over time. A graph of the results is shown in Figure 1.
Recognition and claimed ad awareness both rise during the initial heavy
burst of advertising. However, when the advertising weight drops at the
end of week five we see claimed ad awareness starts to fall. In contrast, the
recognition measures stay at roughly the same level.
This timing differential is important. The trend in claimed ad awareness
is suggesting that the advertising’s effectiveness starts immediately, rises
evenly, peaks around the end of the heaviest burst, then declines when the
lighter drip campaign starts. The conclusion that would be drawn from
this trend is that the advertising has little long-term effect, and needs to be
held at the higher weight in order to have any effect. But when we look at
favourability we find a different trend. Favourability does not move until
the end of the burst, at which point it rises and stays permanently higher.
482
International Journal of Market Research Vol. 47 Issue 5
Mean favourability
50 48 % 5.20
44 %
%
40 5.00
30 4.80
27 %
4.60
20
4.40
10 4.20
TV
0 4.00
1 2 3 4 5 6 7 8 9 10
Weeks
Discussion of results
The results support the theory that advertising which relies upon affect
(i.e. that mainly influences emotions and feelings) is likely to benefit from
longer periods of repeat exposure. It also supports the hypothesis that
recall-based metrics such as claimed ad awareness are likely to seriously
underestimate the effectiveness of advertising that relies on affect. What
does this imply for the research industry?
The question ‘Have you seen brand X advertised on TV recently?’ is one
that we who work in the industry instinctively like and understand. We
can answer it easily and accurately, because we pay attention to adverti-
sing: it is, after all, what pays our wages. The results above suggest that
the clarity with which we can answer this and similar questions is not
always shared by consumers. Ordinary people, who watch TV as part of
their day-to-day routine, almost certainly pay a lot less attention to TV
483
Measuring the hidden power of emotive advertising
Conclusions
We believe the findings of this paper call into question the value both of
recall metrics and continuous tracking research. The continuous collection
of data in tracking research is needed primarily in order to collect recall-
based metrics such as claimed ad awareness, but this type of metric has
been shown to provide confusing and misleading findings for advertising
with a high emotive content. Under the circumstances we conclude that
continuous research is unnecessarily costly: the findings derived from the
periodic studies we used were more accurate and informative, and
considerably less expensive.
Overall, we conclude that methods based upon the periodic measure-
ment and cross-analysis of recognition and brand metrics represent a
better future direction for advertising research, because they are uniquely
able to evaluate the hidden emotional power that advertising undoubtedly
has.
However, there is one caveat. It should be noted that these tests were
conducted on advertising selected for having a high affective content.
Although low-attention processing is applied by the consumer to all
advertising, it is important to stress that the model does not necessarily
apply to all advertising. It will not be as relevant to advertising whose
main purpose is to get a direct response, or advertising that is trying to
impart ‘new news’, as both of these types of advertising will benefit by
achieving the highest level of attention they can. It is possible that the use
484
International Journal of Market Research Vol. 47 Issue 5
References
Ambler, T. (2000) Persuasion, pride and prejudice: how ads work. International
Journal of Advertising, 19, p. 299.
Barclay, W.D., Doub, M.R. & McMurtrey, L.T. (1965) Recall of TV commercials by
time and program slot. Journal of Advertising Research, 5, 2, p. 41.
Barnard, N. (1994) What can you do with tracking studies and what are their
limitations? Admap, April, pp. 1–26.
Broadbent, T. (2000) Advertising Works 11. Henley-on-Thames: World Advertising
Research Center.
Brown, G. (1985) Tracking sudies and sales effects: a UK perspective. Journal of
Advertising Research, Feb./March, pp. 56, 57.
Brown, G. (1986) Modelling advertising awareness. The Statistician, 35, p. 286.
Colman, S. & Brown, G. (1986) Advertising tracking studies and sales effects.
Journal of the Market Research Society, 25, 2.
Damasio, A.R. (1994) Descartes’ Error. New York: G.P. Putnam.
Damasio, A.R. (2000) The Feeling of What Happens. Heinemann.
Doyle, P. (1994) Marketing Management and Strategy. Hemel Hempstead: Prentice-
Hall, p. 240.
Eysenck, M.W. & Keane, M.T. (2000) Cognitive Psychology, 4th edn. Hove:
Psychology Press, p. 181.
Feldwick, P. (2002) What is brand equity, Admap, 430, July.
Feldwick, P., Cook, L. & Carter, S. (1991) Ad effectiveness and ad awareness.
Admap, March, p. 22.
Financial Times (2003) 14 October.
Fitzgerald, N. (1998) A man with a mission. Interview by Judie Lannon. Market
Leader, 2, Autumn, p. 22.
Haley, R.I. & Baldinger, A.L. (1991) The ARF Copy Research Validity Project.
Journal of Advertising Research, 31, 2, p. 30.
Heath, R.G. (1993) Reassuringly expensive – a case history of the Stella Artois press
campaign, in Advertising Works 7, Baker, C. (ed.). Henley-on-Thames: NTC
Publications.
Heath, R.G. (2001) The Hidden Power of Advertising. Admap Monograph No. 7.
Henley-on-Thames: World Advertising Research Center.
Hofmeyr, J. & Rice, B. (2000) Commitment-led Marketing. Chichester: Wiley.
Kotler, P., Armstrong, G., Saunders, J. & Wong, V. (1999) Principles of Marketing,
2nd European edn. Prentice-Hall, p. 668.
Krugman, H.E. (1971) Brain wave measurement of media involvement. Journal of
Advertising Research, 11, 1, Feb., pp. 3–9.
Krugman, H.E. (1977) Memory without recall, exposure without perception.
Journal of Advertising Research, 17, pp. 52–53.
485
Measuring the hidden power of emotive advertising
486