Escolar Documentos
Profissional Documentos
Cultura Documentos
INTRODUCTION
to: martin.giurfa@univ-tlse3.fr
1 Centre
2 Centre
wires.wiley.com/cogsci
Advanced Review
(a)
Toothpick with
sucrose
Harnessed
bee
CS
US
(b)
Computer
Light
Torque source
meter
Color filter
Light
guides
Electronic
motor
Diffusor
Arena position
FIGURE 1 | (a) Pavlovian olfactory conditioning of the proboscis extension response (PER) in restrained honeybees. Left panel: an individual bee
is immobilized in a metal tube so that only the antennae and mouth parts (the proboscis) are free to move. The bee is set in front of an odorant
stimulation setup which is controlled by a computer and which sends a constant ow of clean air to the bee. The air ow can be rerouted through
cartridges presenting chemicals used for olfactory stimulation (conditioned stimuli or CS). Sucrose solution (unconditioned stimulus or US) is delivered
by a toothpick to the antennae and to the proboscis. Right panel: After conditioning, the odor CS, which initially did not evoke any response, triggers
the PER. (b) Operant visual conditioning of a tethered fruit y (courtesy of B. Brembs). Left panel: A Drosophila is ying stationary in a cylindrical
arena. The ys tendency to perform left or right turns (yaw torque) is measured continuously and fed into a computer, which controls arena rotation.
On the screen four landmarks, two Ts and two inverted Ts, are displayed in order to provide a referential frame for ight direction choice. A heat
beam focused on the ys thorax is used as an aversive reinforcer. The reinforcer is switched on whenever the y ies toward a prohibitive direction.
The y controls therefore reinforcer delivery by means of its ight direction. Right panel: Detail of a tethered y in suspended ight within the ight
simulator.
simple associative links to specific neurons and circuitries. Yet, the last decade has generated a wealth
of novel research on insect learning and memory
which has overcome the classical framework of simple forms of associative learning to focus on more
elaborate cognitive capabilities.1,2 This includes work
on attention-like processes in fruit flies and honey
bees,20,21 observational learning in a social context
in bees, crickets and flies,2227 individual recognition
in wasps,2830 categorization,31 concept learning3234
and meta-cognitive like processes in bees.35 These
reports yield new light on the cognitive richness of
insect behavior, which appears to transcend basic
Pavlovian and operant learning. Here, I focus on a
selection of recent findings on learning and cognition
in insects and discuss whether behaviors that appear
particularly complex can be explained on the basis
Operant Conditioning
Operant learning underlies the extensive studies on
visual learning and perception in bees performed in the
last 100 years, since the pioneer work of Nobel-prize
winner Karl von Frisch.41 A free-flying bee, identified by a color spot on the thorax or abdomen,
can be trained to choose a visual target associated
with the appetitive reinforcement of sucrose solution.
The associations built in these context can be either
operant, classical or both, i.e., they may link the
response of the animal (e.g., landing) and the reinforcement, the visual stimuli and the reinforcement,
or both. The experimental framework is nevertheless mainly operant as the bee freely decides where
and when to land to obtain the sucrose. The bees
behavior is thus determinant for accessing or not the
reinforcement.
The fruit fly has also played a pivotal role
for the study of operant learning. In this case, a
Drosophila is suspended from the thorax in the middle
of a cylindrical arena that allows the presentation
of visual landmarks (Figure 1(b)).42 The tethered
fly flies stationary and if some of these landmarks
are paired with the aversive reinforcement of an
unpleasant heat beam pointed on the thorax, the fly
learns to fly toward a safe direction, avoiding the
dangerous-landmark directions42,43 (Figure 1(b)). The
fly learns to control reinforcement delivery as its flight
manoeuvres determine the switching-off of the heat
beam if the appropriate flight directions are chosen,43
thus constituting a case of operant learning. Classical
associations can also be established between the visual
landmarks displayed on the cylinder wall and the
reinforcer.44 In another operant protocol, the heat
box, a Drosophila fly has to learn to avoid the half
of a small dark chamber that is heated every time
the fly walks in.45,46 As soon as the animal leaves
the punished half, the chamber temperature reverts
to normal. Flies learn to restrict their movements to
one-half of the chamber, even in the absence of heating
punishment. This memory is still detectable even if the
fly is taken out of the chamber and then tested 2 h
later.46
In the blood-sucking insect Rhodnius prolixus,
PER is induced by thermal stimulation close to that
of the skin surface of potential vertebrate hosts (35 ).
Operant inhibition of PER was shown by making
a thermal shock contingent with PER.47 Bugs that
responded with PER to a thermal stimulation of 35 C
received a heat shock on the extended proboscis by
increasing the temperature to 50 C; in this way, bugs
stopped responding with PER to thermal stimulation and retained the operant association up to 72 h
later.47
wires.wiley.com/cogsci
Advanced Review
A CHANGE OF PARADIGMS
In the nineties, research on insect learning and memory experienced a significant change; beyond simple associative learning, based on protocols such as
those described above, some researchers started focusing on the possibility that insects exhibit higher-order
forms of learning. The cognitive revolution, which
had already impacted long before the field of animal
learning48 and introduced the view that animals are
goal-seeking agents that acquire, store, retrieve, and
internally process information at many levels of cognitive complexity, reached with a certain delay the
field of insect learning and memory. A change in conceptual approaches followed, not only because insects
were not anymore considered as miniaturized robots
exhibiting reduced plasticity, but because novel questions focusing on cognitive capacities, whose study
had remained the exclusive domain of vertebrates,
started to be raised and answered experimentally.
What follows is a series of examples which do not
pretend to be integral but rather illustrative of these
questions.
ATTENTIONAL PROCESSES IN
INSECT PERCEPTION
Several reports have indicated that attentional processes, similar to those described in vertebrates, can
also be identified in insects. Studies on bumblebee
and honey bee color learning49,50 suggested that attentional processes may dramatically affect discrimination capabilities and that the key issue is how the
bees learn the visual task.51 The role of attention in
visual object recognition has been explicitly studied in
honey bees trained to choose a colored disc (target)
among a varying number of differently colored discs
(distracters).21 Accuracy and decision time were measured as a function of distracter number and color. For
all color combinations, decision time increased and
accuracy decreased with increasing distracter number,
whereas performance improved when more targets
were present. Similar results are found in studies on
visual attention in which primates inspect visual stimuli sequentially. This convergence suggests that serial
visual attention is common to mammals and bees.21
Visual attention has also been studied in fruit
flies.20 A tethered fly flying stationary within a cylindrical arena (similar to that in Figure 1(b)) and tracking a visual object (a vertical black bar displayed on
the cylinder wall) moving at a constant frequency
around it, exhibits anticipatory behavior consistent
with attention for the bar it tracks. In another work,
competing moving gratings were presented to either
(a)
80
(b)
***
Demonstrator (CS1)
60
40
***
Feeder (US)
20
Demonstrator (CS1)
0
First trial
(c)
Observer
1st phase
Subsequent choice
of alternative feeder
Observer
2nd phase
CS1
CS2
Novel feeder
Color/odor (CS2)
US
FIGURE 2 | Social learning in bumblebeesan elemental account. Percentage of choices by observer bees of a feeder occupied by a
demonstrator bee. The arena contained eight feeders, four blue, and four yellow. The demonstrator was placed on one feeder type, yellow or blue,
and the observer released in the arena. Right bar: Choices of the feeder occupied by a demonstrator in the rst trial, when both feeder types were
unfamiliar to observers. Left Bar: Choices of the alternative feeder type in subsequent trials when it was occupied by a demonstrator. The dashed line
corresponds to a random choice in a situation where eight feeders were available. Asterisks correspond to P < 0.01. (Reprinted with permission from
Ref 24. Copyright 2005 Cell Press). (b) Possible associations established by bumblebees during social learning in a foraging context. During direct
interactions with demonstrators, observers experience nectar reward (US; green arrow) and associate demonstrators (conditioned stimulus 1 or CS1)
with the US (red arrow); if demonstrators come to choose a novel feeder (here with a different color), observers will also land on the novel occupied
feeder and will associate the physical properties of the owers that demonstrators now exploit (CS2) with the demonstrators themselves (CS1; red
arrow). The process postulated corresponds to a case of second-order conditioning. (c) Nature of associations established during the two phases of a
second-order conditioning process.
wires.wiley.com/cogsci
Advanced Review
cues might well be possible given the high dimensionality of olfactory coding in Hymenoptera.63 For
instance, unrelated queens of the ant Pachycondyla villosa use chemical cues to recognize each other individually, thereby modulating aggression depending on the
degree of familiarity existing between them. This modulation remains in choice experiments in which physical contact, but not odor perception, was prevented,64
thus showing the olfactory nature of the interindividual recognition.
In the visual modality, studies on the paper wasp
Polistes fuscatus showed that individual recognition is
achieved through learning the yellowblack patterns
on the wasp faces (the so-called masks) and/or
abdomens, which act as efficient labels of social
hierarchy.29 Altering facial and/or abdominal color
patterns induced aggression, irrespective of whether
their patterns were made to signal higher or lower
social ranking. These results indicate, therefore, that
individual wasps learn and use these visual features for
inter-individual recognition.30 Recently, a new twist in
this story was introduced by comparing two closely
related wasp species, P. fuscatus and P. metricus,
which differ in their social structure and ability to
recognize wasp faces28 : P. metricus, contrary to P.
fuscatus, nests alone, does not present facial-mask
variability and as a consequence does not exhibit
individual recognition. Individuals of both species
were trained to discriminate images within a small
T-maze in which incorrect choices were punished with
an electric shock delivered though an electrified floor.
Images included photos of different P. fuscatus faces,
different caterpillars, and black and white patterns
such as vertical and horizontal gratings, a cross, and
a concentric ring pattern.28 While P. fuscatus wasps
differentiated among normal P. fuscatus face images
more rapidly and accurately than nonface images or
manipulated faces, P. metricus, was unable to learn
this discrimination. Interestingly, both species learned
to discriminate caterpillar images and abstract pattern
images but in the case of P. fuscatus such learning
yielded lower discrimination when compared with
face discrimination. These data suggest that P. fuscatus
do not use general pattern- or shape-discrimination
abilities, which are also present in P. metricus, to
recognize conspecific faces. Instead, faces appear to be
treated as unique visual inputs by P. fuscatus, resulting
in improved discrimination performances.28 Yet, the
comparison with abstract patterns which were learned
less well than wasp faces to sustain the conclusion
of a specialized face recognition system is debatable:
the patterns chosen (i.e., a cross vs a grating) did
not facilitate visual recognition as they stimulated
common neural detectors (i.e., a vertical orientation
Sameness/Difference Concepts
The learning of the concepts of sameness and difference was demonstrated through the protocols of
delayed matching to sample (DMTS) and delayed nonmatching to sample (DNMTS), respectively.32 In the
former, the subject must match its choice to a stimulus that corresponds to a sample previously presented.
As the sample is regularly changed during the training, animals must learn the concept of sameness, i.e.,
always choose what is shown (the sample), independently of what else is shown. In the latter, the subject must choose a stimulus that is explicitly different
from a sample previously presented. As the sample is
regularly changed during the training, animals must
learn the concept of difference, i.e., always choose the
opposite of what is shown (the sample), independently
of what else is shown.
Honey bees foraging in a Y-maze (Figure 3(a))
were trained in a DMTS experiment in which they
were presented with a changing nonrewarded sample (i.e., one of two different color diskscolor
groupor one of two different black-and-white gratings, vertical or horizontalpattern group) at the
entrance of a maze (Figure 3(b)). The bees were
rewarded only if they chose the stimulus identical
to the sample once within the maze. Bees trained
with colors and presented in transfer tests with
black-and-white gratings that they had not experienced before solved the problem and chose the grating identical to the sample at the entrance of the
maze. Similarly, bees trained with the gratings and
tested with colors in transfer tests also solved the
problem and chose the novel color corresponding
to that of the sample grating at the maze entrance
(Figure 3(c)). Transfer was not limited to different
types of visual stimuli (pattern vs color), but could also
operate between drastically different sensory modalities such as olfaction and vision.32 Bees also mastered a DNMTS task, thus showing that they learn
a rule of difference between stimuli as well.32 These
results were the first to document that bees learn rules
relating stimuli in their environment. They were later
verified in experiments showing that bees categorize
visual images based on general features common to
these images72 and in a study showing that the sensory
wires.wiley.com/cogsci
Advanced Review
(a)
(b)
Transfer
test
(c)
100
Preference for vertical
Preference for horizontal
Training
(60 trials)
% correct choices
80
Vertical
Horizontal
60
40
20
0
Pattern
group
Colour
group
Blue
Yellow
Sample
FIGURE 3 | Sameness learning in honey bees. (a) Y-maze used to train bees in a delayed matching-to-sample task. Bees entered into the maze to
collect sugar solution on one of the back walls of the maze. A sample was shown at the entrance before bees accessed the arms of the maze. (b)
Training protocol. A group of bees were trained during 60 trials with black-and-white, vertical and horizontal gratings (Pattern Group); another group
was trained with colours, blue and yellow (Colour Group). After training, both groups were subjected to a transfer test with novel stimuli (patterns for
bees trained with colours, colours for bees trained with patterns). (c) Performance of the Pattern and the Colour Group in the transfer tests. Both
groups chose the novel stimulus corresponding to the sample although they had no experience with such test stimuli. (Reprinted with permission
from Ref 32. Copyright 2001 Nature Publishing Group, Macmillan Publishers Limited).
Above/Below Concepts
For many animals that must navigate in complex natural environments, spatial concepts such as right, left,
above, and below are of crucial importance to generate appropriate relational displacements and orientation in their environment. A recent work studied
whether honey bees learn an above/below relationship between visual stimuli and transfer it to novel
stimuli that are perceptually different from those used
during the training.33 Bees were trained to fly into
a Y-maze and choose visual stimuli presented above
or below a horizontal bar. Training followed a differential conditioning procedure in which one spatial
relation (e.g., target above bar) was associated with
sucrose solution whilst the other relation (e.g., target below bar) was associated with quinine solution.
One group of bees was rewarded on the target above
bar relation while another group was rewarded on
the target below bar relation. After completing the
training, bees were subjected to a nonrewarded transfer test in which a novel, discriminable target stimulus
(not used during the training) was presented above or
below the bar. Despite the novelty of the test situation,
which preserved the spatial relationship to the bar
as the single criterion predicting or not the presence
METACOGNITIVE-LIKE PROCESSES
IN HONEY BEES
If cognition can be considered as the ensemble of
faculties that refer to internal representations or
context-dependent memories that reflect these contents, metacognition may be considered as the knowledge of these contents (i.e., the knowing to know).76
Cognitive behavioral biology has focused on
metacognition as a fundamental way to determine
whether animals perform introspective evaluation of
their knowledge before engaging or not in a difficult
task.76 The questions addressed by this research are:
can an animal report on its own degree of confidence
in its behavior, for example by choosing the level of
risk or nonrisk in its responses? Can it show that
it does not know through active research for more
information?
While metacognitive research has shown that
nonhuman vertebrates (mostly primates) selectively
avoid taking difficult tests of memory or perception, collect more information if needed before
taking tests, or gamble more food reward on correct than on incorrect responses in tests of memory
and perception,76,77 a single study has addressed
so far the question of whether an insect may display
metacognitive-like processes.35 Not surprisingly, given
the performances described in the previous section,
the insect chosen was the honey bee.
Bees were trained to solve the above/below
conceptual discrimination (see above), which varied
in difficulty between trials (the images mediating the
relationship were clearly apart or very close to each
other in the vertical plane; Figure 4). Free-flying bees
were rewarded for a correct choice, punished for an
incorrect choice, or could avoid choosing by exiting
the trial (opting out). Bees opted out more often
on difficult trials, and opting out improved their
proportion of successful trials. Bees could also transfer
wires.wiley.com/cogsci
Advanced Review
(a)
Easy
Difficult
Impossible
Difficulty tests
with novel targets
Novel target
below
Target below
Punishment
Reward
Target above
Reference bar
0.6
0.4
0.2
1
Exit of decision
chamber
Reference bar
Target
below
Block of 5 trials
(training)
Training
above/below
conceptual rule
30 trials
Punishment
Transfer impossible
Target above
Reward
0.8
Transfer difficult
1.0
Transfer easy
Transfer test
with novel
targets
(b)
Transfer test
Novel target
below
FIGURE 4 | Metacognitive-like processes in honey bees. (a) Experimental schedule. During the training, a horizontal black bar was used as the
reference to dene the above/below relationship. Targets were the same on both sides but variable between the 30 training trials. Reward (2 M
sucrose) or punishment (quinine) was placed in a translucent microcentrifuge tube in the center of the targets. Within a trial, stimulus pairs were
identical except for vertical position relative to the reference bar and relative to the bottom of the chamber. Between trials, targets and positions of
targets and reference bars were varied so that bees could only learn the above/below relation of targets to the references as predictors of reward. In
the example shown, the above relationship was rewarded and the below relationship punished. The transfer tests were unrewarded and used a novel
target not used during the training. In the difculty tests, the easiness of the discrimination was varied by changing the distance between the target
and the horizontal of the reference bar. For easy trials, the target was clearly above or below the reference bar and did not overlap with the reference
bar. For difcult trials, targets partially overlapped with the reference bar. For impossible trials, the center of both targets was in line with that of the
reference bar. (b) Performance of bees. Proportion of correct choices as a function of blocks of ve training trials (training) and performance in
nonrewarded transfer test (red bar). Performance on tests varying in difculty is also shown (green bars). Bees performed better on easy
(83.8 2.5%) than on difcult (52.4 2.5%) or impossible tests (44.5 7%) tests. (Reprinted with permission from Ref 35. Copyright 2013 National
Academy of Sciences).
CONCLUSION
The present review highlights novel studies on insect
associative learning which in most of the cases had
the intention of transcending the traditional framework of research on simple stimulusstimulus (or
behaviorstimulus) associations. They are all inscribed
within a relatively new tendency of appreciating the
cognitive sophistication of the insect brain.1,7882 Such
a tendency is welcome in a field where focus on simple
learning forms may have sometimes overlooked the
enormous richness of insect behavior. Yet, as underlined in this article, not all the feats presented as
highly cognitive are in fact distinct from nonelemental
learning forms. A fundamental goal in conceiving and
interpreting complex insect behavior is therefore, to
critically determine whether basic levels of interpretation are possible and to what extent they account for
plastic insect behavior. Focusing on the neural bases of
insect higher-order learning is certainly a way to avoid
such a caveat as the characterization of neural architectures should constitutes a dispassionate endeavor.
The study of simple learning forms in insects,
both appetitive and aversive, has yield light on how
neural circuits interact to produce plastic behavior
and which functional and structural changes occur at
different stages of these circuits to support elemental
NOTES
a
b
c
ACKNOWLEDGMENTS
This work was supported by the Institut Universitaire de France, the French National Research Agency
(ANRMINICOG), and the Human Frontier Science Program (HFSP).
REFERENCES
1. Chittka L, Niven J. Are bigger brains better? Curr Biol
2009, 19:R995R1008.
2. Avargus-Weber A, Deisig N, Giurfa M. Visual cognition in social insects. Annu Rev Entomol 2011,
56:423443.
doi:10.1146/annurev-ento-120709144855.
3. Matsumoto Y, Mizunami M. Olfactory learning in
the cricket Gryllus bimaculatus. J Exp Biol 2000,
203:25812588.
4. Giurfa M. Behavioral and neural analysis of associative
learning in the honeybee: a taste from the magic well.
J Comp Physiol A 2007, 193:801824.
5. Menzel R. Memory dynamics in the honeybee. J Comp
Physiol A 1999, 185:323340.
6. Dupuy F, Sandoz JC, Giurfa M, Josens R. Individual
olfactory learning in Camponotus ants. Anim Behav
2006, 72:10811091.
7. Daly KC, Smith BH. Associative olfactory learning in the moth Manduca Sexta. J Exp Biol 2000,
203:20252038.
8. Vergoz V, Roussel E, Sandoz JC, Giurfa M. Aversive learning in honeybees revealed by the olfactory
conditioning of the sting extension reflex. PLoS One
2007, 2:e288.
9. Davis RL. Olfactory memory formation in Drosophila:
from molecular to systems neuroscience. Annu Rev
Neurosci 2005, 28:275302.
10. Fiala A. Olfaction and olfactory learning in Drosophila:
recent progress. Curr Opin Neurobiol 2007,
17:720726.
11. Keene AC, Waddell S. Drosophila olfactory memory:
single genes to complex neural circuits. Nat Rev Neurosci 2007, 8:341354.
12. Busto GU, Cervantes-Sandoval I, Davis RL. Olfactory
learning in Drosophila. Physiology (Bethesda) 2010,
25:338346.
13. Guven-Ozkan T, Davis RL. Functional neuroanatomy
of Drosophila olfactory memory formation. Learn Mem
2014, 21:519526.
14. Davis RL. Traces of drosophila memory. Neuron 2011,
70:819.
wires.wiley.com/cogsci
Advanced Review
FURTHER READING/RESOURCES
Giurfa M. Cognition with few neurons: higher-order learning in insects. Trends Neurosci 2013, 36:285294.
doi:10.1016/j.tins.2012.12.011.
North G, Grenspan RJ. Invertebrate Neurobiology. Cold Spring Harbor Monograph Series 49. New York: Cold Spring
Harbor Laboratory Press; 2007.