Escolar Documentos
Profissional Documentos
Cultura Documentos
The
Bl
Oxfo
SOC
So
17
©
J
10.
062
No
2
0
298
Orig ?Distribution
o8 urnal
ackw
51-9020
2007
1?
cio
vem
1111/
inal
?
Ord,
l?
o ber
gel
CT
UK
j
yArt
.lohe
17Publ
C
m2007
icl ofrnSocial
51-9020.
oAut
pmil
es
ishing
at
pass
hoio ©
2007
Lt
2007Fluency
d .00062.
Blac xkw ellPublishing Ltd
Abstract
Expert knowledge is an essential component of modern society. It is also a
potentially difficult topic for sociology because of the importance sociology attaches
to culture and context. The sociology of science has emphasised the continuity
between scientific expertise and more traditional forms of knowledge. Whilst this
suggests an increasing ‘democratisation of expertise’ is desirable, it also risks
erasing the idea of expertise itself. This might be particularly detrimental for
sociology as it restricts the role of sociological inquiry to examining how expert
status is attributed rather than understanding what expertise is. This paper
describes these developments and contrasts them with other approaches in which
expertise appears less important. It concludes by setting out a new approach
to expertise that respects the role of culture in generating knowledge but, by
stressing the importance of socialisation and experience, argues for a more
nuanced conception of expertise as both real and unequally distributed.
Introduction
Expertise is an important topic for sociology. The reason is that the social
constructivist perspective favoured in much contemporary sociology tends
to see all manner of characteristics – gender, ethnicity, identity and so on
– as the product of particular cultures and contexts. The sociology of
science and technology has shown that the same claims can also be made
about scientific knowledge, thus undermining the claim that science is a
unique and different form of expert knowledge (see, for example, Bloor
1976, Mulkay 1979, Collins 1992). The consequences of this are potentially
far reaching and controversial, as the polemics by Gross and Levitt (1994)
and Koertge (2000) demonstrate. Nevertheless, if the sociologists are correct,
and scientific knowledge is the property and product of particular social
groups, then the study of expertise, its legitimation and its use become
key topics for social science (see, for example, Epstein 1996; Gieryn 1999;
Irwin and Wynne 1996; Jasanoff 1990, 2005; Welsh 2000; Wynne 1982).
Moreover, to the extent that the recognition and use of expertise is
contingent on particular cultural contexts, then the possibility must exist
© 2008 The Author
Journal Compilation © 2008 Blackwell Publishing Ltd
282 The Distribution of Social Fluency
that the outcome could have been different and sociological analysis opens
the door to a more critical debate about the ways in which knowledge
and power are interlinked.
While the sociological urge to deconstruct and contextualise has its
value, it also has a significant blind spot when dealing with expertise.
Constructivism invariably sees expertise as a relational attribution in
which you acquire the status of an expert by virtue of your position in a
network of social relations (Eriksson 2004; Gieryn 1999). This makes the
social science of expert status a primarily retrospective analysis that must
wait for the dust to settle before explaining how each group ended up
where they did. What this perspective does not provide is a position from
which the sociologist of expertise can intervene during the debate itself.
Instead, the conclusion drawn is that the attribution of expertise and
credibility emerge from a social process that invariably reflects the dominant
interests rather than those of the wider society. The normative prescription,
if there is one, is to give those currently marginalised a greater voice in
these debates (Nowotny et al. 2001; Wilsdon and Willis 2004).
This message has clearly been heard and is reflected in a range of
policy documents and initiatives stressing the importance of public
participation. In the UK, the most high-profile expression of this influence
was the GM Nation? debate held in 2003 (see Department of Trade and
Industry 2003; Horlick-Jones et al. 2007). Paradoxically, however, it is
this increase in participation that reveals the importance of retaining the
idea of expertise as something more than an attribution made by others.
For example, if (as is typically the case) widening participation is
predicated on the knowledge of lay citizens, then this knowledge must
be qualitatively different from the expertise held by subject specialists.
If this is not the case, then it is unclear what including the new
participants adds to the deliberations. This is not to say that one kind
of knowledge should be prioritised over the other, but it does suggest
that, in thinking about the role of different communities in relation to
complex or controversial policy issues, it is important to consider the
kinds of knowledge they can or cannot contribute.
In the remainder of this article, the rationale behind the constructivist
position is briefly outlined, drawing mainly on the science and technology
studies (STS) literature. By tracing the development of this perspective
and its move from laboratory sciences to more public settings, I show how
and why it makes sense to stress the cultural contingency of all knowledge,
including science, and why the boundaries between expert and non-expert
do not map neatly on to those of science and non-science. The implication
of STS is, therefore, that there is more expertise available than you might
think. Next, some alternatives to the knowledge-led focus of STS are
briefly considered in order to highlight that it is not necessary to see
expertise everywhere in order to explain how modern society works.
Finally, the article discusses some recent work in STS that distinguishes
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
The Distribution of Social Fluency 283
between different kinds of expertise and allows a more ‘upstream’ role for
the social scientist in the identification of expertise.
example, all federal agencies are required by law to engage the public at
least by offering notice of their proposed rules and seeking comment’.
As noted above, however, one unintended consequence of this emphasis
on public participation might be to reopen debates about expertise and
lay knowledge. While seeing expertise as social fluency shows the limits
of relying on science alone, it also highlights the limits of public partici-
pation. For example, if expertise is related to experience, then participation
can only be a mass exercise if the experiences that provide the expertise
required to participate are ubiquitous. Conversely, to the extent that
participants are expected to either have or develop some specialist expertise,
then participation cannot be a mass exercise. Seeing expertise as the
product of socialisation thus limits its distribution to particular groups
while also valuing the diversity of expertise available. The implication is
that participation, where it aims to address new and complex science, can
include large numbers of people only if it is fairly shallow. If considered
or informed lay opinion is required, however, small samples and long
time frames are required (Evans 2004; Evans and Plows 2007; Renn et al.
1993). One example of this tension is the jury trial, where lay citizens
are expected to make informed decisions about cases that often involve
complex and contested evidence. The assumption – now being challenged
in some financial cases – is that ordinary citizens can come to understand
the issues involved but that this will take time.
Amateurism
If becoming an expert means becoming socialised into a specialist com-
munity, then becoming an expert means running the risk of becoming
blinkered in one’s outlook. In contrast, remaining an ‘amateur’ allows one
to avoid the narrow perspective of the single group, discipline or paradigm
and, potentially, to see the ‘bigger picture’. This defence of non-expertise
finds some support in Bijker’s (1995) theory of sociotechnical change in
which one of the theoretical concepts is ‘inclusion’ within a technical
frame. Individuals with a high degree of inclusion are highly socialised
into a particular paradigm, while those with a low degree of inclusion
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
The Distribution of Social Fluency 287
to work all that hard’ (Wildavsky 1987, 8). This is not to say that these
judgements are always correct, or that they cannot be changed (Gastil and
Levine 2005; Lindeman 2002). It does, however, suggest that, by appealing
to cultural values, those in power have the potential to frame debates and
position themselves in ways that exploit this tendency rather than promote
dialogue. If this is the case, then the optimism of those who think there
are easy ways to make good decisions may turn out to be misplaced.
certainly not be required in order to say the science being investigated was
properly understood. In other words, the social science researcher strives
to gain enough expertise to interact with the scientists but does not seek
the practical skills needed to contribute to their work.
These transitions are formalised in the threefold categorisation of
specialist expertise developed in the paper that launched SEE (Collins and
Evans 2002): no expertise (corresponding to the researcher at the start of
their project); interactional expertise (corresponding to the researcher at the
successful completion of their project); and contributory expertise (corre-
sponding to the practitioners of the community being researched). Beginning
to categorise expertise in this way leads to three observations about the
relationship between experience and expertise:
1. Acquiring expertise is neither all attribution nor a flip-flop process. There will
be a continuum of knowledge states, ranging from ignorance to com-
plete expertise, and individuals will move between these states as their
experiences change over time.
2. Different kinds of expertise can be distributed in different ways. If expertises
are linked to experiences, and experiences vary, then expertises must
have a distribution. Some sorts of experience (e.g. speaking a natural
language) will be so widely distributed as to make the expertise they
give rise to appear ubiquitous. Other kinds of experience (e.g. milking
cows or growing stem cells) will be restricted to such small groups
that the expertise they generate will be seen as esoteric, even if it is
epistemologically similar to the more ubiquitous expertises.
3. Making judgements in the absence of detailed expertise is not unusual. It is
impossible for everyone to be an expert in everything because it is
impossible to participate fully in all the relevant communities. As a
consequence, citizens are routinely asked to make choices that involve
choosing between competing expert communities in which they do
not participate. If these choices are not to be purely random, then
there must be a set of meta-expertises (i.e. expertises about expertise)
that can be used to inform these social judgements.
These observations form the basis of a more extensive categorisation of
expertise that builds on the three stage model of no expertise, interactional
expertise and contributory expertise outlined above. The most complete
form of this is explained at length elsewhere (Collins and Evans 2007) but
the key feature is a ‘Periodic Table of Expertises’ that distinguishes
between different kinds of expertise and shows their interrelationships.
The main features of the table are summarised in Table 1.
The top row reminds us of the ubiquitous expertises that every member
of a society must possess in order to live in it. Ubiquitous expertises are
important because the sociological model of expertise presumes a natural
language speaking community within individuals are socialised and where
expertise can be generated, held and shared. Without this row, the
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
Table 1 The Periodic Table of Expertises
Interactive Ability
Dispositions
Reflective Ability
Polymorphic
Mimeomorphic
External Internal
Meta-
Expertises Ubiquitous Local Technical Downward Referred
discrimination discrimination connoisseurship discrimination expertise
expertises identified in the rest of the table could not exist. The second
row identifies some dispositions or personal qualities that are necessary for
gaining expertise but are not, in themselves, an ‘expertise’. For example,
in order to be socialised it is necessary to interact with other members of
that community and people who have good interpersonal skills may find
this easier than those who do not. Nevertheless, being ‘easy to get along
with’ does not make you an expert in anything in particular.
The next three rows are the most interesting. The row labelled specialist
expertise lists the different kinds of expertise that can be developed in a
substantive domain such as carpentry or chemistry. Starting at the left-hand
side, which is also the lowest level of expertise, the table identifies the first
level of specialist expertise as ‘beermat expertise’. This corresponds to
knowing the kinds of simple facts that might be put on the coasters
provided in bars. Knowing simple propositional statements is a kind of
expertise that might be useful in general knowledge quizzes but it is also
a limited one. The next level of expertise is popular understanding, which
refers to the kind of expertise that can be developed by reading popular
accounts of a particular domain. Unlike beermat knowledge, in which
facts are known but not interconnected, popular understandings begin to
link the different parts of the domain together. The next step up is primary
source knowledge. The difference here is that the literature being read is
no longer the simplified and popularised accounts produced for a general
audience but the specialised publications produced for the practitioners.
Finally, interactional and contributory expertise, which were defined
above, complete the categorisation. Moving along this ‘ladder’ of specialist
expertise, the key distinctions are between primary source knowledge,
interactional expertise and contributory expertise:
1. Primary source knowledge and interactional expertise. This marks the transition
from an expertise that relies on ubiquitous tacit knowledge to access
publicly available accounts of a domain (e.g. reading about a science)
to an expertise that also includes the specialist tacit knowledge that can
only be gained through interaction with the specific community (e.g.
doing qualitative research in a laboratory). The value of interactional
expertise is, therefore, that the primary source material can now be
read with the same discerning eye as a fully fledged contributory
expert. In contrast, the person with primary source knowledge lacks
the tacit skills needed to rate the significance of different publications.
The case of AIDS treatment in South Africa provides a particularly
significant example of the importance of getting these judgements
right (see Weinel 2007)
2. Interactional and contributory expertise. This corresponds to the distinction
between being able to talk fluently about a domain of expertise and
being able to contribute to it. Having contributory expertise signifies
that a person has both the conceptual and practical expertise held by
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
292 The Distribution of Social Fluency
the group; interactional expertise signifies that they posses only the
former (for more on interactional expertise, see Collins 2004). The
distinction is made clear in the difference between a social scientist
who understands the life world of the practising scientist but who has
not contributed to that science. Although much social science fieldwork
is implicitly based on the idea of interactional expertise, it is rarely tested.
The one exception, however, is an imitation game involving gravitational
wave physics and sociologist of science, Harry Collins (see Collins
et al. 2006; Giles 2006). In the experiment, Collins and a gravitational
wave physicist provided answers to a set of questions developed by
another gravitational wave physicist. A series of gravitational wave
physicists were then shown the two sets of answers and asked if they
could tell which answers came from Collins and which from the physicist.
The result was that the physicists were unable to identify Collins, demon-
strating that he could reproduce the discourse of the physics community
even if he could not take part in its practical, experimental work.
The distinction between polymorphic and mimeomorphic actions,
which appears beneath the row of specialist expertises, refers to the extent
to which actions – in this case, expertises – can be mimicked by machines.
Where they can be reproduced in this way, such actions are said to be
mimeomorphic. Where they rely on an understanding of tacit social rules
and cannot, therefore, be reproduced by machines, they are said to be
polymorphic. The distinction is not particularly important in this context,
although it might be the case that in science, for example, the aim is to
render initially polymorphic expertises mimeomorphic and, hence, replicable
by others (see Collins and Kusch 1998).
The next row of the table contains the different kinds of meta-expertise.
Unlike the specialist expertises, meta-expertises are not transitive so that
having one does not imply having the ones below. On the other hand, as
with the specialist expertises, there is a distinction between meta-expertises
that use ubiquitous tacit knowledge and those that use tacit knowledge
acquired through some specialised training. These differences can be
explained as follows:
1. External meta-expertises. These are judgements about trust or reliability
that are based on widely shared or ubiquitous tacit knowledge (e.g.
look, demeanour, past reputation of similar organisations). The idea of
local discrimination reminds us that some communities will have dealt
with a particular expertise or organisation before (e.g. because they live
near a particular industrial site) and that these experiences will shape
their views even in the absence of any significant substantive expertise
(e.g. previous promises may have been broken).
2. Internal meta-expertise. This category contains those judgements – technical
connoisseurship, downward discrimination and referred expertise – that
require the person who exercises them to have some appreciation of the
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
The Distribution of Social Fluency 293
The final row of the table identifies some criteria that might be used
for identifying or choosing between experts. The least powerful criteria
are qualifications because they exclude expertise based on experience.
Track record is slightly better but also undervalues experience and is
unavailable in any genuinely novel setting. Instead, given the emphasis on
understanding expertise as social fluency, the best indicator of expertise is
experience and the more extensive and recent it is the better.
which uses more generic social knowledge and skills to put political and
moral preferences into action (Evans and Plows 2007). In this way, under-
standing the social nature of expertise and its unequal distribution works
not simply to privilege scientific expertise but also to provide a rationale
for the inclusion of lay citizens when a more ‘disinterested’ perspective is
required. If this is the case, then the ‘Periodic Table of Expertises’ suggests
two lines of research that can be pursued in addition to the more
traditional deconstruction of how expert status gets attributed. These are:
1. The categorisation of expertise. Do the categories identified in the periodic
table make sense? The distinctions between primary source knowledge,
interactional expertise and contributory expertise seem robust (Collins
et al. 2006; Collins, 2007) but need further research if they are to be
fully understood. Similarly, the idea of meta-expertise seems to follow
quite directly from the recognition that the practical logistics of social
life must mean that most people are not experts about most things.
That said, while referred expertise has been the subject of some anal-
ysis the potentially far more common categories of ubiquitous and
local discrimination remain in need of further investigation and research.
2. Case studies and experiments in participation. As participatory decision-making
and consultation exercises are taking place in many countries and on
many different topics, the possibility of evaluating different kinds of
participatory processes is becoming a reality (see Rowe and Frewer
2004, 2005). One approach is to analyse the extent to which individual
events succeed in realising their stated ambitions of, for example, giv-
ing a voice to lay citizens. In such cases, researchers might ask whether
those identified as lay participants were genuinely able to contribute
to the debate, or whether those identified as experts listened to the
discussion as opposed to framing it (for a recent example, see Kerr
et al. 2007). Another approach would to focus instead on the ideas that
informed the design of the process itself and examine how the kinds
of expertise they invoked or generated matched the questions they
claimed to answer. For example, how have different participatory
approaches conceptualised and operationalised the idea of lay or expert
participants? What difference has this made to their conduct and out-
come? Do different processes suit different kinds of problem? How
much participation (and by whom and for how long) is actually necessary?
What are the practical implications of making such events routine?
Given the relatively novelty of the SEE approach, it is difficult to argue
which, if any, of these different research approaches should be prioritised.
Evaluating existing participatory mechanisms with a view to improving
their conduct is undoubtedly worthwhile, even if it the difficulties of
breaking conventional modes of attribution and the power relations they
encode are substantial. On the other hand, challenging the foundation of
those attributions by asking broader questions about what being an expert
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
The Distribution of Social Fluency 295
Conclusions
Expertise is central to modern life. Understanding expertise as the product
of successful socialisation demonstrates both the utility of expertise and its
weakness. Experts may be the best people to decide certain esoteric
matters of fact but they are not necessarily the best people to make value
judgements about the utilisation of that knowledge. The reason is, of
course, that the intensive socialisation necessary to develop the expertise
needed to participate in such a specialist community makes it difficult for
such experts to be truly independent. In contrast, lay citizens cannot be
experts in this way. Nevertheless, this apparent weakness may be their
strength. Precisely because lay citizens are not members of specialist expert
communities they may, paradoxically, be the best placed to make the
crucial judgements about what should be done with the products of such
expert debate. The sociological understanding of expertise is, therefore, a
central concern for modern societies. As liberal democracies struggle to
find the correct balance between expert and citizen perspectives, under-
standing what expertise is, how it is developed and how it is used remains
as important as ever.
Acknowledgement
The author is grateful to the two referees and the members of the Centre
for the Study of Knowledge Expertise and Science for their helpful com-
ments on previous versions of this article. Any errors or inaccuracies that
remain are, of course, the responsibility of the author.
Short Biography
Robert Evans is a sociologist of science and technology with a particular
interest in how scientific knowledge is made and used. His research centres
on the use of scientific and other expertise in policy-making and the nature
and value of public participation in such decisions. He has published on
these topics in several leading journals, including Social Studies of Science
and Public Understanding of Science. Together with Professor Harry Collins
he is the co-author of Rethinking Expertise (University of Chicago Press, 2007),
which sets out a new sociological theory of expertise and related research
program: Studies in Expertise and Experience. His current research
contributes to this work by critically addressing the role of the qualitative
researcher in deliberative settings and through the development of the
© 2008 The Author Sociology Compass 2/1 (2008): 281–298, 10.1111/j.1751-9020.2007.00062.x
Journal Compilation © 2008 Blackwell Publishing Ltd
296 The Distribution of Social Fluency
Note
* Correspondence address: Centre for the Study of Knowledge, Expertise and Science,
Cardiff School of Social Sciences, Cardiff University, Cardiff CF10 3WT, UK. Email:
evansrj1@cardiff.ac.uk.
References
Bijker, Wiebe E. 1995. Of Bicycles, Bakelites, and Bulbs: Toward a Theory of Sociotechnical Change.
Cambridge, MA: MIT Press.
Bloor, David 1976. Knowledge and Social Imagery. London: Routledge and Kegan Paul.
Collins, Harry M. 1974. ‘The TEA Set: Tacit Knowledge and Scientific Networks.’ Science
Studies 4: 163– 86.
Collins, Harry M. 1990. Artificial Experts: Social Knowledge and Intelligent Machines. Cambridge,
MA: MIT Press.
Collins, Harry M. 1992. Changing Order: Replication and Induction in Scientific Practice (2nd edn).
Chicago; IL: University of Chicago Press.
Collins, Harry M. 2004. ‘Interactional Expertise as a Third Kind of Knowledge.’ Phenomenology
and the Cognitive Sciences 3: 125– 43.
Collins, Harry (ed.) 2007. ‘Case Studies of Expertise and Experience.’ Special issue of Studies
in History and Philosophy of Science 38(4).
Collins, Harry M. and Robert Evans 2002. ‘The Third Wave of Science Studies: Studies of
Expertise and Experience.’ Social Studies of Sciences 32: 235–96.
Collins, Harry M. and Robert Evans 2003. ‘King Canute Meets the Beach Boys: Responses
to the Third Wave.’ Social Studies of Science 33: 435–52.
Collins, Harry M. and Robert Evans 2007. Rethinking Expertise. Chicago, IL: University of
Chicago Press.
Collins, Harry M. and Martin Kusch 1998. The Shape of Actions: What Humans and Machines
Can Do. Cambridge, MA: MIT Press.
Collins, Harry and Gary Sanders 2007. ‘They give you the keys and say “drive it ”.’ In ‘Case
Studies of Expertise and Experience.’ Special issue of Studies in History and Philosophy of Science
38: 621–41.
Collins, Harry M., Robert Evans, Rodrigo Ribeiro and Martin Hall 2006. ‘Experiments with
Interactional Expertise.’ Studies in History and Philosophy of Science 37(4): 656 –74.
Council for Science and Technology 2005. Policy Through Dialogue. London: CST. ‘http://
www2.cst.gov.uk/cst/reports/’ (last accessed 26 April 2007).
Dreyfus, Hubert L. 1972. What Computers Can’t Do. The Limits of Artificial Intelligence. New
York, NY: Harper and Row.
Department of Trade and Industry 2003. GM Nation? The Findings of the Public Debate. London:
DTI. http://www.gmnation.org.uk/index.html (last accessed 26 April 2007).
Epstein, Steven 1996. Impure Science: AIDS, Activism, and the Politics of Knowledge. Berkeley, CA:
University of California Press.
Eriksson, Lena 2004. From Persona to Person: The Unfolding of an (Un)Scientific Controversy. PhD
thesis. Cardiff, UK: Cardiff University.
Evans, Robert 2004. ‘Talking about Money: Public Participation and Expert Knowledge in the
Euro Referendum.’ British Journal of Sociology 55: 35–53.
Evans, Robert and Alexandra Plows 2007. ‘Listening Without Prejudice? Re-Discovering the
Value of the Disinterested Citizen.’ Social Studies of Science 37: 827–54.
Functowicz, Silvio O. and Jerry R. Ravetz 1993. ‘Science for the Post-Normal Age.’ Futures
25: 739–55.
Gastil, John and Peter Levine (eds) 2005. The Deliberative Democracy Handbook. San Francisco,
CA: Jossey-Bass.
Gerold, Rainer and Angela Liberatore 2001. Report of the Working Group ‘Democratising Expertise
and Establishing Scientific Reference Systems.’ European Commission. http://europa.eu.int/comm/
governance/areas/group2/report_en.pdf (last accessed 26 April 2007).
Gieryn, Thomas F. 1999. Cultural Boundaries of Science: Credibility on the Line. Chicago, IL:
University of Chicago Press.
Giles, Jim 2006. ‘Sociologist Fools Physics Judges.’ Nature 442: 8 (6 July 2006).
Gorman, Michael 2002. ‘Levels of Expertise and Trading Zones.’ Social Studies of Science 32:
933 – 8.
Grin, John, Henk van de Graaf and Rob Hoppe 1997. Technology Assessment Through Interaction:
A Guide. The Hague, The Netherlands: Rathenau Institute.
Gross, Paul R. and Norman Levitt 1994. Higher Superstition: The Academic Left and Its Quarrels
with Science. Baltimore, MD: Johns Hopkins University Press.
Horlick-Jones, Tom, John Walls, Gene Rowe, Nick Pidgeon, Wouter Poortinga, Tim
O’Riordan and Graham Murdock 2007. The GM Debate: Risk, Politics and Public Engagement.
London, UK: Routledge.
House of Lords 2000. Science and Society: Select Committee on Science and Technology, Session 1999–2000,
Third Report, HL Paper 38. London, UK: The Stationary Office. http://www.parliament.the-
stationery-office.co.uk/pa/ld199900/ldselect/ldsctech/38/3801.htm (last accessed 26 April 2007).
Irwin, Alan 1995. Citizen Science: A Study of People, Expertise and Sustainable Development.
London and New York: Routledge.
Irwin, Alan and Brian Wynne (eds) 1996. Misunderstanding Science? The Public Reconstruction of
Science and Technology. Cambridge, UK: Cambridge University Press.
Jasanoff, Sheila 1990. The Fifth Branch: Science Advisors as Policymakers. Cambridge, MA: Harvard
University Press.
Jasanoff, Sheila 2003. ‘Breaking the Waves in Science Studies; Comment on H. M. Collins and
Robert Evans, “The Third Wave of Science Studies.” ’ Social Studies of Science 33: 389– 400.
Jasanoff, Sheila 2005. Designs on Nature: Science and Democracy in Europe and the United States.
Princeton, NJ: Princeton University Press.
Kerr, Anne, Sarah Cunningham-Burley and Richard Tutton 2007. ‘Shifting Subject Positions:
Exports and Lay People in Public Dialogue.’ Social Studies of Science 37: 385– 411.
Koertge, Noretta (ed.) 2000. A House Built on Sand: Exposing Postmodernist Myths About Science.
Oxford, UK: Oxford University Press.
Kuhn, Thomas 1970. The Structure of Scientific Revolutions (2nd edn, enlarged). Chicago, IL:
University of Chicago Press.
Kuklinski, James H. and Norman L. Hurley 1994. ‘On Hearing and Interpreting Political
Messages.’ Journal of Politics 56: 729 –51.
Latour, Bruno 1983. ‘Bring Me a Laboratory and I Will Raise the World.’ Pp. 141–74 in Science
Observed: Perspectives on the Social Study of Science, edited by Karin Knorr-Cetina and Michael
Mulkay. London: Sage.
Lindeman, Mark 2002. ‘Opinion Quality and Policy Preferences in Deliberative Research.
Political Decision Making.’ Deliberation and Participation 6: 195–221.
Lupia, Arthur and Matthew McCubbins 1998. The Democratic Dilemma: Can Citizens Learn
What They Need to Know? Cambridge, UK: Cambridge University Press.
Mulkay, Michael 1979. Science and the Sociology of Knowledge. London: Allen and Unwin.
Nowotny, Helga, Peter Scott and Michael Gibbons 2001. Re-Thinking Science: Knowledge and
the Public in an Age of Uncertainty. Cambridge, UK: Polity Press.
Office of Science and Technology 2002. The Government’s Approach to Public Dialogue on
Science and Technology. London: OST. http://www.sciencewise.org.uk/html/sitedocuments/
1Sep06GuidingPrinciplesforPublicDialogue.pdf (last accessed 26 April 2007).
Pinch, Trevor and Frank Trocco 2002. Analog Days: The Invention and Impact of the Moog
Synthesizer. Cambridge, MA: Harvard University Press.
Popkin, Samuel L. 1991. The Reasoning Voter. Chicago, IL: University of Chicago Press.
Parliamentary Office of Science and Technology 2001. Open Channels: Public Dialogue in Science
and Technology, Report No. 153 (March 2001). London: HMSO.
Royal Commission for Environmental Pollution 1998. 21st Report: Setting Environmental Stand-
ards. Cm 4053: London: RCEP.
Renn, Ortwin, Thomas Webler, Horst Rakel, Peter C. Dienel and Branden Johnson 1993.
‘Public Participation in Decision Making: A Three-Step-Procedure.’ Policy Sciences 26:
189 –214.
Rip, Arie 2003. ‘Constructing Expertise.’ Social Studies of Science 33: 419–34.
Rip, Arie, Thomas J. Misa and Johan Schot (eds) 1995. Managing Technology in Society: The
Approach of Constructive Technology Assessment. London: Pinter Publishers.
Rowe, Gene and Lynn J. Frewer 2004. ‘Evaluating Public Participation Exercises.’ Science
Technology and Human Values 29: 512–57.
Rowe, Gene and Lynn J. Frewer 2005. ‘A Typology of Public Engagement Mechanisms.’
Science, Technology & Human Values 30: 251–90.
Schneider, Mark, Melissa Marchall, Christine Roch and Paul Teske 1999. ‘Heuristics, Low
Information Rationality and Choosing Public Goods: Broken Windows as Shortcuts to
Information about School Performance.’ Urban Affairs Review 34: 729–41.
Starr, Susan Leigh and James R. Griesemer 1989. ‘Institutional Ecology, “Translations” and
Boundary Objects: Amateurs and Professionals in Berkeley’s Museum of Vertebrate Zoology,
1907–39.’ Social Studies of Science 19: 387–420.
Weinel, Martin 2007. ‘Primary Source Knowledge and Technical Decision-Making: Mbeki and
the AZT Debate.’ Studies in History and Philosophy of Science 38: 748–60.
Welsh, Ian 2000. Mobilising Modernity: The Nuclear Moment. London: Routledge.
Wildavsky, Aaron 1987. ‘Changing Preferences by Constructing Institutions: A Cultural Theory
of Preference Formation.’ American Political Science Review 81: 3–22.
Wilsdon, James and Rebecca Willis 2004. See-Through Science: Why Public Engagement Needs
to Move Upstream. London: Demos, in association with the Green Alliance, Environment
Agency and RSA. http://www.demos.co.uk/catalogue/paddlingupstream/ (last accessed 26
April 2007).
Winch, Peter 1958/1988. The Idea of a Social Science and Its Relationship to Philosophy. London,
UK: Routledge.
Wynne, Brian 1982. Rationality and Ritual: The Windscale Inquiry and Nuclear Decisions in Britain.
Bucks, UK: British Society for the History of Science.
Wynne, Brian 2003. ‘Seasick on the Third Wave? Subverting the Hegemony of Propositionalism.’
Social Studies of Science 33: 401–17.
Yearley, Steven 2000. ‘Making Systematic Sense of Public Discontents with Expert Knowledge:
Two Analytical Approaches and a Case Study.’ Public Understanding of Science 9: 105–22.