Escolar Documentos
Profissional Documentos
Cultura Documentos
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at http://www.jstor.org/page/
info/about/policies/terms.jsp
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content
in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship.
For more information about JSTOR, please contact support@jstor.org.
Oxford University Press, Scots Philosophical Association and University of St. Andrews are collaborating with JSTOR
to digitize, preserve and extend access to The Philosophical Quarterly.
http://www.jstor.org
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
ThePhilosophical
Vol.53,No.2
Quarterly,
April
2003
ISSNoo3-8g94
I. INTRODUCTION
Many worksof sciencefictionas well as some forecastsby serioustechnologistsand futurologists
predictthatenormousamountsofcomputingpower
will be available in the future.Let us suppose for a momentthat these
are correct.One thingthatlatergenerationsmightdo withtheir
predictions
oftheirforebearsor of
super-powerful
computersis rundetailedsimulations
people like theirforebears.Because theircomputerswould be so powerful,
theycould runa greatmanysuch simulations.
Suppose thatthesesimulated
people are conscious(as theywould be if the simulationswere sufficiently
and ifa certainquitewidelyacceptedpositionin thephilosophy
fine-grained
of mindis correct).Then itcould be thecase thatthevastmajorityofminds
likeoursdo notbelongto theoriginalrace but ratherto people simulatedby
the advanced descendantsof an originalrace. It is thenpossibleto argue
thatifthiswerethecase, we wouldbe rationalto thinkthatwe are likelyto
be among the simulatedmindsratherthan among the originalbiological
ones. Thereforeifwe do notthinkthatwe are currently
livingin a computer
simulation,we are not entitledto believe thatwe shall have descendants
who will run lots of simulationsof theirforebears.That is the basic idea.
The restofthispaperwillspellitout morecarefully.
thisthesismayholdforthoseengagedin futuristic
Apartfromtheinterest
there
are
also
morepurelytheoretical
rewards.The argumentis
speculation,
a stimulusforformulating
some methodological
and metaphysical
questions,
? The Editorsof ThePhilosophical
Road, Oxfordox4 2DQUK,
2003. Publishedby BlackwellPublishing,
Quarterly,
9600 Garsington
and 350 Main Street,Maiden,MA02148,USA.
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
NICK BOSTROM
244
and it suggestsnaturalistic
analogiesof certaintraditionalreligiousconceptions,whichsomemayfindamusingor thought-provoking.
The structure
of thepaper is as follows.First,I formulatean assumption
which I need to importfromthe philosophyof mind in order to get the
argumentstarted.Secondly,I considersome empiricalreasonsforthinking
thatrunningvastlymanysimulationsof humanmindswould be withinthe
capabilityof a futurecivilizationthathas developedmanyof thosetechnologiesthatcan alreadybe shownto be compatiblewithknownphysicallaws
and engineering
constraints.
This partis notphilosophically
butit
necessary,
an
incentive
for
attention
to
the
Then
rest.
follows
the
core
provides
paying
of the argument,whichmakesuse of some simpleprobability
and
theory, a
sectionprovidingsupportfora weak indifference
the
principle
argument
of thedisjunctionmentioned
employs.Lastly,I discusssome interpretations
in theabstract,whichformstheconclusionofthesimulationargument.
II. THE ASSUMPTION OF SUBSTRATE-INDEPENDENCE
A common assumptionin the philosophyof mind is that of substrateThe idea is thatmentalstatescan superveneon any ofa broad
independence.
class of physicalsubstrates.Provideda systemimplementsthe rightsortof
and processes,it can be associatedwithconscious
computationalstructures
experiences.It is not an essentialpropertyof consciousnessthatit is implemented on carbon-basedbiological neural networksinside a cranium:
silicon-based
processorsin a computercould in principledo thetricktoo.
forthisthesishave been givenin theliterature,
and although
Arguments
itis notentirely
I shallheretakeitas given.
uncontroversial,
The argumentI shall presentdoes not, however,depend on any very
or computationalism.
For example,I need
strongversionof functionalism
not assumethatthethesisof substrate-independence
is necessarily
true(either
or
a
that
analytically metaphysically)merely
computerrunninga suitable
in
would
fact
be
conscious.
I need not assume thatin
Moreover,
program
orderto createa mindon a computeritwouldbe necessaryto programitin
such a way thatit behaveslike a human in all situations,
includingpassing
theTuringtest,etc. I need onlytheweakerassumptionthatit would suffice
forthegenerationofsubjectiveexperiencesthatthecomputational
processes
of a human brain are structurally
detail,
replicatedin suitablyfine-grained
such as on the level of individualsynapses.This attenuatedversion of
is quitewidelyaccepted.
substrate-independence
nerve
Neurotransmitters,
growthfactorsand other chemicalsthat are
smallerthana synapseclearlyplaya role in humancognitionand learning.
? The EditorsofThePhilosophical
Qjuarterly,
200oo3
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
245
of thesechemicals
The substrate-independence
thesisis not thatthe effects
affect
but
that
are smallor irrelevant, rather
subjectiveexperienceonly
they
via theirdirector indirectinfluenceon computationalactivities.For exin subjectiveexperiencewithoutthere
ample,iftherecan be no difference
in synapticdischarges,then the requisitedetail of
also being a difference
simulationis at thesynapticlevel(or higher).
III. THE TECHNOLOGICAL
LIMITS OF COMPUTATION
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
NICK BOSTROM
246
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
247
do notnoticeany
in normalhumanwayswiththeirsimulatedenvironment,
The microscopicstructure
of the insideof the Earth can be
irregularities.
safelyomitted.Distant astronomicalobjects can have highlycompressed
need onlyextendto thenarrowband ofproverisimilitude
representations:
pertiesthatwe can observefromour planetor solar systemspacecraft.On
thesurfaceof Earth,macroscopicobjectsin inhabitedareas mayneed to be
continuouslysimulated,but microscopicphenomena could probablybe
filledin ad hoc.What you see throughan electronmicroscopeneeds to look
itscoherencewith
but you usuallyhave no way of confirming
unsuspicious,
unobservedpartsofthemicroscopicworld.Exceptionsarisewhenwe deliberatelydesignsystemsto harnessunobservedmicroscopicphenomenathat
operatein accordancewithknownprinciplesto get resultswe are able to
The paradigmcase of thisis a computer.The simulaverifyindependently.
tionmay therefore
need to includecontinuousrepresentation
of computers
down to the level of individuallogic elements.This presentsno problem,
sinceour currentcomputingpoweris negligiblebyposthumanstandards.
Moreover,a posthumansimulatorwould have enoughcomputingpower
in all human brainsat all times.
to keep trackof the detailedbelief-states
when
it
saw
a
that
human
was
about to make an observationof
Therefore,
themicroscopicworld,itcould fillin sufficient
detailin thesimulationin the
domain
as
and
where
needed.
Should
appropriate
any erroroccur, the
directorcould edit the statesof any brainsthathave become aware of an
the directorcould
anomalybeforethisspoilsthe simulation.Alternatively,
skipback a fewsecondsand rerunthesimulationso as to avoid theproblem.
It thus seems plausible that the main computationalcost in creating
simulations
thatare indistinguishable
fromphysicalrealityforhumanminds
in the simulationresidesin simulating
organicbrainsdown to the neuronal
or sub-neuronallevel. As we build more and fastercomputers,the cost of
our machinesmighteventually
come to dominatethecostofsimsimulating
While it is notpossibleto get a veryexact estimate
ulatingnervoussystems.
of thecostof a realisticsimulationof humanhistory,
we can use
-oI33-IO36
as
a
estimate.9
As
we
more
operations
rough
gain
experiencewithvirtual
for
reality,we shall get a bettergrasp of the computationalrequirements
such
worlds
realistic
to
in
their
visitors.
But
if
even
case,
making
appear
any
the estimateis inaccurateby several ordersof magnitude,this does not
mattermuch formy argument.I notedthata roughapproximationof the
computationalpower of a planetary-mass
computeris lo42operationsper
second, and that assumesonly alreadyknownnanotechnologicaldesigns,
whichare probablyfarfromoptimal.A singlesuchcomputercould simulate
9 IOO billionhumansx 50 years/humanx 30 millionsecs/yearx
each humanbrainper second= [1033,Io36]operations.
[o014,
Iol7
operationsin
C The EditorsofThePhilosophical
2003
Quarterly,
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
NICK BOSTROM
248
+H
(f)VH)
Writing
fiforthe fractionof posthumancivilizationsthatare interestedin
runningancestor-simulations
(or thatcontainat least some individualswho
are interestedin them and have sufficient
resourcesto run a significant
numberof such simulations),
and NI forthe average numberof ancestorsimulations
runbysuchinterested
we have
civilizations,
?Th
Editors
of Th Philosophicalarter,
C The Editors of The PhilosophicalQuarterly,
2oo3
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
249
and thus
F. fm=
(fif N) +i
3.
In, e.g., N. Bostrom,'The Doomsday Argument,Adam and Eve, UN++, and Quantum
Bias: Observation
Joe', Synthese,
127 (2001), pp. 359-87; and most fullyin my book Anthropic
Selection
andPhilosophy
EfectsinScience
(New York: Routledge,2002).
Quarterly,
2003
? The Editorsof ThePhilosophical
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
NICK BOSTROM
250
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
251
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
NICK BOSTROM
252
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
253
a veryinefficient
way of gettingpleasure- which can be obtainedmuch
more cheaply by direct stimulationof the brain's reward centres.One
conclusionthat followsfrom(2) is that posthumansocietieswill be very
different
fromhuman societies:they will not contain relativelywealthy
independentagentswho have the fullgamutof human-likedesiresand are
freeto act on them.
The possibilityexpressedby alternative(3) is conceptuallythe most
one. If we are livingin a simulation,thenthecosmoswe are obintriguing
ofphysicalexistence.The physicsin
servingisjust a tinypiece ofthetotality
the universewherethe computerrunningthe simulationis situatedmay or
may not resemblethephysicsof theworldwe observe.While theworldwe
see is in some sense'real',itis notlocatedat thefundamental
levelofreality.
It maybe possibleforsimulatedcivilizations
to becomeposthuman.They
on powerfulcomputersthey
may thenrun theirown ancestor-simulations
build in their simulated universe. Such computerswould be 'virtual
machines',a familiarconceptin computerscience.(Javascript
web-applets,
forinstance,run on a virtualmachine- a simulatedcomputer- insidea
desktop.)Virtual machinescan be stacked:it is possible to simulateone
machinesimulating
anothermachine,and so on, in arbitrarily
manystepsof
iteration.If we do go on to createour own ancestor-simulations,
thensince
thiswouldbe strongevidenceagainst(I) and (2),we wouldtherefore
have to
concludethatwe live in a simulation.Moreover,we would have to suspect
that the posthumansrunningour simulationare themselvessimulated
beings;and theircreatorsin turnmayalso be simulatedbeings.
Realitymaythuscontainmanylevels.Even ifit is necessaryforthehierstatusof thisclaim is
archyto bottomout at some stage- themetaphysical
somewhatobscure- theremay be room fora large numberof levels of
reality,and the numbercould be increasingover time.(One consideration
thatcountsagainstthe multi-level
is thatthe computationalcost
hypothesis
forthe basement-level
simulatorswould be verygreat.Simulatingeven a
singleposthumancivilizationmightbe prohibitively
expensive.If so, then
we should expect our simulationto be terminatedwhen we are about to
becomeposthuman.)
Althoughall the elementsof such a systemcan be naturalistic,even
physical,it is possibleto draw some loose analogieswithreligiousconceptionsof theworld.In some ways,theposthumansrunninga simulationare
like gods in relationto the people inhabitingthe simulation:the posthumanscreatedtheworldwe see; theyare of superiorintelligence;
theyare
in
the
sense
that
can
interfere
in
the
'omnipotent'
they
workingsof our
worldevenin waysthatviolateitsphysicallaws; and theyare 'omniscient'in
the sense thattheycan monitoreverything
thathappens.However,all the
? The Editors of The PhilosophicalQuarterly,
2003
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
NICK BOSTROM
254
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions
255
This content downloaded from 128.148.252.35 on Mon, 22 Jun 2015 04:23:51 UTC
All use subject to JSTOR Terms and Conditions