Escolar Documentos
Profissional Documentos
Cultura Documentos
Department of Energy's
By:
Michael J. Radzicki
Robert A. Taylor
1997
Adapted from
Foundations of System Dynamics Modeling
Michael J. Radzicki, Ph.D.
Sustainable Solutions, Inc.
Copyright 1997
Prepared for:
U.S. Department of Energy,
Office of Policy and International Affairs,
Office of Science & Technology Policy and Cooperation
became the industry standard for computer memory for approximately twenty
years. The WHIRLWIND I project also motivated Forrester to create the
technology that first facilitated the practical digital control of machine tools.
After the WHIRLWIND I project, Forrester agreed to lead a division of MIT's
Lincoln Laboratory in its efforts to create computers for the North American SAGE
(Semi-Automatic Ground Environment) air defense system. The computers created
by Forrester's team during the SAGE project were installed in the late 1950s,
remained in service for approximately twenty-five years, and had a remarkable "up
time" of 99.8%.
System Dynamics
Another outcome of the WHIRLWIND I and SAGE projects that is perhaps, for the
purposes of this online book, most noteworthy, was the appreciation Jay Forrester
developed for the difficulties faced by corporate managers. Forrester's experiences
as a manager led him to conclude that the biggest impediment to progress comes,
not from the engineering side of industrial problems, but from the management
side. This is because, he reasoned, social systems are much harder to understand
and control than are physical systems. In 1956, Forrester accepted a professorship
in the newly-formed MIT School of Management. His initial goal was to determine
how his background in science and engineering could be brought to bear, in some
useful way, on the core issues that determine
the success or failure of corporations.
Forrester's insights into the common
foundations that underlie engineering and
management, which led to the creation of
system dynamics, were triggered, to a large
degree, by his involvement with managers at
General Electric during the mid-1950s. At that time, the managers at GE were
perplexed because employment at their appliance plants in Kentucky exhibited a
significant three-year cycle. The business cycle was judged to be an insufficient
explanation for the employment instability.
From hand simulations (or calculations) of the stock-flow-feedback structure of the
GE plants, which included the existing corporate decision-making structure for
hiring and layoffs, Forrester was able to show how the instability in GE
employment was due to the internal structure of the firm and not to an external
force such as the business cycle. These hand simulations were the beginning of the
field of system dynamics.
During the late 1950s and early 1960s, Forrester and a team of graduate students
moved the emerging field of system dynamics, in rapid fashion, from the handsimulation stage to the formal computer modeling stage. Richard Bennett created
5
population. At the Bern meeting, Forrester was asked if system dynamics could be
used to address the predicament of mankind. His answer, of course, was that it
could.
On the plane back from the Bern meeting, Forrester
created the first draft of a system dynamics model of
the world's socioeconomic system. He called this
model WORLD1. Upon his return to the United States,
Forrester refined WORLD1 in preparation for a visit to
MIT by members of the Club of Rome. Forrester called
the refined version of the model WORLD2. Forrester published WORLD2 in a
book titled World Dynamics .
From the outset, World Dynamics drew an enormous amount of attention. The
WORLD2 model mapped important interrelationships between world population,
industrial production, pollution, resources, and food. The model showed a collapse
of the world socioeconomic system sometime during the twenty-first century, if
steps were not taken to lessen the demands on the earth's carrying capacity. The
model was also used to identify policy changes capable of moving the global
system to a fairly high-quality state that is sustainable far into the future.
In response to the notoriety of World Dynamics, the Club of Rome offered to fund
an extended study of the predicament of mankind via system dynamics. As
Forrester was committed to extending his Urban Dynamics project at the time, he
declined to participate. He did, however, suggest that one of his former Ph.D.
students -- Dennis Meadows -- conduct the study. The model that was created by
Meadows and his associates was called WORLD3 and published in a book
titled The Limits to Growth . Although the WORLD3 model was more elaborate
than WORLD2, it generated the same fundamental behavior modes and conveyed
the same fundamental messages as its predecessor. Despite the similarities, The
Limits to Growth received even more world-wide attention than World Dynamics.
Some authors have speculated that this was due to the "friendly" style of writing
that made the book accessible to nontechnical readers .
In 1991, three of the original authors of The Limits to Growth redid the study in
preparation for the twentieth anniversary of the book's publication. The results
were published in a book titled Beyond the Limits . The revised system dynamics
model created for the study was called WORLD3-91. Once again, the results
presented in Beyond the Limits were consistent with the results presented in World
Dynamics and The Limits to Growth, although Beyond the Limits included a
significant amount of numerical data that did not exist when the original studies
were undertaken. Beyond the Limits also contained a careful presentation of
arguments aimed at counteracting the criticisms that were directed at the earlier
world modeling books.
7
Energy Modeling
[Bibliography]
Bunn, Derek W., Erik R. Larsen, and Kiriakos Vlahos. 1993. "Complementary Modelling
Approaches for Analysing Several Effects of Privatization on Electricity Investment." Journal
of the Operational Research Society 44(10): 957-971.
Choucri, Nazli. 1981. International Energy Futures: Petroleum Prices, Power, and Payments.
Cambridge, MA: MIT Press.
Coyle, R. Geoffrey. 1985. "Representing Discrete Events in System Dynamics Models: A
Theoretical Application to Modelling Coal Production." Journal of the Operations Research
Society 36(April): 307-318.
Coyle, R. G. and Juan C. Rego. 1983. "Scenario and Policy Evaluation in Electrical Supply
Decisions: The Argentine Case." pp. 702-715. In: John D. W. Morecroft, David F. Andersen
and John D. Sterman, eds. Proceedings of the 1983 International Conference of the System
Dynamics Society. Chestnut Hill, Massachusetts.
Davidsen, Pl I., John D. Sterman, and George P. Richardson. 1990. "A Petroleum Life Cycle
Model for the United States with Endogenous Technology, Exploration, Recovery, and
Demand."System Dynamics Review 6(1): 66-93.
De Geus, Arie P. 1988. "Planning as Learning." Harvard Business Review 66(2): 70-74.
Duncan, Richard C. 1996a. "Mexico's Petroleum Exports: Safe Collateral for a $50 Billion
Loan? Manuscript available from the Institute on Energy and Man. 3821 NE 45th. #37.
Seattle, WA 98105.
Duncan, Richard C. 1996b. "The Mexican Petroleum 'Play' in Two 'Acts:' Taking Hold of Oil
Production Data." pp. 141-144. In George P. Richardson and John D. Sterman,
eds. Proceedings of the 1996 International Conference of the System Dynamics Society.
Cambridge, Massachusetts.
Dyner, Isaac, I. M. Giraldo, A. Moreno, D. Valencia, and A. Lobo. 1990. "Regional Energy
Planning." pp. 333-340. In: David F. Andersen, George P. Richardson and John D. Sterman,
eds.Proceedings of the 1990 International Conference of the System Dynamics Society.
Chestnut Hill, Massachusetts.
Fiddaman, Thomas S. 1997. Feeedback Complexity in Integrated Climate-Economy Models.
Doctoral Thesis Submitted to the Alfred P. Sloan School of Management. Massachusetts
Institute of Technology. Cambridge, MA 02139.
Ford, Andrew. 1997. "System Dynamics and the Electric Power Industry." System Dynamics
Review 13(1): 57-85.
Ford, Andrew. 1996a. "Testing the Snake River Explorer." System Dynamics Review 12(4):
305-329.
10
Ford, Andrew. 1996b. "Electric Vehicles: The Case For (and Against) Incentives." Public
Utilities Fortnightly (April 15).
Ford, Andrew. 1995a. "Simulating the Controllability of Feebates." System Dynamics
Review11(1): 3-29.
Ford, Andrew. 1995b. "System Dynamics and the Sustainable Development of the Electric
Power Industry." pp. 60-73. In: Toshiro Shimada and Khalid Saeed, eds. Proceedings of the
1995 International Conference of the System Dynamics Society. Gakushuin University.
Tokyo, Japan. July 30-August 4, 1995.
Ford, Andrew. 1994. "Electric Vehicles and the Electric Utility Company." Energy
Policy 22(7).
Ford, Andrew, Michael Bull, and Roger Naill. 1989. "Bonneville's Conservation Policy
Analysis Models." Energy Policy 15(2): 109-124.
Ford, Andrew and Michael Bull. 1989. "Using System Dynamics for Conservation Policy
Analysis in the Pacific Northwest." System Dynamics Review 5(1): 1-16.
Ford, Andrew, and Greg Mann. 1983. "Summary of the Workshop on Regulatory-Financial
Models of the US Electric Utility Industry." Report LA-9815-C. Los Alamos National
Laboratory. Los Alamos, New Mexico 87545.
Ford, Andrew and Annette Youngblood. 1983. "Simulating the Spiral of Impossibility in the
Electric Utility Industry." Energy Policy (March).
Ford, Andrew and Annette Youngblood. 1982. "Technical Documentation of the Electric
Utility Policy and Planning Analysis Model, Version 4." Report LA-9347-MS. Los Alamos
National Laboratory. Los Alamos, New Mexico 87545.
Ford, Andrew. 1975. A Dynamic Model of the U.S. Electric Utility Industry. Doctoral Thesis
Submitted to the Thayer School of Engineering. DSD #28, 31. Dartmouth College. Hanover,
New Hampshire 03755.
Forrester, Jay W. 1970. World Dynamics. Cambridge, MA: MIT Press.
Forrester, Jay W. 1961. Industrial Dynamics. Cambridge, MA: MIT Press.
FOSSIL2: Energy Policy Model Documentation. 1980. Energy and Environmental Analysis,
Inc. Department of Energy Contract No. AC01-79PE70143. Assistant Secretary for Policy,
Planning and Analysis. Washington, D.C. 20585.
Genta, Peter J. and Neville Sokol. 1993. "Applying a Systems Thinking Approach to
Business Process Re-Engineering: A Case Study of a Canadian Oil and Gas Producer." pp.
11
142-151. In: Enrique Zepeda and Jos A. D. Machuca, eds. The Role of Strategic Modelling
in International Competitiveness: Proceedings of the 1993 International Conference of the
System Dynamics Society. Cancn, Mexico. July 19-25.
Geraghty, Dominic M. and James M Lyneis. 1985. "Feedback Loops: The Effect of External
Agents on Utility Performance." pp. 249-267. In: Strategic Management and Planning for
Electric Utilities. J. Plummer, E. Oatman, and P. Gupta, eds. New Jersey: Prentice-Hall.
Geraghty, Dominic M. and James M Lyneis. 1983. "Regulatory Policy and the Performance
of Electric Utilities: A System Dynamics Analysis." pp. 613-638. In: John D. W. Morecroft,
David F. Andersen and John D. Sterman, eds. Proceedings of the 1983 International
Conference of the System Dynamics Society. Chestnut Hill, Massachusetts.
Hubbert, M. King. 1993. "Exponential Growth as a Transient Phenomenon in Human
History." pp. 113-126. In Herman E. Daly and Kenneth N. Townsend, eds. Valuing the Earth:
Economics, Ecology, Ethics. Cambridge, MA: MIT Press.
Hubbert, M. King. 1956. "Nuclear Energy and the Fossil Fuels." p.p. 7-25. In: Drilling and
Production Practice. Washington, DC: American Petroleum Institute.
Hubbert, M. King. 1950. "Energy from Fossil Fuels." In Annual Report of the Smithsonian
Institution. pp. 255-271.
Kinek, Patrick and Anil B. Jambekar. 1984a. "The Effects of Government's Permitting and
Bonding Review Process on Small Surface Coal Operations." Materials and Society 8(1): 7182
Kinek, Patrick and Anil B. Jambekar. 1984b. "Simulations of Small Surface Coal
Operations."Simulation 42(3).
Kinek, Patrick and Anil B. Jambekar. 1983. "Modeling Small Surface Coal Operations." pp.
439-451. In: John D. W. Morecroft, David F. Andersen and John D. Sterman,
eds. Proceedings of the 1983 International Conference of the System Dynamics Society.
Chestnut Hill, Massachusetts.
Khalil, Yehia H. and Michael J. Radzicki. 1996. "The Dynamics of the Zero Emission Vehicle
Industry." pp. 268-271. In George P. Richardson and John D. Sterman, eds. Proceedings of
the 1996 International Conference of the System Dynamics Society. Cambridge,
Massachusetts. July 22-25, 1996. Available on the World Wide Web at:
http://www.tiac.net/users/sustsol.
Kreutzer, W. Brian, David P. Kreutzer and Janet Gould. 1992. "The Quahog Oil Production
Simulator: A Case Study of the Rapid Development of a Management Flight Simulator for
Training." pp. 329-336. In: Jac A. M. Vennix, Jan Faber, Wim J. Scheper, and Cees A. Th.
12
Takkenberg, eds. Proceedings of the 1992 International Conference of the System Dynamics
Society. Utrecht University. Utrecht, The Netherlands. July 14-17, 1992.
Larsen, Erik R. and Derek W. Bunn. 1994. "Modelling Electricity Privatization in the UK."
Working Paper W-94-04. London Business School. Sussex Place. Regent's Park. London
NW1 4SA. United Kingdom.
Lyneis, James M. 1985. "Leverage and the Performance of Electric Utilities: How Feedback
Assumptions Affect Policy Conclusions." pp. 513-532. In: Merrill E. Warkentin,
ed. Proceedings of the 1985 International Conference of the System Dynamics Society.
Keystone, Colorado.
Lyneis, James M., Carl G. Bespolka, and Ben Tucker. 1994. "Preparing for a Competitive
Environment -- The Prospects for America's Electric Utilities." pp. 143-153. In: Proceedings
of the 1994 International Conference of the System Dynamics Society. Stirling, Scotland.
United Kingdom.
Meadows, Donnella H., Dennis L. Meadows and Jrgen Randers. 1992. Beyond the Limits:
Confronting Global Collapse; Envisioning a Sustainable Future. Post Mills, Vermont: Chelsea
Green.
Meadows, Donnella H., William W. Behrens, III, Dennis L. Meadows, Roger F. Naill, Jrgen
Randers and Erich K. O. Zahn. 1974. The Dynamics of Growth in a Finite World. Cambridge,
MA: Wright-Allen Press.
Meadows, Donnella H. and Dennis L. Meadows, eds. 1973. Toward Global Equilibrium:
Collected Papers. Cambridge, MA: Wright-Allen Press.
Meadows, Donnella H., Dennis L. Meadows, Jrgen Randers and William W. Behrens, III.
1972.The Limits to Growth: A Report for the Club of Rome's Project on the Predicament of
Mankind. New York: Universe Books.
Meadows, Dennis L., John Stanley-Miller and Roger Naill. 1975. "The Transition to
Coal."Technology Review 78(1).
Mendis, Matthew S., Joseph I. Rosenburg and Douglas M. Medville. 1979. "An Economic
Assessment of Labor Supply and Demand in the Coal Mining Industry through 2000."
InProceedings of the Second Miami International Conference on Alternative Energy Sources.
Miami, FL: University of Miami.
Morecroft, John D. W. 1992. "Design of a Learning Environment: The Oil Producers'
Microworld.: pp. 465-474. In: Jac A. M. Vennix, Jan Faber, Wim J. Scheper, and Cees A. Th.
Takkenberg, eds. Proceedings of the 1992 International Conference of the System Dynamics
Society. Utrecht University. Utrecht, The Netherlands. July 14-17, 1992.
13
Morecroft, John D. W. and Kees A. J. M. van der Heijden. 1992. "Modeling the Oil
Producers: Capturing Oil Industry Knowledge in a Behavioral Simulation Model." European
Journal of Operational Research 59(1): 102-122.
Naill, Roger F. 1992. "A System Dynamics Model for National Energy Policy
Planning." System Dynamics Review 8(1): 1-19.
Naill, Roger F. 1977. Managing the Energy Transition: A System Dynamics Search for
Alternatives to Oil and Gas. Cambridge, MA: Ballinger.
Naill, Roger F. 1976. COAL1: A Dynamic Model for the Analysis of United States Energy
Policy. Doctoral Thesis Submitted to the Thayer School of Engineering. DSD #54.
Dartmouth College. Hanover, New Hampshire 03755.
Naill, Roger F. 1973. "The Discovery Life Cycle of a Finite Resource: A Case Study of U.S.
Natural Gas." pp. 213-256. In: Donnella H. Meadows and Dennis L. Meadows, eds. Toward
Global Equilibrium: Collected Papers. Cambridge, MA: Wright-Allen Press.
Naill, Roger F. 1972. Managing the Discovery Life Cycle of a Finite Resource: A Case Study
of U.S. Natural Gas. Master's Thesis Submitted to the Alfred P. Sloan School of Management.
Massachusetts Institute of Technology. Cambridge, MA 02139.
Naill, Roger F. Sharon Belanger, Adam Klinger, and Eric Petersen. 1992. "An Analysis of the
Cost of Effectiveness of US Energy Policies to Mitigate Global Warming." System Dynamics
Review 8(2): 111-128.
Powell, Stephen G. 1990a. "An Evaluation of Behavioral Simulation Models of OPEC." pp.
878-892. In: David F. Andersen, George P. Richardson and John D. Sterman,
eds. Proceedings of the 1990 International Conference of the System Dynamics Society.
Chestnut Hill, Massachusetts.
Powell, Stephen G. 1990b. "The Target-Capacity Utilization Model of OPEC and the
Dynamics of the World Oil Market." Energy Journal 11(1).
Randers, Jrgen. 1973. "The Dynamics of Solid Waste Generation." pp. 165-211. In:
Donnella H. Meadows and Dennis L. Meadows, eds. Toward Global Equilibrium: Collected
Papers. Cambridge, MA: Wright-Allen Press.
Schwarz, Ingo A. 1978. "A Generic System Dynamics Model Applied to U.S. Coal
Mines."Modeling and Simulation 9.
Senge, Peter M. 1990. The Fifth Discipline: The Art and Practice of the Learning
Organization. New York: Doubleday Currency.
14
Sterman, John D. 1983. "Economic Vulnerability and the Energy Transition." Energy
Systems and Policy 7(4): 259-301.
Sterman, John D. 1981. The Energy Transition and the Economy: A System Dynamics
Approach. Doctoral Thesis Submitted to the Alfred P. Sloan School of Management.
Massachusetts Institute of Technology. Cambridge, MA 02139.
Sterman, John D., George P. Richardson, and Pl I. Davidsen. 1988. "Modeling the
Estimation of Petroleum Resources in the United States." Technological Forecasting and
Social Change 33(3): 219-249.
Sterman, John D. and George P. Richardson. 1985. "An Experiment to Evaluate Methods for
Estimating Fossil Fuel Resources." Journal of Forecasting 4(2): 197-226.
Warsh, David. 1990. "Larry, Curly & Moe in the Persian Gulf: wither Oil Prices?" Boston
Globe(November 25): A33.
Wolstenholme, Eric F. and R. K. Holmes. 1985. "The Design of Colliery Information and
Control Systems." European Journal of Operational Research 20(2): 168-181.
Wolstenholme, Eric F. 1983. "The Relevance of System Dynamics to Engineering System
Design."European Journal of Operational Research 14(1): 116-126.
Wolstenholme, Eric F. 1982a. "Managing International Mining -- A Case Study Concerning
Complex Multiple-Ownership Systems." European Journal of Operational Research 9(2):
133-143.
Wolstenholme, Eric F. 1982b. "The Design and Control of Policies for Underground Coal
Clearance Systems." Dynamica 6(2).
Wolstenholme, Eric F. 1981. "Designing and Assessing the Benefits of Control Policies for
Conveyor Belt Systems in Underground Coal Mines." p. 192. In: Proceedings of the
International System Dynamics Conference. Rensselaerville, NY.
Zahn, Eric K. O. 1981. "Dynamics of Coal in West Germany." p. 252. In: Proceedings of the
1981 International Conference of the System Dynamics Society. Rensselaerville, NY.
16
Figure 1: Stock-Flow Structure Representing Hubberts View of Oil and Gas Discovery and Production
A direct implication of Hubberts theory is that a time series graph of either oil or
gas production (at either the world-wide or domestic levels) must, at a minimum,
be "hump" shaped. That is, the area beneath the production curve for oil or gas is
the cumulative production of the resource, and the cumulative production of the
resource must be a finite number. In fact, Hubbert argued that the life cycle of oil
and gas discovery and production yields a bell-shaped production curve, which
describes a period of low resource price and exponential growth in production, a
peaking of production as the effects of resource depletion cause discoveries per
foot of exploratory drilling to drop and resource price to rise, and a long period of
rising costs and declining production as the substitution to alternative resources
proceeds. Figure 2 shows a graphical representation of Hubberts life cycle theory
of oil and gas discovery and production.
Figure 2: M. King Hubberts Life Cycle Theory of Oil and Gas Discovery and Production
17
Adelmans views vis--vis oil price and depletion were summarized in a 1991
column by Boston Globe reporter David Warsh:
The price of oil is a study in monopoly, nothing more. The question of mineral
depletion doesnt really enter into it...[I]n fact, there is no fixed stock of oil, says
Adelman; there is only an inventory we call reserves, which we replenish with
new prospecting and lifting techniques. What we dont choose to find or lift
remains a secret of the earth, unknown, probably unknowable, surely unimportant;
a geological fact of no economic interest. In the endless tug of war between
diminishing returns and increasing knowledge, he says, technology wins out...
[The] worldwide stability of the development cost of new oil since 1955 shows that
oil is no more scarce today than it was then. The great shortage is like the horizon,
always receding as you go toward it, says Adelman. Whats left are the
monopolistic political high-jinks .
Figure 3: Stock-Flow Structure Representing Adelmans View of Oil and Gas Discovery and Production
answering this question, in 1972 the Resource Policy Group at Dartmouth College
received a three year contract from the National Science Foundation to study the
United States "energy transition problem."
The US Energy Transition Problem
The "energy transition problem" refers to the set of disruptions that the US
economy must go through as it reduces its dependence on domestic gas and oil
(due to depletion) and increases its reliance on new sources of energy. Historically,
the US economy has gone through two energy transitions: (1) from wood to coal
during the late 1800s, and (2) from coal to oil and gas during the early 1900s. But,
these transitions were motivated by the availability of abundant new energy
sources that were cheaper and more productive than the existing sources. The
energy transition that the US is currently facing, however, is being forced by
depletion and rising production costs, and not by a cheaper and more productive
energy source .
The implications of the energy transition problem for the United States are quite
significant. The continued growth in US energy demand, coupled with the
depletion of domestic oil and gas resources and long delays in the development of
alternative domestic energy sources is causing a widening domestic energy gap
(domestic energy demand - domestic energy supply). This gap can only be filled, in
the near term at least, through increased dependence on foreign imports of natural
gas and oil. In addition, as long as abundant oil and gas imports are available at
prices that are low relative to the marginal cost of developing new domestic
supplies (i.e., as long as its easier to import oil and gas than it is to develop new
domestic energy sources), US oil and gas depletion will continue, if not accelerate .
The COAL1, COAL2 and FOSSIL1 Models
Roger Naills natural gas model represented the US gas system at a very aggregate
level. The model was not broken down by region, technology, or type of gas. It did
not allow for the substitution of fuels nor for endogenous technological change.
Thus, although it helped to motivate the study of the US energy transition problem,
it was inadequate for the study itself. A new, expanded, model was required.
For his Ph.D. dissertation at Dartmouth, again under the supervision of Dennis
Meadows, Naill expanded the boundary of his natural gas model to include all
major US energy sources (energy supply), as well as US energy consumption
(energy demand) . He called his dissertation model COAL1, because his analysis
showed that the best fuel for the US to rely on during the energy transition was
coal .
After he had completed his Ph.D., Naill worked with the Dartmouth Resource
Policy Group to improve and extend COAL1 as part of the Groups National
19
Science Foundation grant activities. The improved and extended version of the
model was called COAL2 . In 1975, the Energy Research and Development
Administration (which later became the US Department of Energy) provided
support to further improve and extend COAL2 for use in government energy
planning. This improved and extended model was called FOSSIL1, since it looked
at the transition of an economy that is powered by fossil fuels (i.e., by oil, gas, and
coal) to one that is powered by alternative energy sources.
The FOSSIL1 model (as were its predecessors) was thus based on Hubberts theory
of resource abundance, depletion, and substitution, and used to analyze and design
new legislation that would enable the US economy to pass through the energy
transition smoothly. It consisted of four main sectors: (1) energy demand, (2) oil
and gas, (3) coal, and (4) electricity, and addressed, among others things, the
following questions:
o Is energy independence for the US feasible and, if so, when?
o Should a national energy strategy emphasize conservation or increased
supply?
o Which transition energy source should be accelerated?
The results from using FOSSIL1 to analyze the energy transition questions were
that:
o Due to the momentum of past energy policies and the inherent delays before
new policies become effective, in the short term the US energy problem
cannot be solved.
o Neither supply side nor demand side policies alone will ameliorate the
transition problem sufficiently.
o Smoothly passing through the energy transition requires policies
that both stabilize energy demand and increase alternative energy supplies.
The FOSSIL2 and IDEAS Models
In response to the United States first energy crisis in 1977, the Carter
Administration created the first National Energy Plan. Shortly thereafter, the US
House of Representatives asked the Dartmouth Resource Policy Group to evaluate
the Plan using the FOSSIL1 model. After the evaluation of the Plan was
completed, Roger Naill left the Resource Policy Group to head the Office of
Analytical Services at the Department of Energy and, among other things, prepare
energy projections in support of future National Energy Plans.
20
To prepare the energy projections for future National Energy Plans, Naill
implemented FOSSIL1 in-house at the Department of Energy and supervised a
team that extensively modified it so that national energy policy issues could be
analyzed. The modified version of FOSSIL1 was called FOSSIL2 .
From the late 1970s to the early 1990s, the FOSSIL2 model was used at the
Department of Energy to analyze, among other things:
o the net effect of supply side initiatives (including price deregulation) on US
oil imports.
o the US vulnerability to oil supply disruptions due to political unrest in the
Middle East or the doubling of oil prices.
o policies aimed at stimulating US synfuel production.
o the effects of tax initiatives (carbon, BTU, gasoline, oil import fees) on the
US energy system.
o the effects of the Cooper-Synar CO2 Offsets Bill on the US energy system.
In 1989, the Congress directed DOE to conduct a study of energy technology and
policy options aimed at mitigating greenhouse gas emissions. FOSSIL2 was used
for this purpose. Some preliminary conclusions from the study were that:
o Reforestation is a promising alternative to taxes or standards.
o Effectively promoting cost-effective conservation measures would be
worthwhile.
o There needs to be a significant long-term switch from coal to advanced
nuclear power and renewables (environmentally benign) in the US electric
power sector.
o Due to compensating feedbacks in the US energy system, a combination of
policies, rather than any single policy, is going to be necessary to
successfully combat the global warming problem.
o Policy makers should not aim policy changes at a single sector of the US
energy system because this approach ignores the ramifications of the policy
changes in other sectors of the US energy system .
In recent years, extensive improvements have been made to FOSSIL2s
transportation and electric utilities sectors . The improved version of FOSSIL2 has
been renamed IDEAS, which stands for Integrated Dynamic Energy Analysis
21
Simulation. The IDEAS model is now maintained for the DOE by Applied Energy
Services of Arlington, Virginia .
Sterman's Model of Energy-Economy Interactions
During the late 1970s John Sterman, an MIT Ph.D. student and former Dartmouth
College undergraduate, was hired by Roger Naill to work with a team to modify
and extend the FOSSIL1 model into the FOSSIL2 model. During this work,
Sterman came to realize that the FOSSIL2 model ignored important feedbacks and
interactions between the energy sector of the economy and the economy itself. For
his Ph.D. dissertation, Sterman built a system dynamics energy model that
captured, for the first time, significant energy-economy interactions .
To be more precise, Sterman noticed that in the COAL-FOSSIL-IDEAS family of
models, the energy sector is modeled in isolation from the rest of the economy.
That is:
o GDP is exogenous to the model. It is not affected by the price or availability
of energy.
o Costs of unconventional energy technologies are exogenous to the model.
o Investment in energy is unconstrained by the investment needs of other
sectors of the economy.
o Interest rates are exogenous to the model.
o Inflation is unaffected by domestic energy prices, production, or policies.
o World oil prices are unaffected by domestic energy prices, production, or
policies .
Sterman addressed these deficiencies through his modeling and found that:
o The economic consequences of depletion are much more severe during the
transition period (extending to approximately 2030) than during the long run
or equilibrium state.
o The magnitude of the economic effects are substantial in absolute terms and
include reductions in economic growth; increased
unemployment;inflationary stress; higher real interest rates;reduced
consumption per capita.
22
the case of world oil production which has not yet peaked, US domestic oil
production (in the lower 48 states) peaked in 1970. Since Hubbert had forecast in
1956 that US oil production (in the lower 48 states) would peak between the years
1966 and 1971, his forecast is one of the most accurate and remarkable in the
history of energy forecasting . In light of this, Sterman, Richardson and Davidsens
synthetic data experiment for the United States is perhaps best interpreted as
supporting the argument that Hubberts method is the most accurate.
Other System Dynamics Modeling in the Oil and Gas Industry
System dynamics modeling has been used by numerous researchers, outside of the
Naill-to-IDEAS lineage, to examine firm-level and industry-level issues in the oil
and gas industry. Table 1 lists some of the work that has been done. Inspection of
the table reveals that topics such as the behavior of OPEC and world oil markets,
business process re-engineering in an oil and gas producing firm, international
relations stemming from world oil supply and demand relationships, and oil firms
as learning organizations, have been addressed with system dynamics. The Energy
2020 model was developed by George Backus and Jeff Amlin to provide individual
energy firms and state agencies with a multi-fuel energy model. It is similar in
design to the DOEs IDEAS model.
Topic Area
Authors
25
De Geus (1988)
Choucri (1981)
Table 1: Some Well-Known System Dynamics Studies in the Oil and Gas Industry
The efforts of oil companies to become "learning organizations" through the use of
"management flight simulators" is a particularly noteworthy use of system
dynamics in energy modeling. In 1990, system dynamicist Peter Senge wrote a
book that outlined a way for organizations to become "learning organizations"
through the use of system dynamics and other tools . A learning organization is
composed of employees who possess a shared, holistic, and systemic vision, and
have the commitment and capacity to continually learn, rather than simply
executing a "plan" put forth by the "grand strategist" at the top of the organization.
One of the principal tools used by learning organizations is the "management flight
simulator." Management flight simulators are computerized learning environments
that invite decision makers to train in a simulator just like a pilot does. The flight
simulator runs an underlying system dynamics model for a number of periods,
pauses, and waits for the decision maker to make a policy change. After the policy
change has been entered, the flight simulator again simulates the model forward in
time, pauses, and waits for the next policy change. After a decision maker has
finished a session in the simulator, he or she is invited to determine why the system
behaved as it did. Once the decision maker ascertains this, he or she is invited to
play again. Of course, after a number of plays the decision makers understanding
of the system should improve and, hopefully, he or she will apply the lessons
learned to an actual organization.
System Dynamics Modeling in the Coal Industry
26
Topic Area
Authors
Industry-level studies
Mining systems
Wolstenholme (1984)
Coyle (1985)
27
Since Fords pathbreaking work, system dynamics has been used extensively by
utility managers for strategic planning . Table 1 lists some well-known system
dynamics studies that have addressed problems in the electric power industry,
including: the effects of regulatory policy on utility performance, the "spiral of
impossibility," the effects of external agents on utility performance, the financial
performance of utilities, the effects of energy conservation practices on utility
performance, regional strategic electricity/energy planning, national strategic
electricity/energy planning, electric vehicles, deregulation in the UK electric power
industry, deregulation in the US electric power industry, and river use and its
impact on hydroelectric power.
The system dynamics work on river use and its impact on hydroelectric power is
particularly noteworthy as it involves the use of a management flight simulator in a
public policy context. More precisely, the management flight simulator is designed
to allow ordinary citizens, as well as utility managers and other stakeholders, to
test policies aimed at moving hydroelectric systems in desired directions, while
taking multiple criteria into account.
Topic Area
Authors
Lyneis (1985)
Sterman (1981)
Electric vehicles
Ford (1996a)
Table 3: Some Well-Known System Dynamics Studies in the Electric Power Industry
29
30
Formal Models
Modeling is something that all human beings do. Children create models out of playdough,
tinker toys, legos, blocks, cards, sand, and the like. Engineers create clay models of
automobiles, metal models of aircraft, wooden models of bridges, plastic models of cities,
hand-drawn models of buildings, and computer models of most of the things they create.
Natural scientists create physical models of molecules, the human body, and the solar system,
and mathematical and/or written models of the evolution of the universe. Social scientists
create computer and written models of the mind, mathematical and computer models of the
economy, and physical models of ancient civilizations. Managers build financial models with
spreadsheet programs and database applications. Playwrights create models capturing aspects
of the human condition.
Humans create models for a variety of reasons. Models are simplifications of reality and
(usually) help people to clarify their thinking and improve their understanding of the world.
Models can be used for experimentation. A computer model, for instance, can compress time
and space and allow many system changes to be tested in a fraction of the time it would take
to test them in the real world. Further, testing changes on a model, rather than on an actual
system, is a good way to avoid "shooting yourself in the foot." That is, if a change does not
perform well in a model of a system, it is questionable as to whether it will perform well in
the actual system itself. In addition, experimenting on a model can avoid causing harm to an
actual system, even when the change being tested is successful. For example, testing a more
effective sprinkler system design does not require setting an actual building on fire, if the
testing is done on a model of the building.
Mental Models
Although it is perhaps self-evident that humans regularly create and use formal models, it is
less obvious that they regularly create and use informal models, or mental models. More
precisely, human beings do not have actual families, clubs, churches, universities,
corporations, cities, states, national socioeconomic systems, and the like, inside of their
heads, but rather mental representations of these systems. Thus, in the field of system
dynamics it is argued that policy makers should not worry about whether or not to use a
31
model, but rather which model to use . In other words, system dynamicists believe that policy
makers should decide whether they wish to make decisions based on results obtained from
their unaided mental models, or from results obtained from some combination of formal and
mental models.
Both formal models and mental models have many strengths and weaknesses . Mental
models are flexible, rich in detail, and constructed from the most abundant and valuable
source of information in the world - experience "data" collected in your brain. John Sterman,
a prominent system dynamics professor at Massachusetts Institute of Technology, points out
that the "great systems of philosophy, politics, and literature are, in a sense, mental models" .
To illustrate the importance of mental models, it is useful to consider the following thought
experiment . Imagine that spacemen land in Detroit, remove every worker from one of the
city's automobile plants, and replace them with workers who are identical in every way to the
removed workers, except that they have no mental information to guide them in making
automobiles. Could the new workers build automobiles by using the available written and
numerical information? The answer is "no," and the reason is that an overwhelming majority
of the information that is crucial for automobile manufacturing is contained in the minds of
the removed workers.
Although mental models have many strengths, they also have many weaknesses. Mental
models are often fuzzy, incomplete, imprecise, and filled with unstated assumptions and
goals. During conversation and debate, different people use different mental models, and
these models can and do change -- even during the course of a single conversation or debate .
Further, the human mind is a poor dynamic simulator. Cognitive limitations prevent humans
from accurately thinking through the dynamic behavior inherent in all but the simplest of
their mental models .
To illustrate the richness and complexity of human mental models and the difficulty of
thinking through their dynamic consequences, it is useful to examine Douglas Hofstadter's
book Gdel, Escher, Bach: An Eternal Golden Braid . In his book, Hofstadter integrates
Gdel's Incompleteness Theorem, the music of Johann Sebastian Bach, and the art of Maurits
Cornelis Escher, to address the issue of whether machine reasoning and artificial intelligence
are truly possible. Hofstadter's self-made sketch of a portion of his mental model that
underlies his book is presented in Figure 1.
(click
on
image
to
see
detailed
view)
After examining Hofstadter's sketch, it is perhaps easier to accept the argument that trying to
accurately think through the dynamic behavior inherent in mental models is a difficult task
indeed!
System dynamics provides the basic building blocks necessary to construct models that teach us how
and why complex real-world systems behave the way they do over time. For us, the goal is to
leverage this added understanding to design and implement more efficient and effective policies.
This chapter introduces the concept of time paths and how to begin looking at the world in terms of
changing patterns over time rather than as static snap-shot events. This chapter also introduces the
concept of system stocks, system flows, and system feedback. To understand the dynamic
behavior of a system, its key physical and information stocks, flows and feedback
structures must be identified.
Time Paths
System dynamics modeling is concerned with the dynamic behavior of systems - that is, the
behavior of systems over time. In system dynamics modeling, the modeler attempts to
identify the patterns of behavior being exhibited by important system variables, and then
build a model that can mimic the patterns. Once a model has this capability, it can be used as
a laboratory for testing policies aimed at altering a system's behavior in desired ways.
Figure 1 is a straight line with a positive slope and an example of a dynamic time path.
Although actual systems can exhibit a variety of time paths (often simultaneously), the good
news is that the number of distinct time path "families" that exists is relatively small.
simplicity and intuitive appeal of these paths, it is important to point out some facts which
can place them in the proper perspective, vis--vis system dynamics modeling.
Exponential Family
The second distinct family of time paths is the exponential family, shown in Figure 3. The
exponential family consists of exponential growth and exponential decay. As previously
mentioned, real systems tend to grow and decline along exponential time paths, as opposed to
linear time paths.
35
Goal-seeking Family
The third distinct family of time paths is the goal-seeking family as shown in Figure 4. All
living systems (and many nonliving systems) exhibit goal-seeking behavior. Goal-seeking
behavior is related to exponential decay. This can be seen by comparing the second time path
in Figure 3 with the second time path in Figure 4. The only difference between the two is that
in Figure 3, the time path is seeking a goal of zero, whereas in Figure 4, the time path is
seeking a nonzero goal.
Oscillation Family
The fourth distinct family of time paths is the oscillation family. Oscillation is one of the
most common dynamic behaviors in the world and is characterized by many distinct patterns.
Four of these distinct patterns are shown in Figure 5: sustained, damped,
exploding, and chaos.
36
S-shaped Family
The fifth distinct family of time paths is the s-shaped family, shown in Figure 6. Close
inspection of the s-shaped growth time path pattern reveals that it is really a combination of
two time paths - exponential growth and goal-seeking behavior. More precisely, in the case of
s-shaped growth, exponential growth gives way to goal-seeking behavior as the system
approaches its limit or carrying capacity (indicated by the green line).
Sometimes, however, a system can overshoot its carrying capacity. If this occurs and the
system's carrying capacity is not completely destroyed, the system tends to oscillate around
its carrying capacity. On the other hand, if the system overshoots and its carrying capacity is
damaged, the system will eventually collapse. This is referred to as an "overshoot and
collapse" system response. A third possible outcome from an overshoot event is that a system
will simply reverse direction and approach the system capacity in a reverse s-shaped pattern.
As with a "normal" s-shaped pattern, a reverse s-shaped pattern is a combination of two time
paths -- exponential decay and a self-reinforcing spiral of decline.
Actual Data
A story that is frequently recounted by Jay Forrester is that a student once told him that he
"learned to read the newspaper differently," after taking a class in system dynamics. Although
it is possible to interpret the student's comment in a number of ways, one can speculate that,
among other things, he began to see the graphs of actual time series data, presented in the
media, in a different light after studying system dynamics.
Figures 1 through 10 present graphs of a variety of actual time series data reproduced from
books, newspapers, and magazines, which appeared during the last few years. An
examination of the figures reveals that it is possible to identify, in actual data, many of the
time paths shown in the previous section.
Figure 1, for example, is a graph of actual Medicare costs from 1967 to 1994 and Medicare
costs from 1967 to 1994 as projected in 1965. Two things about this graph are noteworthy.
The first is that Medicare costs were projected to grow linearly from 1967 to 1994 -- a
common mistake among persons not familiar with the dynamics of systems. The second is
that actual Medicare costs grew exponentially from 1967 to 1994. This time path is clearly a
member of the exponential family of time paths.
38
39
Figure 5 is a graph of the number of lynx trapped in Canada (in log form) from 1821 to 1933.
Although slightly "noisy" or choppy, the time path can certainly be classified as a sustained
oscillation.
Figure 5: Lynx trapped in Canada (in log form) from 1821 to 1933.
Figure 6 is a graph of Norwegian pulp inventory, production, and sales, for the years 1957 to
1978. Clearly, the time path of pulp inventory is an exploding oscillation .
Figure 6: Norwegian pulp inventory, production, and sales, for the years 1957 to
1978.
Figure 7 is a time series graph of the number of third class mail pieces (in billions) delivered
by the United States Postal Service, during the years 1981 to 1991. The path is clearly sshaped.
40
Figure 7: Number of third class mail pieces (in billions) delivered by US Postal
Service, 1981 to 1991.
Figure 8 is a time series graph of materials consumption in the United States for the years
1900 to 1992. Although a bit noisy, the data exhibit an overshoot and oscillate time path.
41
Figure 9: United States bank, saving and loan, and total financial institution
failures, 1980 to 1992.
Figure 10 is a graph of grainland in Japan for the years 1950 to 1994. The time path exhibited
by this data is clearly a reverse s-shape.
42
outflow equals the inflow, the number of entities in the stock will remain the same. This last
Figure 2: Example stock and flow structure with an inflow and outflow
In principle, a stock can have any number of inflows and outflows. In practice, however, a
system dynamics model usually contains stocks with no more than four-to-six inflows and/or
outflows. The principle of accumulation holds regardless of the number of inflows and
outflows that work to change the number of entities accumulating in a stock.
o Decouple flows,
o Create delays.
Each of these characteristics will be discussed in turn.
Stocks have memory
The first key characteristic of stocks is that they have memory (i.e., persistence or inertia). An
easy way to see this is to recall the simple stock-flow structure presented in Figure 1. If the
inflow to the stock is shut-off, the number of entities in the stock will not decrease, but rather
stay at the level it is at when the inflow stops. An outflow in excess of the inflow is required
to decrease the number of entities in the stock. The importance of this characteristic should
not be underestimated. This is because people often believe that shutting-off an inflow to a
stock will cure a problem being created by the number of entities in the stock. Regrettably,
nothing could be further from the truth.
exponentially.
45
46
A second important characteristic of stocks is that they (i.e., the accumulation process)
usually change the time shape of flows . This can be seen by simulating the simple stockflow structure shown in Figure 1, with different time shapes for the flow. Figure 7 for
example, presents the time shape of the stock when the flow is at a constant level of 5
units/time. An examination of the figure reveals that the accumulation process changes the
horizontal time shape of the flow into a linear growth shape for the stock .
(Click on image to see animation)
In a similar way, Figure 8 through Figure 13 show the time shape of the stock for
different time shapes exhibited by the flow.
(Click on image to see animation)
47
Figure 9 shows that a linear decline shape for the inflow, which is at all times positive, causes
the stock to grow at a decreasing rate. Recall the example above in which a decrease in
inflation reduced the rate of increase in price. In this case, price would be analogous to the
stock variable and rate of inflation would be the analogous to the inflow variable.
(Click on image to see animation)
In figure 10, we see a case in which the inflow (valve) is at all time negative. This is
equivalent to saying that the inflow valve is "drawing down the level" (i.e., it's a drain). In
this case, the time path for the inflow valve is at all times negative and is declining linearly.
This causes the stock to decline at an increasing rate. .
48
The case shown in Figure 11 is similar to that of Figure 10 in that the inflow valve is always
negative, indicating that the stock is being drawn down. However, in this case the flow valve
is closing, i.e., becoming less negative. As show in the figure, a linear growth shape for the
flow, which is at all times negative, causes the stock to decrease at a decreasing rate.
(Click on image to see animation)
Figure 12 illustrates case in which "shape" of the inflow time path is not changed by the
accumulation process . In this case, an inflow that increases exponentially causes the stock
(the accumulation ) to increase in a similar fashion . In terms of real-world stock and flow
data, the National deficit and debt data shown in Figure 3 and Figure 4 illustrate this case.
49
In Figure 13, we see the result of having the inflow oscillating in a sinusoidal manner
between a value of 1 and -1, i.e., the stock is being filled and drained repeatedly. As one
would expect, the stock mimics the inflow's time path character (as in Figure 12). It is
important to note, however, that maximum value of the stock is reached after the inflow's
maximum .
50
A fourth important characteristic of stocks is that they create delays. This can be seen by reexamining Figure 13 -- the response of a stock to a sinusoidal inflow. In this example, it is
clear that the stock reaches each of its peaks and troughs after the flow reaches each of its
corresponding peaks and troughs, during each repetition of the cycle. Henri Bergson once
remarked that "time is a device that prevents everything from happening at once" . Bergson's
point of course is that, despite human impatience, events in the world do not occur
instantaneously. Instead, there is often a significant lag between cause and effect. In system
dynamics modeling, identifying delays is an important step in the modeling process because
they often alter a system's behavior in significant ways. The longer the delay between cause
and effect, the more likely it is that a decision maker will not perceive a connection between
the two. Figure 15 presents some examples of stock-flow structures specifying significant
system delays.
Feedback
A lthough stocks and flows are both necessary and sufficient for generating
dynamic behavior, they are not the only building blocks of dynamical systems.
More precisely, the stocks and flows in real world systems are part of feedback
loops, and the feedback loops are often joined together by nonlinear couplings that
often cause counterintuitive behavior.
From a system dynamics point of view, a system can be classified as either "open"
or "closed." Open systems have outputs that respond to, but have no influence
upon, their inputs. Closed systems, on the other hand, have outputs that both
respond to, and influence, their inputs. Closed systems are thus aware of their own
performance and influenced by their past behavior, while open systems are not .
Of the two types of systems that exist in the world, the most prevalent and
important, by far, are closed systems. As shown in Figure 1, the feedback path for a
closed system includes, in sequence, a stock, information about the stock, and a
decision rule that controls the change in the flow . Figure 1 is a direct extension of
the simple stock and flow configuration shown previously with the exception that
an information link added to close the feedback loop. In this case, an information
link "transmits" information back to the flow variable about the state (or "level") of
51
the stock variable. This information is used to make decisions on how to alter the
flow setting.
52
The overall polarity of a feedback loop -- that is, whether the loop itself is positive or negative -- in a
causal loop diagram, is indicated by a symbol in its center. A large plus sign indicates a positive
loop; a large minus sign indicates a negative loop. In Figure 3 the loop is positive and defines a self
reinforcing process. This can be seen by tracing through the effect of an imaginary external shock as
it propagates around the loop. For example, if a shock were to suddenly raise Variable A in Figure 3,
Variable B would fall (i.e., move in the opposite direction as Variable A), Variable C would fall (i.e.,
move in the same direction as Variable B), Variable D would rise (i.e., move in the opposite direction
as Variable C), and Variable A would rise even further (i.e., move in the same direction as Variable
D).
By contrast, Figure 4 presents a generic causal loop
diagram of a negative feedback loop structure. If an
external shock were to make Variable A fall,
Variable B would rise (i.e., move in the opposite
direction as Variable A), Variable C would fall (i.e.,
move in the opposite direction as Variable B),
Variable D would rise (i.e., move in the opposite
directionas Variable C), and Variable A would rise
(i.e., move in the same direction as Variable D).
The rise in Variable A after the shock propagates
around the loop, acts to stabilize the system -- i.e.,
move it back towards its state prior to the shock.
The shock is thus counteracted by the system's
response.
54
In order to make the notion of feedback a little more salient, Figure 6 to Figure 17
present a collection of positive and negative loops. As these loops are shown in
isolation (i.e., disconnected from the other parts of the systems to which they
belong), their individual behaviors are not necessarily the same as the overall
behaviors of the systems from which they are taken.
Positive Feedback Examples
Population Growth/Decline: Figure 6
shows the feedback mechanism responsible
for the growth of an elephant herd via
births. In this simple example we consider
two system variables: Elephant Births and
Elephant Population. For a given elephant
herd, we say that if the birth rate of the
herd were to increase, the Elephant
Population would increase. In this same
way, we can say that if - over time - the
Elephant Population of the herd were
to increase, the birth rate of the herd
would increase. Thus, the Elephant Birth
Figure 6: Positive Loop Responsible for the Growth in an Elephant
rate drives the Elephant Population that
Herd via Births
drives Elephant Birth rate - positive
feedback.
55
56
The relationship between withdrawals and bank health is negative (-) or opposite (O). This means
that if the rate of bank withdrawals increases, the health of the bank decreases as capital reserves are
drawn down. The relationship between the banking industry's health and the rate of bank failures is
also negative. This means that if the health of the banking industry increases, the number of bank
failures per year will decrease.
This vicious cycle was clearly seen during the 1930s. An overall economic downturn caused the rate
of bank failures to increase. As more banks failed, the public's fear of not being able to withdraw
their own money increased. This, in turn, prompted many to withdraw their savings from banks,
which further reduced the banking industry's capital reserves. This caused even more banks to fail.
Figure 10: Feedback structure responsible for growth high school drug use
57
Figure 12 and Figure 13 are two simple and familiar examples of negative feedback processes.
Figure 12 shows the negative feedback process responsible for the dissipation of Itching due to
Scratching. Figure 13 considers the negative feedback involved in Eating to reduce Hunger.
Anincrease in one's Hunger causes a person to eat more food. Increasing in the rate food
consumption, in turn, reduces Hunger.
58
59
An alternative and (often) more desirable way to represent negative feedback processes via
causal loop diagrams is by explicitly identifying the goal of each loop. Figure 16, for
example, shows a causal loop diagram of a generic negative feedback structure with an
explicit goal. The logic of this loop says that, any time a discrepancy develops between the
state of the system and the desired state of the system (i.e., goal), corrective action is called
forth that moves the system back into line with its desired state.
A more concrete example of a negative feedback structure with an explicit goal is shown in
Figure 17. In the figure, a distinction is drawn between the actual number of elephants in a
herd and the desired number of elephants in the herd (presumably determined by a knowledge
of the carrying capacity of the environment supporting the elephants). If the actual number of
elephants begins to exceed the desired number, corrective action -- i.e., hunting -- is called
forth. This action reduces the size of the herd and brings it into line with the desired number
of elephants.
has a number of features that are important to mention. The first is that the authors
have numbered each of the positive and negative loops so that they can be easily
referred to in a verbal or written discussion. The second is that the authors have
taken great care to choose variable names that have a clear sense of direction and have reallife counterparts in the actual system . The last and most important feature is that, although
the figure provides a sweeping overview of the feedback structure that underlies profitability
problems in the paper and pulp industry, it cannot be used to determine the dynamic behavior
of the model (or of the actual system). In other words, it is impossible for someone to
accurately think through, or mentally simulate, the dynamics of the paper and pulp system
from Figure 18 alone.
61
Figure 18: Causal Loop Diagram of a Model Examining Profitability in the Paper
and Pulp Industry
Figure 19 is a causal loop diagram of a system dynamics model created to examine forces
that may be responsible for the growth or decline of life insurance companies in the United
Kingdom. As with Figure 18, a number of this figure's features are worth mentioning. The
first is that the model's negative feedback loops are identified by "C's," which stand for
"Counteracting" loops. The second is that double slashes are used to indicate places where
there is a significant delay between causes (i.e., variables at the tails of arrows) and effects
(i.e., variables at the heads of arrows). This is a common causal loop diagramming
convention in system dynamics. Third, is that thicker lines are used to identify the feedback
loops and links that author wishes the audience to focus on. This is also a common system
dynamics diagramming convention . Last, as with Figure 18, it is clear that a decision maker
would find it impossible to think through the dynamic behavior inherent in the model, from
inspection of Figure 19 alone.
62
Figure 19: Causal Loop Diagram of a Model Examining the Growth or Decline of
a Life Insurance Company .
Archetypes
An area of the field of system dynamics or, more precisely, of the much broader field of
"systems thinking," that has recently received a great deal of attention is archetypes .
Archetypes are generic feedback loop structures, presented via causal loop diagrams, that
seem to describe many situations that frequently appear in public and private sector
organizations. Archetypes are thought to be useful when a decision maker notices that one of
them is at work in his or her organization. Presumably, the decision maker can then attack the
root causes of the problem from an holistic and systemic perspective . Currently, nine
archetypes have been identified and cataloged by systems thinkers, including:
o Balancing Process with Delay,
o Limits to Growth,
o Shifting the Burden,
o Eroding Goals,
o Escalation,
o Success to the Successful,
o Tragedy of the Commons,
63
real system can grow infinitely large, and hence that no model of a real system should be able
to grow infinitely large. Similarly, common sense suggests that, since many real world
variables cannot take on negative values, their model-based counterparts should not be able to
take on negative values .
When a system dynamicist looks for relationships in an actual system that prevent its stocks
from going negative or growing infinitely large, he or she is usually looking for the system's
nonlinearities. Nonlinear relationships usually define a system's limits .
Nonlinear relationships play another important role in both actual systems and system
dynamics modeling. Frequently, a system's feedback loops will be joined together in
nonlinear relationships. These nonlinear "couplings" can cause the dominance of a system's
feedback loops to change endogenously. That is, over time, a system whose behavior is being
determined by a particular feedback loop, or set of loops, can (sometimes suddenly)
endogenously switch to a behavior determined by another loop or set of loops. This particular
characteristic of nonlinear feedback systems is partially responsible for their complex, and
hard-to-understand, behavior . As a result, system dynamics modeling involves the
identification, mapping-out, and simulation of a system's stocks, flows, feedback loops, and
nonlinearities.
One of the reasons that mental models are so complex is simply that the real-world systems
that humans are trying to understand are highly complex. Over the years, system dynamicists
have identified characteristics that seem to appear again and again in real-world systems -particularly social systems . They have found that: (1) symptoms of a problem are often
separated from the actual problem by time and space; (2) complex systems often behave
counter to human intuition; (3) policy intervention in complex systems can frequently yield
short-term successes but long-term failure, or the reverse; (4) internal system feedback often
counters external policy intervention;(5) it is better to structure a system to withstand
uncertain external shocks than to try to predict those external shocks; (6) real-world complex
systems are not in equilibrium and are continually changing.
These characteristics arise due to the nonlinear stock, flow, feedback structures of social
systems.
Consider once again, Figure 19, shown below. Investment performance in an insurance
company (shown in the top right of the figure) is shown to be directly influenced by portfolio
mismatch, but only after a significant delay, and indirectly influenced by many factors that
are far removed (spatially) from the firm's financial performance (e.g., sales person skills).
Managers in actual insurance companies may or may not be aware of these delays and
connections, but their existence ensures that, if a problem arises with an insurance firm's
investment performance, deciding what to do to permanently correct it will be difficult
indeed. Mentally keeping track of the various interactions and delays, over time, is next to
impossible in such a system.
Figure 19: Causal Loop Diagram of a Model Examining the Growth or Decline of a Life
Insurance Company .
The fact that system problems and system symptoms are separated by time and space implies
the need for a holistic or systems approach to problem solving. Although this is perhaps
obvious to someone reading this book, it is the exact opposite of the traditional approach to
problem solving practiced in most of science and in most organizations. The traditional
approach to problem solving is the reductionist approach, which involves breaking down a
system experiencing a problem into "manageable" pieces and then analyzing each piece in
isolation. The reductionist approach ignores the connections between a system's pieces,
because the behavior of an entire system is thought to be merely the sum of the behaviors of
its parts. This view is implicitly a "linear" view of the world as the behavior of a linear
system is, indeed, merely the sum of the behavior of its parts. The behavior of a nonlinear
system, however, is more than just the sum of its parts. A nonlinear system can only be
analyzed in its entirety, with the connections between its parts being as important as the parts
themselves. An old Sufi allegory known as the "Blind Ones and the Matter of the Elephant"
illustrates the folly of the reductionist approach to problem solving, and the usefulness of a
"nonlinear" approach to problem solving, quite nicely.
66
Beyond Ghor was a city. All its inhabitants were blind. A king with his
entourage arrived nearby; he brought his army and camped in the desert.
He had a mighty elephant, which he used in attack and to increase the
people's awe.
The populace
became anxious to
learn about the
elephant, and some
sightless from
among this
community ran like
fools to find it. Since they did not know even the form or shape of the
elephant, they groped sightlessly, gathering information by touching
some part of it. Each thought that he knew something because he could
feel a part.
When they returned to their fellow-citizens, eager groups clustered
around them, anxious, misguidedly, to learn the truth from those who
were themselves astray. They were asked about the form, the shape, of
the elephant, and they listened to all they were told.
The man whose hand had reached the ear said, "It is a large, rough
thing, wide and broad, like a rug." One who had felt the trunk said, "I
have the real facts about it. It is like a straight and hollow pipe, awful
and destructive."One who had felt its feet and legs said, "It is mighty
and firm, like a pillar."
Each had felt one part out of many. Each had perceived it wrongly.
Idries Shah. 1969. "The Blind Ones and the Matter of the Elephant," p. 25. In: Tales of the Dervishes. New York: E.
P. Dutton.
Counterintuitive Behavior
Nonlinear stock-flow-feedback systems frequently behave in ways that are counterintuitive or
different from that which a decision maker's unaided mental model would suggest -particularly in response to the dynamics of a policy change. Forrester notes, for example, that
both the places where "high leverage points" (i.e., places at which a policy change can
permanently alter a system's behavior) are located, and the direction in which a decision
maker must "push" a system to change it's behavior, are counterintuitive .
Frequently, the counterintuitive behavior of social systems is due to the existence of negative
feedback loops. As an example, consider a small sailboat with a rudder in the stern. If the
sailor operating the boat wishes to turn the bow (front) to the starboard (right), he or she must
67
turn the rudder, located in the stern, to port (left). In other words, he or she must intervene
with a policy change (turn the rudder) in a place (the stern) different from where the change
will manifest itself (the bow) and in a direction (port) opposite from the one desired for the
entire system (starboard). A sailboat is a negative feedback system in the sense that there is a
desired direction the sailor wishes to point the bow of the boat and an actual direction the
bow of the boat is pointing. If a discrepancy develops between the desired direction and the
actual direction, corrective action (moving the rudder) is taken.
A second example of a simple negative feedback loop system that can exhibit counterintuitive
behavior is a thermostat. Consider the following thought experiment. If a person is given a
cigarette lighter (i.e., a small heat source) and an ice cube (i.e., a small source of cold) and
asked to apply one to the sensor on the thermostat to make a room warmer, which one should
he or she choose? The answer, of course, is the ice cube because applying a cold source to the
thermostat's sensor would cause the furnace to turn on and heat the room.
Figure 20: Ignoring the Long Run Effects of Feedback Can Lead to Unintended
Consequences
Consider the example of congestion in a city's expressway system. If the policy response is to
significantly expand the capacity of the system, the short run result is a lessening of
congestion. But, as information about the improved, even pleasant-to-use, expressway system
begins to affect longer run decisions such as where people choose to live (e.g., people move
to the suburbs and commute to work via the improved expressway system), the congestion
can return and even be worse than before. Of course, the effect can occur in the opposite
direction as, closing down some of a city's expressway to create congestion can, in the long
term, cause people to resettle near the city and/or to build and use public transportation.
68
Policy Resistance
Frequently, a nonlinear feedback system will respond to a policy change in the desired
manner for a short period of time, but then return to its pre-policy-change state. This occurs
when the system's feedback structure works to defeat the policy change designed to improve
it.
Policy resistance is caused by a system's negative feedback processes. Consider the example
of the percentage of white students attending Boston schools with nonwhite students, before
and after mandatory busing was instituted as a policy change. The data for the years 1968 1992 is shown in Figure 21. Inspection of the figure reveals that the percentage of white
students attending Boston schools with nonwhite students shot up immediately after the
busing policy was instituted in 1974, but then gradually declined so that by 1982 it had return
to its pre-busing level.
Unpredictability
Many decision makers spend enormous amounts of time and money trying to develop models
to precisely predict or forecast the future state of a system. From a system dynamics point of
view, however, this is a poor use of a decision maker's resources. There are two reasons for
this. The first is that it is impossible, in principle, to precisely predict the future state of a
nonlinear feedback system, except in the very short term. The second is that, even if it were
69
possible to predict the future state of a nonlinear feedback system, a decision maker's
resources are better spent trying to predict the behavior mode of a system in response to a
proposed policy change, and in trying to redesign the stock-flow-feedback structure of a
system so that it behaves well, regardless of what happens in the future.
70
71
Figure 24: Simulated Time Series Plot of Hunters from the "Model" and "Real
World System"
Figure 24 is a time series plot of the simulated stock of hunters from both the "model" and
"real world system." Before period twenty, the two curves are clearly identical and overlay
perfectly. After period twenty, however, they begin to diverge significantly. Indeed, from
about period thirty forward, the perfectly specified "model" of the "real world system"
predicts the correct number of hunters in the system, only by chance. The conclusion is thus
that, even a perfectly specified model cannot predict the future state of a nonlinear feedback
system, except in the very short term. Point prediction is thus impossible in principle.
Disequilibrium
As was pointed out earlier, all actual social systems exist in a state of disequilibrium. This implies that
actual social systems possess on-going pressures for change, and stocks that decouple flows and allow
inflows to differ from outflows. It also implies that using equilibrium-based modeling techniques,
such as many of those used in economics and management, will frequently not yield insights that
directly relate to the dynamic behavior of actual social systems.
In the previous chapter, Building Blocks, we presented the basic "concepts" and "language" used to
describe the structure underlying complex system behavior. We put forth the case that a well-known
set of time paths can describe, individually or in combination, the behavior of virtually all dynamical
systems. We introduced the idea that all dynamic behavior in the world occurs due to the interaction
between stock and flow variables, and the interaction between sets of stocks/flows within larger
feedback loops.
In this chapter, we use these ideas to explore the
underlying system structure responsible for the basic
families of time paths including: exponential growth and
decay, goal-seeking behavior, system oscillation, and sshaped behavior. To do this, we develop a sequences of
small simulation models that explain the major modes of
systems behavior, while presenting some the basic
mathematics behind computer simulation.
Figure 2: The Amount that Flowed into the Stock is the Area of the Rectangle (DT = 1)
Knowing that flows cause stocks to fill or drain, looking at the time path of the flow variable
in Figure 1 we can say that the height to which the stock will fill due to its rate of flow over
the (arbitrarily determined) time period from t=0 to t=1, is the area beneath the time path of
the flow from period t=0 to t=1. This is shown by the shaded rectangle in Figure 2. The area
of the rectangle is easy to calculate, of course, as it is merely the height of the rectangle (i.e.,
the value of the flow at any point from t=0 to t=1) multiplied by the length of the rectangle
73
(i.e., the time span from t=0 to t=1). If we define the time span from t=0 to t=1 to be "DT"
then the:
Exact Amount that Flowed into Stock from Time Period 0 to Time Period 1
= Area of Rectangle
= Value (Height) of the Flow * Change in Time
= f(1) * DT
Equation 1
Simulated Solutions
The situation gets a little more complicated, however, when the flow variable in Figure 1
is not constant but changes over time. Figure 3 is a graph of a quadratic inflow to the
stock (i.e., one that is nonlinear with one "bend" or "curve"). Applying the same logic
that was used in the last example -- i.e., finding the area of a rectangle "beneath" the
time path of the flow -- yields an overestimate of the amount that has flowed into the
stock from t=0 to t=1. The "wedge" area above the curve in Figure 3 is the amount by
which the rectangle overestimates the amount that has flowed into the stock.
Figure 3: The Approximate Amount that Flowed into the Stock is the Area of the
Rectangle (DT = 1)
But what if the change in time, DT, is made smaller? What if DT is, say, cut in half?
Figure 4 replicates the time path from Figure 3, but shows a DT of .5 -- i.e., half as large
as before.
74
Figure 4: Approximating the Amount that Flowed into the Stock (DT = .5)
This time, the approximate amount that has flowed into the stock from t=0 to t=1 is
the sum of the areas of two rectangles. That is the:
Approximate Amount that Flowed into Stock from Time Period 0 to Time
Period 1
= Area of Rectangle 1 + Area of Rectangle 2
= [f(.5) * DT ] + [f(1) * DT]
= [f(.5) + f(1)] * DT
= t=0
t=1
f(t) * DT
Equation 2
Further, the amount by which the sum of the area of the rectangles overestimates the
amount that has flowed into the stock is now the sum of the two wedges above the time
path of the flows.
There are two significant implications of reducing DT to .5 -- i.e., of cutting it in half.
The first is that it doubles the number of areas (rectangles) that have to be calculated
(from one to two). The second is that it reduces the error in the estimate of the amount
that flowed into the stock from t=0 to t=1. The second implication can be seen by
comparing Figures 4 and Figure 3. The sum of the areas of the two wedges above the
time path of the flow in Figure 4 is less than the area of the single wedge above the time
path of the flow in Figure 3.
75
Figure 5: Approximating the Amount that Flowed into the Stock (DT = .25)
In fact, the error in the estimate of the amount that flowed into the stock from t=0 to t=1
can be reduced even more by systematically reducing the size of DT. Figure 5 shows
what happens when DT is cut in half again (to a value of .25) and Figure 6 shows what
happens when DT is given a value of .125. In each case, the overestimate of the amount
that flowed into the stock is reduced and the number of areas (rectangles) that must be
calculated is doubled. For example, in the case of Figure 5 the:
Approximate Amount that Flowed into Stock from Time Period 0 to Time
Period 1
= Area of Rectangle 1 + Area of Rectangle 2 + Area of Rectangle 3 + Area
of Rectangle 4
= [f(.25) * DT ] + [f(.5) * DT ] + [f(.75) * DT ]+ [f(1) * DT]
= [f(.25) + f(.5) + f(.75) + f(1)] * DT
= t=0
t=1
f(t) * DT
Equation 3
76
Figure 6: Approximating the Amount that Flowed into the Stock (DT = .125)
The trade-off between accuracy and number of calculations should be clear at this
point. The more accurate the estimate of the amount that has flowed into a stock, the
more areas (rectangles) that have to be calculated.
Most modern-day system dynamics software packages allow a system dynamicist to
create a model by placing icons (stocks, flows, feedback links, etc.) on an electronic piece
of paper displayed on a computer screen, and connecting them together with the
computers mouse. While this is occurring, the software automatically generates
equations that correspond directly to each of the icons. The stock icon in Figure 1, for
example, corresponds directly to a mathematical equation that tells a computer how to
calculate the amount that has flowed into it during a particular period of time. In
general terms, this equation is:
only the approximate amount that has flowed into a systems stocks at short time
intervals (DTs) between successive computations. Further, to determine the approximate
amount that has flowed into a systems stocks at a future period of time, a simulated
solution requires the calculation of the amounts that flowed into the systems stocks
in all earlier periods of time. Lastly, a simulated solution is a particular solution (i.e., a
particular time path) that cannot reveal anything about the general nature of the
systems dynamics.
Analytical Solutions
In principle, a dynamical systems time step, DT, could be cut in half forever. If this
were to occur, the error in approximating the amount that flowed into the systems
stocks would be systematically reduced until it became infinitesimally small. In more
traditional mathematical notion this means that the:
Exact Amount that Flowed into Stock from Time Period 0 to Time Period
1
= lim DT -> 0 [ t=0
= t=0
t=1
t=1
f(t) * DT ]
f(t) * dt
Equation 5
Equation 5 represents (in general terms) the continuous time version of the dynamical
system presented in Figure 1. In this version of the model, DT is infinitesimally
small and the solution to the equation reveals exactly how much has flowed into the
systems stock from t=0 to t=1 . The solution to Equation 5, if it exists, is an exact
analytical solution .
In contrast to simulated solutions, analytical solutions are general solutions to dynamic
systems of equations. Rather than revealing the approximate amounts that have flowed
into a systems stocks at short time intervals (DTs) between successive computations,
they reveal the exact amounts that have flowed into a systems stocks at any period of
time. In other words, for any system possessing an analytical solution, any time period
can be substituted into the solution and it will yield the exact amounts that have flowed
into the systems stocks. The solution does not require the calculation of the amounts
that flowed into the systems stocks in all earlier periods of time. In addition, the form
of a systems analytical solution reveals much about the general nature of its dynamics,
even without any numerical computation.
Given all of the apparent advantages offered by exact analytical solutions, why do
modelers bother to use simulated solutions at all? The answer is quite simple: only
linear systems have exact analytical solutions. This is because: (1) they can be broken
down into parts, (2) the behaviors of the parts can be determined, and (3) the behavior
of the entire system can be found by adding together the behaviors of the parts. In other
78
words, the behavior of a linear dynamical system is merely the sum of the behaviors of
its parts.
Nonlinear systems, on the other hand, cannot be broken down into pieces and solved
analytically. They must be analyzed as a whole. The connections between the parts of a
nonlinear system are as vital to its behavior as the pieces themselves. Indeed, the
behavior of a nonlinear system is more than merely the sum of the behaviors of its parts.
Since nonlinear dynamical systems do not have exact analytical solutions, their behavior
can only be determined through simulation.
In sum, if the real world is nonlinear (i.e., has limits), if humans are incapable of
thinking through all of the dynamic implications of their mental models, and if
nonlinear dynamical models have no analytical solutions, simulation modeling is
necessary for improved dynamical thinking and learning.
Exponential Growth
Exponential growth is one of the most common time paths exhibited by systems in the world.
It has two characteristics that are very important to note. The first characteristic is its power.
Exponential growth can occur very rapidly. The second characteristic is its insidiousness.
Exponential growth can "sneak up" on a person!
Consider the case of repeatedly folding a standard piece of paper in half, doubling its
thickness with each fold . After five or six folds, the paper is not particularly thick. But how
thick would it be after 36 more folds? As shown in Figures 7a and 7b, after 42 folds a
standard piece of paper would be approximately 280,000 miles thick -- more than the
distance from the Earth to the moon! Further, the shape of the plot shows that the big
explosion in thickness occurs at the end of the plot. For most of the simulation run, the
systems growth is hardly distinguishable from the horizontal axis . The last few doublings,
however, really make the thickness grow .
79
In terms of a system dynamics model that can produce exponential growth, consider Figure 8
-- a "first cut" stock-flow structure of an elephant herd system. The figure presents the
models stock and flow icons, the corresponding system dynamics equations, and
the dimensions of each equation. As will become apparent throughout the remainder of this
book, the specification of the dimensions of every equation in a system dynamics model is an
important part of the modeling process. It helps the modeler both document a model and
conceptualize its structure. Stocks are dimensioned in terms of "units" ("Elephants") and
flows are dimensioned in terms of "units/time" ("Elephants/Year"). Other variables in a
system dynamics model must possess dimensions that correspond algebraically to its stockflow-feedback loop structure . Examples of system dynamics models that have been properly
dimensioned will be presented ahead.
Figure 9: Simulation of the First Cut of the Elephant Herd Model (Initial Elephants = 10)
Before moving directly to a structure that exhibits the exponential time shape, it is perhaps
better to "think like a modeler" for the moment. A good system dynamicist will test each of
the structures he or she creates for "robustness." This means that he or she will test to see if
their model behaves "properly" under a variety of circumstances, both normal and extreme. If
80
a model behaves properly in response to robustness testing, the system dynamicist can be
confident that it will behave properly when interfaced with other model structures.
Figure 10: Simulation of the First Cut of the Elephant Herd Model (Initial Elephants = 0)
Figure 10 shows the results of a robustness test done on the "first cut" elephant herd model.
For the purpose of the test, the initial number of elephants in the herd (stock variable) was
changed to zero. Clearly the simulation makes no sense. The number of elephants in the herd
grows even though there are initially no elephants to produce baby elephants. The conclusion
is that the model does not behave properly in response to this extreme test and is therefore
"nonrobust."
The next cut of the model should be aimed at correcting the robustness problem. The first cut
of the model generated an implausible result because elephants are needed to produce more
elephants. This biological fact implies that a feedback link from the stock of elephants to the
flow of elephant births is required so that the computer can calculate the number of baby
elephants produced by the elephant herd each year.
Figure 11 presents the "second cut" of the elephant model. It contains a feedback link from
the stock of elephants to the birth rate flow, an additional icon (the birth rate coefficient
(BirthRateCoef)), and an additional information link.
Figure 11: "Second Cut" of the Elephant Herd Model (Initial Elephants = 0)
81
Figure 12 shows the results of a simulation of the model when the initial number of elephants
is set at zero. Clearly, the new formulation of the model has cured the robustness problem
revealed in Figure 10. When there are initially no elephants in the herd, no baby elephants are
born and the size of the herd remains at zero.
(click on image to run simulation)
Figure 12: Results of a simulation using "Second Cut" of the Elephant Herd Model (Initial
Elephants = 0)
Figure 13, on the other hand, is a simulation of the model when the initial number of
elephants is ten. In this case, the positive feedback loop created between elephants and baby
elephants causes the exponential growth path of the elephant herd.
(Click on image to run simulation)
Figure 13: Simulation of the "Second Cut" of the Elephant Herd Model (Initial Elephants =
10)
Generic Structure
Over the years, system dynamicists have identified combinations of stocks, flows and
feedback loops that seem to explain the dynamic behavior of many systems. These frequently
occuring stock-flow-feedback loop combinations are often referred to as "generic structures"
.
82
Figure 14 shows a generic structure responsible for exponential growth and its corresponding
causal loop diagram. It is the generic version of Figure 11 -- a generic first order positive
feedback loop system . Most system dynamicists think about this structure when modeling a
system that grows exponentially; the contents of the stock produces more of the contents of
the stock.
83
Figure 16: Structure for the growth of knowledge in a particular flield of study
Exact Analytical Solution for a First Order, Linear, Positive Feedback Loop System
The first order positive feedback loop system of Figure 14 is a linear system. As a result, in
addition to its simulated solution, it possesses an exact analytical solution. This solution is:
84
Initialization Phase
o Create a list of all equations in required order of
85
evaluation.
o Calculate initial values for all stocks, flows and
auxiliaries (in order of evaluation).
Iteration Phase
o Estimate the change in stocks over the interval DT.
o Calculate new values for stocks based on this
estimate.
o Use new values of stocks to calculate new values
for flows and auxiliaries.
o Add DT to simulation time.
o Stop iterating when Time >= StopTime
Step 1 of the Iteration Phase is the place where most numerical integration methods differ.
More specifically, different numerical integration methods estimate the change in a model's
stocks over the interval DT in different ways.
Although many numerical integration methods exist, the two that are most frequently used in
system dynamics modeling are Euler's method and a second order Runge-Kutta method.
Euler's method is the simplest and least accurate (for a given DT) numerical integration
method available . Indeed, due to its conceptual simplicity, it is the method upon which the
nomenclature of the generic system dynamics stock equation is based.
In Step 1 of the Iteration Phase of the simulation of a system dynamics model, Euler's method
estimates the change in a model's stocks over the interval DT as:
Stock = DT * Flow at Beginning of DT
Thus, in Step 2 of the Iteration Phase, the new values for a model's stocks are calculated in
the following way:
Stockt = Stock(t-DT) + Stock
Stockt = Stock(t-DT) + DT * (Flow(t-DT) => t)
Of course, this is precisely the same formulation as Equation 4 of Analytical-vs-Simulated
Solutions.
A second-order Runge-Kutta method differs from Euler's method in that it uses two flow
calculations within a given DT to create an estimate for the change in a model's stocks over
86
the interval DT. More precisely, during Step 1 of the Iteration Phase of a simulation, a second
order Runge-Kutta method estimates the change in a model's stocks over the interval DT as:
F1 = DT * Flow at Beginning of DT [same as in Euler's method]
F2 = DT * Flow at End of DT = DT * Flow(Stock(t) + F1)
Stock = 1/2 * (F1 + F2)
Stockt = Stock(t-DT) + Stock
Stockt = Stock(t-DT) + 1/2 * (F1 + F2)
In other words, a second-order Runge-Kutta method estimates the change in a model's stocks
by taking the mean of the flows that occur at the beginning and at the end of each time step.
Figure 17: Comparison of Exact Analytical Solution to Simulated Solution (Euler's Method;
DT = .5)
Figure 17 compares the results of simulating the generic first order positive feedback loop
system shown in Figure 14 via Euler's method with a DT of .5, against the exact analytical
solution to the system given by Equation 1. In each case, the initial value of the stock is set
equal to 100 units and the value of the growth coefficient is set at .02 units/unit/time.
Athough each solution starts at the same place, the simulated solution quickly diverges from
its exact counterpart. Indeed by period 10, the exact amount in the stock is 122.14 units,
while the simulated solution indicates that it contains only 122.02 units.
In a similar way, Figure 18 compares the exact analytical solution to the generic first order
positive feedback loop system against a simulated solution using Euler's method and a DT
of .25. Clearly, cutting DT in half improves the accuracy of the simulated solution, as the
simulated value of the stock at period 10 is now 122.08.
87
Figure 18: Comparison of Exact Analytical Solution to Simulated Solution (Euler's Method;
DT = .25)
Finally, Figure 19 compares Equation 1 to a simulated solution utilizing a second order
Runge Kutta method and a DT of .25. Inspection of this figure reveals that the simulated
solution is now equal to the exact solution, to two places to the right of the decimal point,
throughout the entire simulation.
Figure 19: Comparison of Exact Analytical Solution to Simulated Solution (Second Order
Runge Kutta Method; DT = .25)
Measures of Exponential Growth
The exact analytical solution to a first order, linear, positive feedback system (Equation 1)
can be used to derive two important measures of exponential growth. The first of these
measures is the system's time constant. The second is sytem's doubling time.
Time Constant
88
Figure 20 depicts a system dynamics representation of a first order, linear, positive feedback
loop system with an exact analytical solution represented by Equation 1. The time constant of
this system, Tc, measured in units of time, is defined to be 1/Coef.
89
Figure 21: Exponential Growth After One and Two Time Constants have Elapsed
Figure 21 shows the amount of exponential growth that has taken place in a first order, linear,
positive feedback loop system, with a Coef of .1 and an initial value of 100, after one and two
time constants have elapsed. After one constant, the stock has grown from 100 to 271.83 and
after two time constants it has grown to a value of 738.90.
Doubling Time
The second measure of how quickly exponential growth is proceeding in a first order, linear,
positive feedback system is its doubling time. A system's doubling time is simply the amount
of time it takes for the contents of its stock to double.
The doubling time of a first order, linear, positive feeback loop system, T d, is equal to seventy
percent of its time constant. That is: Td = .7 * Tc . For the more mathematically inclined
reader, the derivation of this result is provided in the shaded box below.
Derivation of the Doubling Time for a First Order, Linear, Positive Feedback Loop
System
The doubling time for a first order, linear, positive feeback loop system is calculated
using Equation 1. If the doubling time, Td, is defined to be the time it takes to double the
initial value of a stock, then:
2*Stock0 = Stock0 * eCoef * Td
Since the system's time constant, Tc, is 1/Coef, then the system's Coef = 1/Tc. Thus:
2 * Stock0 = Stock0 * e 1/Tc * Td
Dividing both sides by Stock0 yields:
2 = eTd/ Tc
Taking the natural logarithm of both sides yields:
ln(2) = ln(eTd/Tc)
Or:
.69 = Td / Tc
Or:
.7 = Td / Tc
90
Or:
Td = .7 * Tc
Thus, the doubling time of a first order, linear, positive feeback loop system is seventy
percent of its time constant.
Figure 22 shows the same simulation run presented in Figure 21. This time the figure shows
that the system's stock doubles from a value of 100 to a value of 200 in (approximately) the
seventh period (.7 multiplied by the time constant of 10 periods).
Figure 22: Doubling Time for a First Order, Linear, Positive Feedback Loop System
The concept of doubling time leads directly to a heuristic known as the Rule of 70. This rule
says that, if you know, or can estimate, how quickly an exponentially growing system is
growing (i.e., if you know, or can estimate, Coef in Equation 1), you can calculate its
doubling time as Td = (70 / Coef) * 100.
Consider, for example, the growth of the United States economy. As shown in Figure 23, U.S.
nominal GDP grew exponentially at a rate of 7 percent per year, from 1959 to 1995 (i.e., Coef
is estimated to be .07055). At this rate of growth, the Rule of 70 says that the nominal size of
U.S. economy will double in (70 / .07055)*100 = 9.86 years.
91
Figure 1 presents a generic, first order, linear, negative feedback loop system. The model is
initialized in equilibrium by setting the initial value of the stock equal to its goal, and then
"shocked" out of equilibrium (at time=1) by a step function that changes the system's goal
from ten to fifteen. This procedure -- ie., starting a system dynamics model in equilibrium
and then shocking it out -- is widely used in system dynamics because it allows the modeler
to see the "pure" behavior of the system in response to the shock. Moreover, it illustrates
another important idea in system dynamics modeling: A system containing negative feedback
loops will be in equilibrium only when all of its stocks are equal to all of its goals
simultaneously.
The implication of this idea is very important. In the real world it is rare, if not impossible, to
find actual systems (particularly actual social systems) that exist in states of equilibrium
because actual systems contain many negative feedback loops that do not reach their
92
goals simultaneously. Thus, system dynamicists often start their models in states of
equilibrium, not because they feel that this reflects reality, but rather because it is a useful
reference point for analyzing the "pure" behaviors of their models .
The behavior exhibited by the negative feedback loop system as shown in Figure 2 is goal
seeking. When the goal is increased from ten to fifteen, a discrepancy between the stock and
its goal is created. In response to this discrepancy, the system initiates corrective action by
increasing its flow and smoothly raising its stock to a value of fifteen . The time it takes the
system to reach its new goal is determined by the size of TimeCoef. The bigger TimeCoef is,
the longer it takes for the system to adjust to its new goal. This is illustrated in Figure 3,
where the negative feedback loop system of Figure 1 is simulated with three different values
of TimeCoef (1, 2, and 3) in response to a reduction in the goal (opposite the case shown in
Figures 1 and 2) from ten down to five with a step function at time=1.
(Click on image to run simulation)
Equation 1
To study Equation 1, it is helpful to look at the special case when the system is seeking a goal
of zero. Equation 2 presents this special case. It found by simply substituting goal values of
zero into Equation 1.
Equation 2
One very important thing to note about Equation 2 is that it is very similar to Equation 1
of Exponential Growth, the exact analytical solution to a linear positive feedback loop
system. Indeed, Equations 1 of Exponential Growth and Equation 2 differ only by the signs of
their exponents. Equations 1 of Exponential Growth has an exponent of Coef * t and
Equation 2 has an exponent of -(1/TimeCoef) * t. Since Coef and 1/TimeCoef are both
numbers, the exponents, and hence the equations, differ only by sign.
The reason that Equation 2 has a minus sign in front of its exponent is that it represents a
system seeking a goal of zero. Thus, under the assumption that the system's stock contains
positive values, the system will steadily lose units via its outflow until there is nothing left .
This process is known as exponential decay.
For the more mathematically inclined reader, the derivation of Equation 1 is presented in the
shaded box below.
94
Derivation of the Analytical Solution to the First Order, Linear, Negative Feedback
Loop System
Exponential Decay
Figure 1 below is a system dynamics representation of a linear first order negative
feedback loop system with an implicit goal of zero. The figure includes the model's
equations, a causal loop diagram, and a simulation of the model's structure. The
simulation is an example of exponential decay behavior that corresponds to the
exact analytical solution to the system presented in Equation 2 of Goal Seeking
Behavior.
(Click on image to run simulation)
95
Figure 1: First Order, Linear, Negative Feedback Loop System with an Implicit Goal of Zero
goal will the negative feedback loop system have made after one time constant has
elasped? The answer can be found by substituting the time constant into
the Equation 2 of Goal Seeking Behavior:
Stockt = Stock0 * e-(1 / TimeCoef) *Tc
Stockt = Stock0 * e-(1/TimeCoef)*TimeCoef
Stockt = Stock0 * e-1
Stockt = Stock0 * (1/e)
Stockt = Stock0 * .37
This result indicates that the system loses 63% of the contents of its stock after one
time constant has elapsed. Extending this logic reveals that the system loses 86%
of the contents of its stock after two time constants have elasped (Stock t =
Stock0 * .37 * .37 = Stock0 * .14) and 95% of the contents of its stock after three
time constants have elapsed (Stockt = Stock0 * .37 * .37 * .37 = Stock0 * .05).
Figure 2 repeats the simulation from Figure 1 and confirms this result graphically.
As in the case of a first order positive feedback loop system, the negative loop
system's half life is 70% of its time constant. That is: T h = .7 * Tc. Once again, the
derivation of ths result is presented in the shaded box below for the more
methematically inclined reader. A graphical presentation of the result is also shown
in Figure 2.
(Click on image to run simulation)
97
Figure 2: Behavior of a First Order, Linear, Negative Feedback Loop System after Three Time Constants have
Elapsed
The analysis of the first order negative feedback loop system with an implicit goal
of zero can be extended to the more general negative feedack loop model originally
presented in Figure 2 of Goal Seeking Behavior, giving the following insight: A
first order, negative, feedback loop system reaches approximately 95% of its goal
after three time constants have elapsed.
Derivation of the Half Life for a First Order, Linear, Negative Feedback Loop
System
The half life of a first order, linear, negative feeback loop system is calculated
usingEquation 2 of Goal Seeking Behavior. If the half life, Th, is defined to be the time it
takes to cut the initial value of a stock in half, then:
1/2 * Stock0 = Stock0 * e-1/Coef * Th
Since the system's time constant, Tc, is 1/Coef, then the system's Coef = 1/Tc. Thus:
1/2 * Stock0 = Stock0 * e-Tc * Th
Dividing both sides by Stock0 yields:
1/2 = e - Th/Tc
Taking the natural logarithm of both sides yields:
ln(1/2) = ln(e -Th/ Tc)
Or:
ln(1) -ln(2) = ln(e-Th/Tc)
Or:
0 - .69 = - Th / Tc
Or:
.7 = Th / Tc
Or:
Th = .7 * Tc
98
Thus, the half life of a first order, linear, negative feeback loop system is seventy percent
of its time constant.
System Oscillation
System oscillation is the characteristic symptom of negative feedback structures in
which the information used to take goal-seeking action is delayed (See Figure 1).
In such cases, a control action is not based on the current state of a system but on
some previous state or value. As you can imagine, usingdated information to
control the approach to a target is likely to cause the system to miss or overshoot
its goal. Specific structural characteristics of a system, such as delay
duration and delay order, will determine whether the resulting oscillation will
diminish over time, reach some sustained amplitude and frequency, or experience
an increasing amplitude.
Figure 1: System oscillation is created when decision information in negative feedback structures is delayed.
Figure 2 shows a simple system in which the information about the current "level"
of the system variable first passes through a single stock/flow structure before
being used to take a controlling action (information path is shown in red). Thus, the
decision to take action by changing the variable, Action, is based not on the current
state of the system but on some previous value.
99
Given this structure, Figure 3 shows what happens if the goal, DesiredSystemLevel,
is increased by 5 units. Because of the delay, the system overshoots its target at
about time=6, reaches a maximum of 22 units at time=10, then undershoots at
about time=12, and so on. Eventually, the system does find its target 50 time units
after the goal changed!
Figure 3: A step increase in goal value causes a damped oscillation response in system.
100
One of the primary herd control "leverage points" in this system is to change the rate at which
elephants are "harvested" by increasing or decreasing the number of hunters. Keep in mind
that the elephant population level is a function of the elephant Net Birth Rate and the Harvest
Rate. Thus, by increasingthe hiring rate of hunters, the total number of hunters will increase.
An increase in the number of hunters will increase the elephant harvest rate. An increase in
harvest rate will "draw down" the level of elephants in the herd.
Consider a scenario in which the net birth rate of the elephant herd increases from 8 elephants
per year to 12 elephants per year. Due to inherent delays in herd data gathering and analysis
methods, this increase is not immediately detected. After some delay, the birth rate trends are
revealed and the manager decides to hire more hunters. However, because of the delays in
hiring, more time passes before the hunters are actually onboard. As the hunter population
increases, the harvest rate increases, which causes the herd population growth to slow, stop,
and eventually turn downward. Since the system delays are still in place, however, the herd
level continues to drop and eventually undershoots the target, prompting the manager to
reduce the number of hunters. This "trial and error "oscillating process continues until the
equilibrium target is reached, almost 20 time units from the initial step increase in birth rate!
Figure 5 and 6 shows the results of this scenario.
101
Types of Oscillations
Information delays are prevalent in the real world so it's no surprise that oscillations are the
most common dynamic behaviors. There are four basic types:
Sustained
Oscillation
Damped
Oscillation
Exploded
Oscillation
Chaos
Oscillation
102
weather patterns
S-Shaped Growth
S-shaped growth is the characteristic behavior of a system in which a positive and
negative feedback structure fight for dominance but result in long-run equilibrium.
As illustrated in Figure 1, the positive feedback exponential growth loop (shown in
blue) initially dominates the system, causing the system variable to increase at an
increasing rate. However, as the system approaches its limit or "carrying capacity",
the goal-seeking negative feedback loop (shown in red) becomes the dominant
loop. In this new mode, the system approaches stasis asymptotically. This "shifting
dominance" event from one loop to another is characteristic of nonlinear behavior
and is found in a variety of physical, social, and economic systems.
103
The positive Birth Rate loop, shown in blue, is responsible for the exponential
growth experienced during the early stages of herd growth. As the population of
the herd increases, the birth rate - given some Fecundity (fertility) constant increases. Increasing the birth rate further promotes the growth of the herd. In
balance, the negative Death Rate loop, shown in red, is responsible for drawing
down the herd population. On its own, the death rate of the elephant herd implicitly
reduces the population to zero. As elephants die, the population decreases until an
equilibrium population of zero is reached wherein no more elephants die. The
negative Carrying Capacity loop, shown in green, considers the effect of an
increasing population density on the average life span - and thereby the Death rate
- of the elephant herd. Here, the explicit goal of the system is determined by the
carrying capacity.
Given this structure, Figures 4 and 5 show the time series results from simulating
this model from time=0 to time=100. In Figure 4 ,we see the exponential behavior
of the birth rate from time=0 to about time=40. At time=40, the influence of an
increasing population density on the average life span begins to show with an
"upturn" in the rate of Deaths within the herd. After this point, the gap between
104
Birth and Death rate gradually closes as the population density increases. At about
time=58, the Birth and Death rate become equal and the system achieves
equilibrium.
Figure 4: Time series plot of elephant herd Birth rate and Death rates.
To illustrate this behavior another way, Figure 5 shows a normalized time series plot of the
Elephant herd population and the Net Growth rate for the herd. Net Growth is defined as the
number of elephant births minus the number of elephant deaths. As we expect, initially the
Net Growth increases exponentially due to the dominance of the Birth rate loop. However,
we see a very specific shift at time=40 when the Net Growth peaks and begins to fall. As the
rate of death increases, the Net Growth decreases. The continued increase in Death rate
eventually brings Net Growth to zero, causing the system to reach steady state.
Figure 5: Normalized time series for Elephant population and Net Growth indicates
that shift occurs at maximum growth point.
Overshoot and Collapse
So far, we have considered a system in which the carrying capacity is constant. Now, let us
examine the case in which a system overshoots its limit, causing the carrying capacity itself
to change. In such cases, three outcomes are possible depending upon the specific structure of
the system. The system may:
o oscillate about its carrying capacity;
o overshoot and collapse in which case the carrying capacity is destroyed and the
system crashes; or
105
o reverse direction and approach its carrying capacity in an s-shaped declining fashion.
In order to demonstrate overshoot and collapse behavior in our elephant model, we have to
add some structure. As shown in Figure 6, we assume that the system's carrying capacity is
actually a stock of resource, such as acres of grass and shrubbery, with some characteristic
yearly average output. If the herd population is below the land's ability to replenish itself,
then the carrying capacity is constant. However, if the consumption rate of the elephant herd
exceeds its steady state carrying capacity, then land's ability to regenerate is eroded by some
amount. The Erosion Rate in this case is defined as the number of elephants in the herd
multiplied by the yearly erosion rate per elephant.
(click on image to run simulation)
Figure 7 shows the results of a simulation run from time=0 to time=100 with an initial herd
population of 50 elephants. In this case, the herd exceeds the initial Carrying Capacity at
about time=20. After some delay, this excess number of elephants begins to erode the
Carrying Capacity. Since the Carrying Capacity serves as the target in this negative feedback
system, the Elephant population responds in kind by reversing its exponential growth and
follows the Carrying Capacity downward. Note that even when the population drops to 200
animals, the initial Carrying Capacity, it remains greater than the now decreasing Carrying
Capacity, thus the process continues until the system crashes and the Carrying Capacity of the
land becomes zero.
106
There is more to modeling than just being able to build a model on a computer. Ultimately the goal
of building a system dynamics model is to improve the way that people understand systems and
improve their decision making. In this chapter, we share some thoughts and ideas about the process
of creating system dynamics models and how these models can be used to test options through
computer simulation "experiments."
its
system
and
107
There are two ways in which a system dynamics model can aid in understanding
complex problems. A completed model can be used to test alternative policy options
(i.e. conduct experiments). However, it should be noted that there is great benefit to
participating in the model building process itself. Practitioners have found that longterm learning tends to come from the model building process, so it is important to
involve the decision maker from the beginning.
With this in mind, we can think of the modeling process as having the following
steps:
1. Identify Problem
2. Develop Hypothesis
3. Test Hypothesis
4. Test Policy Alternatives
108
109
Test Policies
(improving mental
models)
With a basic model that
seems to be able to
explain why the problem
is behaving the way that it
is, you can look for policy
interventions that lead to
more desirable long term
system behaviors. A good
way to start this process is
to first identify the key
decisions
(critical
decisions/policies that the
organization
makes),
indicators (what you need to see from the system to assess the decision), and
uncertainties (most fragile assumptions about the relationships or outside world)
associated with the problem. Then try out different possible sets of decisions under
different assumptions about the uncertainties. Look for tradeoffs between short term
behavior and long term behavior.
o Decisions - There are typically four to six key management decisions the
user must make, using the knobs, dials, and/or input boxes presented on the
screen.
o Reports - They provide the critical "snap-shot in time" to inform the users
about the state of the system.
o Graphs - During a model simulation, time series graphs allow the user to
study system trends. As discussed earlier, studying the shape of a
system's time paths is an important part of understanding the structure that
lies beneath.
o Initial Conditions - Because of the nature of system dynamics models,
there are usually one or more key uncertainties that significantly impact the
behavior of the simulation run. It is important to allow the user to set the
value of these uncertainties as part of the experimentation process. An
important part of model design and use is making hidden assumptions and
parameters visible!
Management Flight Simulation Example
The Product Development Flight Simulator was developed by Daniel Kim and Don Seville at
the Organization Learning Center at MIT to teach users the dynamics and highly complex
nature of the product development cycle. The user had three primary objectives or
requirements:
o The product must be finished on schedule.
o The product must be developed using a limited pre-defined budget.
o The product must be of sufficient quality to compete in a competitive market.
For this simulator, the product development project was separated into two categories of
tasks: product engineering tasks (100 total tasks to complete), and process engineering tasks
(100 total tasks to complete). Each category represented a stock of work (tasks) that would be
drawn down at a particular work rate. The product engineers (PE) were responsible for
product design and testing. Process engineers (PcE) were responsible for designing and
building the manufacturing process to turn the design into a marketable product.
Figure 1 shows the basic layout of the product development flight simulator. During the
simulation, each stock of work was gradually drawn down as the engineers worked.
Regardless of whether all the engineering design and process work was completed, the
product was manufactured and released into the market on the scheduled day. If the all or a
majority of the work was completed, the quality of the product was high. However, if a
significant amount of tasks remained, then the quality of the product was low on the day of
release. Product sales depended heavily on whether the product was released by the target
release date and was of a competitive quality.
111
112
Rocket Simulator is a simple system dynamics model that simulates the motion of a rocket
being launched from a planet's surface. We used a system dynamics stock and flow structure
to describe abody in motion such as a rocket or an automobile in terms of its mass,
acceleration, velocity, distance traveled, and the forces acting on it. The figure on the right
shows the basic structure of the rocket simulation model. As the pilot, you control two of the
simulation model's parameters: the throttle and direction. The THROTTLE controls the
rocket's thrust and fuel burn rate. The ROCKET ANGLE controls what direction the rocket is
pointing. This simulation uses simple equations of motion to teach concepts of accumulation
and system delay as well as demonstrate how even simple systems can behave in a complex
and non-intuitive way.
(click on image below to run simulation)
As we discussed in the System Dynamics and Energy Modeling section, one of the system dynamics
analyses conducted in support of the world modeling efforts was a natural gas discovery and
production model created by MIT Master's student Roger Naill. Naill based his model on the life
cycle theory of oil and gas discovery and production put forth by petroleum geologist M. King
Hubbert. Like Hubbert, Naill assumed for his analysis that the total amount of oil and gas in the
United States (i.e., the amount of oil and gas "in place"), and hence the "ultimately recoverable"
amount of oil and gas in the United States, is
finite.
In this chapter, we recreate Naill's
original Natural Gas Discovery Model as a
case study in how to construct and
experiment with system dynamics models.
To make the explanation of the model more
manageable, we present a series of model
versions, each version incrementally more
complex with the addition of new structure.
In each case, the reader is encouraged to run the model to see how the additional structure affects its
113
behavior. In the final section of this chapter, we present a "flight simulator" version of the completed
model. The reader is encouraged to conduct policy experiments by changing decision variables or
model uncertainty variables to see how the behavior of the system changes in response.
114
Figure 1: Actual Data from the U.S. Natural Gas Discovery and Production System
One feature of the model that is particularly noteworthy is that there is no inflow to the stock
of UnprovenReserves. This is because natural gas is created in geologic time, yet used on a
human time scale of a hundred years or so. Thus, for all practical purposes, the amount of
natural gas in the United States can be treated as fixed. Naill made this assumption because
he based his model on the resource life cycle theory of M. King Hubbert. A fixed stock of gas
or oil is at the core of Hubberts theory.
Figure 1: First Cut of Naills Model of U.S. Natural Gas Discovery and Production
Figure 2 lists the system dynamics equations that directly correspond to the icons shown in
Figure 1. Three features of these equations are important to note. The first is that the variables
on the left hand side of each equal sign have their measurement units enclosed in brackets {}.
In system dynamics modeling stocks are measured in "units" and flows are measured in
"units/time." In Figure 2, each of the stocks is measured in "Cubic Feet" of gas and each of
the flows is measured in "Cubic Feet (of gas)/Year."
In system dynamics modeling, each of the equations in a model must be "dimensionally
correct." This means that the arithmetic of the units of measurement must be correct. For
example, if a flow {units/time} is equal to a stock {units} divided by a constant, the
constant must be measured in {time}. Inspection of the equations in Figure 2 reveals that they
are all dimensionally correct.
The second feature of the equations in Figure 2 is that the stocks each have initial values.
More specifically, the initial amount of gas in the stock of UnprovenReserves is 6.4*e12
cubic feet and the initial amount of gas in the stock of ProvenReserves is 1.28434*e15 cubic
feet. The initial values of stocks in system dynamics models can be determined in a variety of
ways. The values are often known or knowable and the analyst needs only to investigate
available data sources to find out. In the case of Naills model presented here, the initial
values were estimated by using the system dynamics software to calculate the "best fit" to
actual U.S. natural gas discovery and production data. In the case of UnprovenReserves, a
value estimated by Hubberts method could also have been used.
The third feature of the equations in Figure 2 is that both of the flows have first
order control. This means that a negative or balancing feedback loop has been
created between each stock and its outflow to prevent the stocks from ever taking
116
[Stock] ProvenReserves
{Cubic Feet}
= dt*(DiscoveryRate - UsageRate
[Initial] ProvenReserves
{Cubic Feet}
= 6.4e12
[Stock] UnprovenReserves
{Cubic Feet}
= dt*(-DiscoveryRate)
[Initial] UnprovenReserves
{Cubic Feet}
= 1.28434e15
[Flow] DiscoveryRate
{Cubic Feet/Year}
[Flow] UsageRate
{Cubic Feet/Year}
= UnprovenReserves*DiscoveryCoef
= ProvenReserves*UsageCoef
[Constant]
{1/Years}
DiscoveryCoef = .0075
[Constant]
{1/Years}
UsageCoef = .02
Figure 2: Equations from the First Cut of Naill's Model of U.S. Natural Gas Discovery and Production
Figure 3 shows time series plots from a simulation of the model presented in Figures 1 and 2.
Of note is that, even at this very early stage in the models development, it produces dynamic
behavior consistent with the real system. UnprovenReserves fall monotonically due to
depletion and ProvenReserves rise during the early part of the century, peak during the mid1970s, and then decline thereafter. The DiscoveryRate falls monotonically and the UsageRate
(essentially the production rate) rises from 1900 to the mid-1970s, peaks, and then declines
thereafter.
117
Figure 3: Time Series Plots from a Simulation of Naills Model of U.S. Natural Gas Discovery and Production
Figure 4(a): Second Cut of Naills Model of U.S. Natural Gas Discovery and Production
Figure 4(b): Causal Diagram the the Second Cut of Naill's Model
of U.S. Natural Gas Discovery and Production.
118
A comparison of Figure 4(a) to Figure 1 reveals that the right-hand side of the model
(ProvenReserves, UsageRate, UsageCoef) has not changed. The left-hand side of the model,
on the other hand, has had a significant piece of system dynamics structure added to it. More
precisely, the simple discovery rate equation has been replaced by a balancing feedback
loop (negative feedback) that works its way through the fraction of unproven reserves
remaining and the cost of exploration.
Refering to Figure 4(b), the logic of the balancing loop is as follows: a fall in unproven
reserves (UnprovenReserves), ceteris paribus, causes a fall (i.e., a move in the Same
direction) in the fraction of unproven reserves remaining (FracRemaining). A fall in the
FracRemaining, ceteris paribus, causes a rise (i.e., a move in the Opposite direction) in the
effect of the fraction remaining on the cost of exploration (EffFracRemainCost). A rise in the
EffFracRemainCost, ceteris paribus, causes a rise in the cost of exploration
(CostOfExploration). A rise in the CostOfExploration, ceteris paribus, causes a fall in the
indicated discovery rate (IndicDiscovRate) which, in turn, ceteris paribus, causes a fall in the
discovery rate (DiscoveryRate). A fall in the DiscoveryRate closes the loop and
ensures, ceteris paribus, that unproven reserves will be higher than they otherwise would
have been.
Three other features of the model presented in Figure 4a are important to note. The first is
that the balancing loop preserves first order control in the model. That is, although the
feedback from the stock of unproven reserves to its outflow (DiscoveryRate) is not direct as it
was in the first cut of the model, the equations in the loop still causes the computer to shut-off
the discovery rate when the stock of unproven reserves is zero.
The second feature of the model presented in Figure 4a that is important to note is
the delay symbol that appears in the discovery rate icon. The purpose of embedding a delay
in the discovery rate is to account for the lag that exists between the time a decision is made
to invest in gas exploration and the time actual gas discoveries occur. This delay could also
have been modeled explicitly with a simple stock and flow stucture.
The last feature of the model that is important to note is its table functions. Represented by
the zig-zag-like symbols, table functions allow the modeler to externally impose
relationships(linear and nonlinear) between system variables.
Figure 5 lists the system dynamics equations that directly correspond to the icons shown in
Figure 4. Three characteristics of these equations are particularly noteworthy. The first is that,
in
addition
to
the stocks(rectangles), flows (pipe
and
faucet
assemblies)
and constants (diamonds) presented in the first cut of the model, there are now auxiliary
equations (circles) in the model.
The second noteworthy characteristic is that the model is again dimensionally correct. In
particular, the measurement units of each variable in the balancing loop correspond to the
arithmetic embodied in each equation in the loop. To provide just one example, the indicated
119
[Stock] ProvenReserves
{Cubic Feet}
= dt*(DiscoveryRate - UsageRate)
[Initial] ProvenReserves
{Cubic Feet}
= 6.4e12
[Stock] UnprovenReserves
{Cubic Feet}
= dt*(-DiscoveryRate)
[Initial] UnprovenReserves
{Cubic Feet}
= 1.28434e15
[Flow] DiscoveryRate
{Cubic Feet/Year}
[Flow] UsageRate
{Cubic Feet/Year}
= DELAYINF(IndicDiscovRate,4.5,3)
= ProvenReserves*UsageCoef
CostOfExploration =
NrmCostExploration*EffFracRemainCost
[Aux]
{Dollars/Cubic Foot}
{Dimensionless}
FracRemaining =
UnprovenReserves/INIT(UnprovenReserves)
[Aux]
{Dimensionless}
[Aux] IndicDiscovRate
{Cubic Feet/Year}
= InvestInExplor/CostOfExploration
InvestInExplor = GRAPH(TIME,1900,15,
[100000000,220000000,350000000,470000000,
600000000,720000000,820000000,900000000,950000000,9900
00000, 1000000000"Min:0;Max:1000000000;Zoom"])
[Aux]
{Dollars/Year}
[Constant] NrmCostExploration
{Dollars/Cubic Foot}
[Constant]
{1/Years}
= 1.34775e-5
UsageCoef = .02
Figure 5: Equations from the Second Cut of Naills Model of U.S. Natural Gas Discovery and Production
120
An examination of Figure 6 reveals that the table functions both represent nonlinear
relationships in the model and help to define the systems limits. The effect of the fraction of
gas remaining on the exploration cost function (EffFracRemainCost) indicates that as gas
depletion occurs, the cost of gas exploration increases monotonically. The investment in
exploration function (InvestInExplor) indicates that, over time, the number of dollars per year
allocated to gas exploration increases and then saturates. In future cuts of the model, this
relationship will be made endogenous.
Figure 6: Table Functions in the Second Cut of Naills Model of U.S. Natural Gas Discovery and Production
Figure 7 shows time series plots from a simulation of the model presented in Figures 4 and 5.
As with the previous version of the model, this cut produces dynamic behavior consistent
with the real system. That is, the UsageRate again rises from 1900 to the mid-1970s, peaks,
and then declines. UnprovenReserves again fall monotonically due to depletion and
ProvenReserves again rise during the early part of the century, peak during the mid-1970s,
and then decline.
The only behavior in this version of the model that is new involves the DiscoveryRate. A
comparison of Figures 3 and 7 reveals that the DiscoveryRate now rises and falls whereas, in
the previous version of the model, it simply fell monotonically. The reason for this difference
is that, in this cut of the model, the InvestInExplor table function exogenously increases
investment in exploration over time. Early in the systems evolution, the increasing amount of
investment dollars causes a rise in natural gas discovery. Later on, however, the effects of
depletion overwhelm the investment dollars and the discovery rate falls. An interesting
simulation experiment that could be done is to systematically alter the InvestInExplor
function (its shape, its saturation level, etc.) and resimulate the model to ascertain the results
of the changes.
Figure 8(a): Third Cut of Naills Model of U.S. Natural Gas Discovery and Production
122
synthetic, actual price data could have been used to determine its effect on the natural gas
system.
124
Figure 9: Equations from the Third Cut of Naills Model of U.S. Natural Gas Discovery and Production
Figure 10 shows time series plots from a simulation of the model presented in Figures 8 and
9. As with previous versions of the model, this cut produces dynamic behavior that is roughly
consistent with the real system. The only behavior in this version of the model that is new is
that of ProvenReserves. This time they rise and plateau, instead of rising, peaking, and
falling. This behavior is clearly not correct and must be fixed in later versions of the model. It
occurs in this version because, during the last third of the simulation, the exogenously rising
price of natural gas reduces the UsageRate to the (very low and falling) DiscoveryRate. This
can be seen by inspecting the top-right plot of Figure 10.
Figure 10: Time Series Plots from a Simulation of the Third Cut of Naills Model of U.S. Natural Gas Discovery
and Production
125
Figure 7: Time Series Plots from a Simulation of the Second Cut of Naills Model of U.S. Natural Gas
Discovery and Production
126
Figure 11(a): Fourth Cut of Naills Model of U.S. Natural Gas Discovery and Production.
127
the RelResProdRatio. A fall in the RelResProdRatio, ceteris paribus, causes a rise in the
percent of sales revenue devoted to investment in gas exploration (PctInvestExplor). A rise in
the PctInvestExplor, ceteris paribus, causes a rise in InvestInExplor. A rise in
InvestInExplor, ceteris paribus, causes a rise in the IndicDiscovRate. After a significant delay,
a rise in the IndicDiscovRate, ceteris paribus, causes a rise in the DiscoveryRate, which
closes the loop and ensures, ceteris paribus, that proven reserves will be higher than they
otherwise would have been.
Figure 13 shows time series plots from a simulation of the model presented in Figures 11. A
comparison with Figure 10 reveals that the model now exhibits two new behaviors. The first
is an oscillation that is most apparent in the plots of proven reserves, the discovery rate, and
the usage rate. The second is that proven reserves now rise, peak and fall, instead of merely
rising and peaking as in the last version of the model.
The models oscillatory behavior can be readily explained. A rule of thumb in system
dynamics modeling is that oscillation is caused by a balancing feedback loop with delayed
corrective action. The balancing loop (negative feedback) that was added to this version of
the model provides precisely this type of structure. That is, the model adjusts its investment
in exploration by watching its reserve-production ratio. When proven reserves drop and the
reserve-production ratio falls below its desired level, more revenue is invested in exploration.
When proven reserves rise and the reserve-production ratio exceeds its desired level,
investment in exploration falls. Because of the significant delay between the time a monetary
investment in exploration is made and the time natural gas discoveries occur, by the time new
proven reserves are added to ProvenReserves, they are no longer the amount necessary to
bring the reserve-production ratio into line with its desired value. As a result, the model must
again adjust its investment in exploration via the balancing loop. The system ends-up out of
sync -- over and undershooting its desired reserve-production ratio.
129
Figure 13: Time Series Plots from a Simulation of the Fourth Cut of
Naills Model of U.S. Natural Gas Discovery and Production
130
Figure 14(a): Fifth Cut of Naill's Model of U.S. Natural Gas Discovery and Production
131
Figure 14(b): Causal Diagram of additional balancing and reinforcing loops for Cut 5 model.
The addition of an endogenous pricing structure creates four new feedback loops in the
model. Two of the loops are reinforcing loops (positive feedback) and two are balancing
loops (negative feedback). These loops can be identified in Figure 14, wholly or partially, via
information links of different colors.
The first new loop (shown with red information links) is a reinforcing loop. This loop works
through gas price and hence sales revenue to keep gas discoveries rising as depletion occurs.
The second new loop (shown partially in blue) is also a reinforcing loop. In a way similar to
the previous loop, this loop works through gas price and return on investment in exploration
to keep gas discoveries rising as depletion occurs.
The third new loop is a balancing loop. It is shown partially in Figure 14 with purple
information links. This loop works to keep the reserve-production ratio at its desired level by
changing gas price and hence new gas discoveries. In other words, this loop represents the
effects of gas price on the supply side of the gas system.
The fourth new loop shown partially in Figure 14 with teal information links is also
a balancing loop. This loop works to keep the reserve-production ratio at its desired level by
changing gas price and hence the gas usage rate. In other words, this loop represents the
effects of gas price on the demand side of the gas system.
132
Figure 16 shows time series plots from a simulation of the model presented. A comparison
with Figure 13 reveals that the models behavior is essentially the same as before, although its
oscillations are less severe. This damping of the systems oscillations, of course, is due to the
feedback loops that were added to the system. Movements in the price (market) system take
away some of the pressure on the system to change via the percent of revenues invested in
gas exploration and discovery.
Figure 16: Time Series Plots from a Simulation of the Fifth Cut of Naills Model of U.S. Natural Gas Discovery
and Production
133
Figure 17: Sixth Cut of Naill's Model of U.S. Natural Gas Discovery and Production.
134
Figure 19: Time Series Plots from a Simulation of the Sixth Cut of Naills Model of U.S. Natural Gas Discovery
and Production: Unregulated Scenario
135
Figure 20: Time Series Plots from a Simulation of the Sixth Cut of Naills Model of U.S. Natural Gas Discovery
and Production: Regulated Scenario
Finally, in the Reference Modes section of this chapter, we presented some actual data from
the U.S. natural gas system including actual discovery rate, usage (production) rate, proven
reserves, and reserve-production ratio. Although these data do not span the entire life cycle
of the natural gas system (roughly the years 1900 to 2050) a la Hubbert, they were used to
complement the reference modes resulting from Hubbert's theory and to calibrate the model.
Figure 21 shows the time series plot comparing the actual data to simulated data between the
years 1975 to 1995.
136
Figure 21: Time series plot comparing the actual data to simulated data between the years 1975 to 1995.
137
138
Figure 2: Example time series plot of base run Proven Reserves and Discovery Rate variables.
After checking through the different graphs, you should be ready to start changing parameters
in the model to see how the simulation can unfold differently under different policies and
scenarios. The control panel contains two kinds of parameters for you to control: Policy
Levers and Uncertainties variables.
1. Policy Levers: These are variables that represent decisions people make based on the
information that they are receiving from the system. For example, the Wellhead Price
Tax is a government control lever.
2. Uncertainties: Things that influence the system from the outside that we cannot
predict. We want to test different policies against many scenarios of the uncertainties
to see what are the best policies. For example, the initial value for the Unproven
Reserves variable is only an estimate. Therefore, this simulator allows the user to vary
this initial value to the sensitivity of the model to this uncertainty.
We will walk you through one experiment in more detail to illustrate the steps of changing
the policy and explane the results, and then set you loose to experiment with the rest.
Guided Experiment
What if the unproven reserves of natural gas were 50% greater than we first estimated? This
is an experiment in which we are going to alter one of the "uncertainties" in the model to see
how much difference it will make in the behavior of the natural gas industry:
1. To start the run, press the run button as in the base run.
2. Scroll to the Unproven Reserves graph and look for the gage titled "INITIAL." This
gage will allow you to enter different assumptions about the initial amount of
unproven reserves. Click on the right arrow button under this gauge to increase the %
139
percent of baseline value. Since we want to increase the initial value of the unproven
reserves by 50% (2e15 ft^3), the gauge should be set to 150% of the baseline value as
shown in Figure 2.
3. Now press the pause button to resume the simulation. When the simulation is
complete, you can move over to the graphs to see what happened as a result.
Figure 3: Setting initial uproven reserves to 50% greater than base case
One of the sets of graphs are called comparative graphs and allow the same variable to be
shown on the same graph for multiple experiments, as shown in Figure 3 below:
Figure 4: Comparison of base run and results of increasing base unproven reserves by 50%.
The first run in the red line was the base run. The green line is the new run with the new
assumption about the amount of unproven runs. Look through the other graphs. What
happened? For how much longer did the significantly higher amount of unproven reserves
allow the industry to continue? Why do you think this happened? These are the kinds of
questions you should be asking yourself as you go through different experiments using the
slide bars in the control panel.
To clear the results of a particular simuation experiment, simply pull down the simulate
menu and select the "clear results" option as shown in Figure 5.
140
Suggested Experiments:
Conservation policy 1- What would happen if the government (or industry) set up a policy
to encourage the conservation of natural gas whenever the proven reserves fall? We can
simulate this policy through the natural gas Demand variable in the control panel. This
variable can be changed at any time during the simulation.
Uncertainties
Amount of unproven reserves - One of the fundamental uncertainties
of natural resources is that we don't know how much is underground that
we have not yet discovered. An important test of the natural gas system is to find out how
much difference it would make if there were twice as much as we first estimated. What would
happen
if
there
were
ten
times
(1000%
of
baseline)
as
much?
Base usage
uncertainty
the growth
variable
is
for
natural
gas.
Now that you've read this book, and "surfed" through some examples, what is your next step? One
of the difficulties is that while the software used in system dynamics modeling has made it easy to
build models, it takes some discipline and practice to make good system dynamics models. A good
model is a model that focuses on examining a problem or behavior, rather than trying to model an
entire system. A good model is one that is a documented, understandable, and concise representation
of a system. And most importantly, a good model is one that can help people better understand the
world in which they are trying to act and enable them to make more effective long-term decisions.
Cautious Enthusiasm: The goal of this book is to share the philosophy and tools of system
dynamics. Your ultimate success relies, of course, on actually practicing yourself. Each of the
systems dynamics software packages comes with excellent manuals to get you started. We would
also recommend working with someone more experienced at some point to help you accelerate the
learning process.
Opportunities include:
modeling projects with more experienced practitioners, either in your own organization or
outside consultants.
142
MIT
System
Dynamics
Group
143
System
Dynamics
in
Education
Project
The System Dynamics in Education Project (SDEP) is a
group of students and staff in the Sloan School of
Management at the Massachusetts Institute of Technology,
working under the guidance of Professor Jay W. Forrester,
the founder of system dynamics.
144
o Written Material
Productivity Press - publisher of all system dynamics academic books P.O.Box 13390, Portland, OR 97213. Phone (503) 235-0660. Call to get a
catalog.
145