Você está na página 1de 20

P O L I C Y R E P O R T

Where the Bodies are


Buried
How experts for N.C.’s Attorney
General mislead the public about
TVA air pollution risks

Joel Schwartz
June 2008
Where the Bodies are
Buried
How experts for N.C.’s Attorney
General mislead the public about
TVA air pollution risks

Joel Schwartz
June 2008

Table of Contents

2 Executive Summary

3 TVA Emissions Reductions

3 Toxicity of Power Plant Emissions

5 Attorney General’s Experts Omit Contrary Evidence


8 Observational Epidemiology Studies Versus Other
Evidence

11 Correcting the Experts’ Errors and Exaggerations

11 Conclusion

12 Notes

Cover photo is the Tennessee Valley


Authority’s Kingston Fossil Plant on
the Tennessee River in Kingston, Tenn.
Photo courtesy of the TVA.
 Where the Bodies are Buried | EXECUTIVE SUMMARY

Executive Summary

The Tennessee Valley Authority (TVA) operates is harmful, even at levels tens of times greater than are
11 coal-fired power plants in the southeastern United ever found in the air Americans breathe. In fact, am-
States. These plants emit nitrogen oxides (NOx) and monium sulfate is used as an “inert control”—that is, a
sulfur dioxide (SO2), which contribute to particulate substance that is not harmful—in studies of other sub-
matter (PM) and ozone in the eastern U.S., including stances that are expected to be toxic. According to the
North Carolina. Attorney General’s experts, 98.5 percent of the pre-
In an effort to force the TVA to reduce its contri- dicted health benefits of power plant emissions reduc-
bution to air pollution in North Carolina, state Attor- tions are due to reductions in sulfate and nitrate par-
ney General Roy Cooper filed ticulates. In other words, 98.5 percent of the benefits
In reality, the actual benefits of suit against the TVA in Janu- claimed for power plant emissions reductions depend
ary 2006, arguing that the TVA on the assumption that ammonium sulfate and nitrate
the TVA power plant emission plants constitute a public nui- are toxic. Since this assumption is false, 98.5 percent
reductions will at best be only sance.1 To bolster his case, Coo- of the claimed benefits are not real.
per commissioned reports from The remaining 1.5 percent of predicted benefits
a tiny fraction of the amount
experts in air pollution model- comes from reductions in ozone pollution that are
claimed by the Attorney Gener- ing (Lyle R. Chinkin and Neil expected to result from reductions in NOx emissions
J.M. Wheeler), control methods from the TVA power plants. Although ozone can be
al’s experts.
(James E. Staudt), health effects dangerous at high levels, the expert reports also exag-
(John D. Spengler and Jonathan I. Levy), and cost- gerate the benefits of ozone reductions. The key source
benefit analysis (Leland B. Deck).2 of the exaggeration of benefits for ozone reductions is
These experts estimated that reducing NOx and the experts’ assumption that ozone causes premature
SO2 emissions from TVA sources by about 370,000 death, even at the relatively low levels encountered in
tons per year3 (a 65 percent reduction) would have the air today. Based on decades of studies with sev-
substantial health benefits, preventing more than eral different species of animals, ozone is not deadly,
1,400 cases per year of premature mortality, more than even with long-term exposure to levels more than 13
a 1,000 hospital visits, and hundreds of thousands of times greater than the current federal ozone standard
asthma exacerbations each year.4 By placing dollar for daily peak levels. Reductions in premature mortal-
values on these health benefits using standard cost- ity account for 96 percent of the total ozone benefits.
benefit analysis techniques, Leland Deck’s expert Since ozone does not cause premature mortality, these
report concluded that the health benefits would total benefits are likewise not real.
$10.9 billion per year, or about 18 times greater than After calculating that the benefits of TVA emis-
the annual cost of the emission reductions.5 sions reductions would be 18 times the costs, Deck’s
In reality, the actual benefits of the TVA power expert report concludes “Such a large benefit/cost ra-
plant emission reductions will at best be only a tiny tio is evidence that substantially different assumptions
fraction of the amount claimed by the Attorney Gen- could be made in either the benefit or the cost analyses
eral’s experts. Nearly all the claimed health benefits without changing my conclusion that the requested
of the emissions reductions come from reductions in emission reductions do provide a substantial net ben-
fine particulate matter (PM2.5). Particulate matter from efit to society.”7
power plants is mostly ammonium sulfate, formed from This assertion is backwards. The high benefit/
SO2 emissions, with some ammonium nitrate, formed cost ratio is not evidence of net benefits. Rather, be-
from NOx emissions.6 But neither of these substances cause sulfates and nitrates are harmless and because

John Locke Founation


Where the Bodies are Buried | TVA EMISSIONS REDUCTIONS 

ozone at today’s low ambient levels is not deadly, the The Spengler and Levy expert report provided
large benefit/cost ratio is evidence that false assump- the air pollution health effects estimates that went
tions were used to generate it. Using the more realis- into Deck’s cost-benefit analysis. It is their selective
tic assumption that sulfates and nitrates are harmless omission and mischaracterization of evidence that ul-
eliminates 98.5 percent of the benefits. The more re- timately resulted in the vast exaggeration of the health
alistic assumption that low-level ozone is not deadly benefits of TVA power plant emissions reductions. The
eliminates another 1.4 percent of the benefits. As a re- remainder of this report provides the detailed evidence
sult, the costs of the TVA emission reductions will at refuting Spengler and Levy’s incorrect claims about
best be more than 50 times greater than the benefits. the health effects of TVA power plant emissions.

TVA Emissions Reductions

TVA emission reductions would reduce the contributes to the formation of ozone.
sulfate and nitrate components of particulate The goal of the Attorney General’s lawsuit is to
matter, as well as ozone. force the TVA to reduce SO2 and NOx emissions from
its power plants in order to reduce particulate matter
Particulate matter is made up of many substanc- and ozone. The expert report by Chinkin and Wheeler
es, but the contribution from coal-fired power plants modeled the effect on PM2.5 and ozone levels for the
comes in the form of ammonium sulfate and ammoni- following TVA emission reduction scenario for the
um nitrate. Through reactions in the atmosphere some year 2013: SO2 would be reduced from a baseline of
of the SO2 is converted to sulfate and some of the NOx 449,000 tons down to 137,000 tons, or a 69 percent
is converted to nitrate, both of which react with am- reduction. NOx would be reduced from a baseline of
monia to form ammonium sulfate and nitrate. As the 115,000 tons down to 59,000 tons, or a 48 percent re-
Spengler and Levy expert report notes sulfate is “the duction. Spengler and Levy then predicted health im-
principal type of particulate air pollution produced provements based on Chinkin and Wheeler’s estimates
from coal-fired power plant emissions.” 8 NOx also of PM2.5 and ozone reductions

Toxicity of Power Plant Emissions

Sulfate and nitrate particulate matter is harmless. of the benefits attributed to emissions reductions from
these plants, with the remaining 1.5 percent of benefits
The claim that power plant emissions cause pre- coming from reductions in ozone.9
mature death, asthma attacks, hospital admissions, and However, as discussed in the previous section,
other harms depends mainly on the toxicity of power the PM2.5 caused by coal-fired power plants is in the
plant particulates. Based on estimates in the expert re- form of ammonium sulfate, plus a small amount of
ports, reductions in the components of PM2.5 caused ammonium nitrate. Neither of these substances is
by TVA power plants accounts for 98.5 percent of all harmful. As a result, there are no health benefits from

Policy Report
 Where the Bodies are Buried | TOXICITY

reducing them. This eliminates 98.5 percent of the os- Ammonium nitrate particulates have also prov-
tensible health benefits from the TVA emissions reduc- en to be non-toxic in human volunteers, even at levels
tions. tens of times greater than ever occur in the air people
The lack of toxicity of ammonium sulfate is breathe.15
well-known to air pollution health scientists. In fact, A number of recent scientific review articles
ammonium sulfate particulates are used as an “inert have also noted the lack of toxicity of sulfate and ni-
control”—that is, a substance that does not cause any trate particles in humans and laboratory animals, and
harm and has no physiological effects—in studies the implausibility that these substances could be re-
of other potentially toxic sponsible for harmful effects.16 Spengler and Levy
PM2.5 caused by coal-fired power agents. For example, Koe- omitted from their expert report the large body of evi-
nig et al. (1993) studied the dence that sulfate and nitrate are harmless. As a result,
plants is in the form of ammoni-
effects of breathing sulfu- they vastly exaggerate the benefits of TVA emissions
um sulfate, plus a small amount ric acid aerosols in elderly reductions.
of ammonium nitrate. Neither asthmatics and non-asth- Leland Deck’s expert report provides a cost-
matics.10 As described in benefit analysis for the TVA emissions reductions and
of these substances is harmful. Koenig et al., “There were finds that the benefits are more than 18 times greater
As a result, there are no health four test atmospheres: two than the costs. Deck concludes “Such a large benefit/
included control exposures cost ratio is evidence that substantially different as-
benefits from reducing them.
of air and physiologically sumptions could be made in either the benefit or the
inert particles (ammonium cost analyses without changing my conclusion that the
sulfate), and two included sulfuric acid…”11 (empha- requested emission reductions do provide a substantial
sis added). net benefit to society.”17
Indeed, the lack of toxicity of ammonium sulfate This assertion is backwards. The high benefit/
has been known for decades. During the late 1970s and cost ratio is not evidence of net benefits. Rather, be-
early 1980s, researchers exposed human volunteers to cause sulfates and nitrates are harmless, the large ben-
as much as 1,000 micrograms per cubic meter (μg/m3) efit/cost ratio is evidence that false assumptions were
of ammonium sulfate and yet found no physiological used to generate it. Using the more realistic assump-
effects or harm.12 For comparison, sulfate levels in tion that sulfates and nitrates are harmless eliminates
U.S. air range from about 0.2 μg/m3 to 7 μg/m3 on an 98.5 percent of the benefits and results in the costs of
annual-average basis, and can get as high as about 30 the emissions reductions being 3.6 times greater than
μg/m3 on the worst days at the worst locations in the the benefits. As detailed later in this report, Spengler
U.S.13 In other words, sulfate levels 30 times greater and Levy also exaggerate harm from ozone. After re-
than the highest levels in U.S. air have no effects on moving Spengler and Levy’s unrealistic assumptions,
human health. Indeed, asthma medications that open the estimated benefits of the TVA emissions reductions
constricted airways are delivered in the form of in- drop by more than 99.9 percent, making the costs more
haled sulfate aerosols—that is, in the form of sulfate than 50 times greater than the benefits.
particulate matter.14

John Locke Founation


Where the Bodies are Buried | OMITTED CONTRARY EVIDENCE 

Attorney General’s Experts Omit Contrary Evidence

Spengler and Levy mischaracterize study coal-related particulates. Thus, even if sulfates or ni-
results and omit contrary evidence from their trates were toxic, these two studies would still be ir-
expert report. relevant for calculating the benefits of reducing emis-
sions from the TVA’s coal-fired power plants.
Sulfate and nitrate are not the only cases where School absences. Spengler and Levy estimate
Spengler and Levy omit contrary evidence from their that reducing ozone caused by NOx emissions by TVA
analysis. In addition, they mischaracterize many of the sources would prevent a total of 42,000 school ab-
studies they cite in their expert report. Taken together, sence days per year.20 They based their estimate of the
these tactics exaggerate the apparent harm from any effect of ozone on school absences on Gilliland et al.
given amount of air pollution and create a false ap- (2001),21 which reported results from the Children’s
pearance of consistency among studies in the research Health Study (CHS). The CHS followed more than
literature. Several examples follow: 2,000 children in 12 different California communities
Infant mortality studies. Spengler and Levy from 1993-2001.
cite several studies that they claim support an overall What Spengler and Levy omit from their report
conclusion that each 10 μg/m3 increase in PM2.5 is as- is that two other studies failed to find an increase in
sociated with a 7 percent increase in risk of premature school absences due to
daily changes in ozone Spengler and Levy rely mainly
death. One of these studies is Lipfert et al. (2000)18, of
which they state, “The study by Lipfert et al. reports levels, even though these on Woodruff et al. (2006) and
numerous estimates but generally corroborates this other two studies used the
Ritz et al. (2006) for estimating
magnitude of effect.” exact same CHS data as
But here is what Lipfert et al. (2000) actually Gilliland et al., and even infant mortality .... However,
wrote: “Significant negative mortality associations included some of the same
both of these studies were of
were found for SO4 [sulfate].” In epidemiological par- authors.22
lance, a “negative” association means that higher lev- By citing one study children in California, where
els of the pollutant were associated with lower levels that reported an associa- there are no coal-fired power
of harm. In other words, Lipfert et al. concluded that tion between ozone and
absences and omitting the plants and therefore no coal-re-
sulfate was not harmful—exactly the opposite of how
Spengler and Levy characterize Lipfert et al. two studies that didn’t, lated particulates.
Lipfert et. al. go on to write, “There was no in- Spengler and Levy exag-
dication of a role for outdoor PM2.5, but possible con- gerate the apparent harm from air pollution and cre-
tributions from indoor air pollution sources cannot be ate a false appearance of consistency in the research
ruled out….” Thus, not only did Lipfert et al. not find literature.
any harm from power plant particulates specifically, The fact that three studies using the exact same
they also found no evidence of harm from total PM2.5. data came to wildly different conclusions is also an
Spengler and Levy rely mainly on Woodruff et example of the degree to which the pollution associa-
al. (2006) and Ritz et al. (2006) for estimating infant tions reported in “observational” epidemiology stud-
mortality due to particulates, arguing that they are “the ies are not representative of real causal effects, but
two strongest studies” of the relationship between air are more a matter of subjective modeling choices by
pollution levels and infant mortality.9 However, both researchers and inherent limitations of observational
of these studies were of children in California, where methods. Spengler and Levy rely solely on observa-
there are no coal-fired power plants and therefore no tional epidemiology studies for their health-effects es-

Policy Report
 Where the Bodies are Buried | OMITTED CONTRARY EVIDENCE

timates, and this is one of the reasons why their claims year.23 Furthermore, they predict that reductions in
are so wildly at odds with reality. The problems with PM2.5 and ozone will prevent, respectively, 830 and
observational studies will be discussed in more detail 40 asthma emergency room (ER) visits.24 As already
later in this report. noted, the PM2.5 benefits are not real, because sulfate
Beyond the problem of omitting contrary evi- and nitrate particulates are not harmful.
dence on ozone and school absences, Spengler and The claimed benefits for ozone are also implau-
Levy also ignore the fact that the Gilliland et al. (2001) sible. Ozone levels peak during July and August, be-
ozone-absence relationship is not credible even on its cause sunlight drives the reactions that form ozone.25
own terms. For example, according to the Gilliland et Yet all across the U.S., July and August are also the
al. results: months with the lowest rate of asthma ER visits.26 In
• Spending more time outdoors, which would North Carolina, counties with higher ozone levels
have increased ozone ex- have lower rates of respiratory hospital admissions, as
Ozone levels peak during July posures, was associated shown in Figure 1.
with fewer school ab- Spengler and Levy also mischaracterize the lit-
and August .... Yet all across the
sences. erature on air pollution and asthma attacks and omit
U.S., July and August are also • The apparent effects of contrary evidence. They cite five studies that they
ozone were associated combined to generate their estimate that each 1 μg/m3
the months with the lowest rate of
mainly with ozone ex- increase in PM2.5 is associated with a 2 percent increase
asthma ER visits.26 In North Caro- posures from one or two in asthma exacerbations.27 Spengler and Levy note
lina, counties with higher ozone weeks before the absence, that they gleaned these five studies from Table 8B-5
rather than to ozone expo- of the EPA’s 2006 “Criteria Document” for ozone and
levels have lower rates of respira- sures within a few days conclude that “there is consistency in the magnitude
tory hospital admissions. before the absence. of the concentration-response function across all stud-
• Higher levels of particu- ies.”28
late matter were associated with a large This claim might lead readers to believe that the
increase in non-illness-related absences, five studies found similar and statistically significant
but were not associated with an increase in associations between particulate matter and asthma
absences due to illness. In fact, an increase exacerbations. But this is not the case. For example:
of 10 μg/m3 in PM10 (particulate matter un- • In a study by Desqueyroux et al. (2002),
der 10 microns in diameter) was associated increases in particulate matter during the
with a larger effect on non-illness-related previous two days were actually associated
absences than the effect of a 0.020 ppm with a 33 to 50 percent decrease in asthma
increase in ozone on respiratory-related ab- symptoms, though the effect was not sta-
sences. tistically significant.29 On the other hand,
Taken together, these results are biologically im- higher PM from four or five days ago was
plausible and suggest that the apparent effect of ozone associated with an increase in asthma symp-
on school absences was a statistical figment, rather toms and this was statistically significant.
than a real cause-and-effect relationship. This pattern is biologically implausible and
Asthma emergency room visits. Spengler and suggests the result is a statistical figment,
Levy predict that reductions in PM2.5 from TVA power rather than a real effect.
plants will prevent 250,000 asthma exacerbations per • In Mortimer et al. (2002) the association be-

John Locke Founation


Where the Bodies are Buried | OMITTED CONTRARY EVIDENCE 

tween particulate matter and asthma symp- was released because the study reported an association
toms was not even statistically significant.30 between higher ozone and increased asthma symp-
Furthermore, the size of the putative PM toms. Activists, regulators and many air pollution
effect decreased with time after exposure— health scientists hailed the study as evidence that even
just the opposite of the pattern reported by low levels of ozone cause asthma exacerbations. But
Desqueyroux et al. these same advocates omit Gent et al. when discuss-
Contrary to Spengler and Levy’s claim, these ing the putative effects of PM2.5 on asthma, because
studies are not consistent with each other, and they Gent et al. did not find any association between PM2.5
do not suggest a real effect of particulate matter on and asthma symptoms. Likewise, when discussing
asthma symptoms. ozone, advocates cite Gent et al. but omit studies, such
Spengler and Levy also omit Gent et al. (2003), as Mortimer et al. (2002), that did not find an effect
which found no relationship between PM2.5 levels and of ozone on asthma symptoms. This selective citation
asthma symptoms.31 This is an interesting omission. of evidence creates an appearance of larger and more
Gent et al. was widely reported in the media when it consistent harm from air pollution than warranted by

Figure 1: Asthma Hospitalization Rates vs. Ozone Level For N.C. Counties
Vertical axis of each graph: Ozone (exceedance days per year)

Horizontal axis of each graph: Asthma hospitalizations (per 100,000 population)

Notes: Each point represents a given North Carolina county. Ozone exceedance days are based on an 8-hour, 0.085 ppm standard and are an average for all
monitoring sites operating in a given county in a given year. Lines are linear regression lines.
Sources: Ozone data for North Carolina were downloaded from EPA’s AIRData database, http://www.epa.gov/air/data/geosel.html (accessed September 29,
2006). Asthma hospitalization data were provided by the North Carolina State Center for Health Statistics.

Policy Report
 Where the Bodies are Buried | OBSERVATIONAL EPIDEMIOLOGY STUDIES

the underlying weight of the research evidence. for water and space heating, whereas coal in the U.S.
Dublin coal-ban study. The city of Dublin, is burned in large power plants. The difference is that
Ireland, in 1990 banned the use of soft (bituminous) the pollution issue in Dublin was the large amounts
coal for home heating and cooking, which resulted of black smoke (i.e., soot) produced by all of this
in a large drop in black smoke levels, particularly in domestic coal-burning, while sulfate and nitrate PM
winter. A study in the Lancet concluded that the coal were not a factor. The situation is just the opposite in
ban caused a reduction in premature mortality.32 Spen- U.S. power plants, where the particulates from coal
gler and Levy cite this study to support their claim of are non-toxic sulfate and nitrate formed in the atmo-
health benefits from reducing particulates caused by sphere from the power plants’ emissions of gaseous
coal-fired power plant emissions. They state “the re- SO2 and NOx, rather than directly emitted black smoke
duction in respiratory and cardiovascular mortality and soot. Spengler and Levy’s vague mention of “re-
that coincided with a ban on coal burning in Dublin, duction in…mortality that coincided with a ban on
Ireland, is evidence that discernable effects of air pol- coal” might mislead readers into thinking that pollu-
lution can be demonstrated on a population.”33 tion from domestic coal use in Dublin is comparable to
Spengler and Levy are comparing apples and power plant coal use in the U.S. when the two in fact
oranges. The coal in Dublin was burned inside homes bear no relationship to each other.

Observational Epidemiology Studies Versus Other Evidence

Observational epidemiology studies are invalid from non-randomly selected groups of people with
and at odds with more reliable evidence. non-random and poorly measured air pollution expo-
sures and look for correlations between the two. All
Given the direct evidence that sulfate and nitrate of Spengler and Levy’s claims of health benefits from
are not toxic, and that ozone is not deadly, one might TVA emissions reductions are based on the results of
ask how Spengler and Levy managed to create an ap- observational studies.
pearance that their claims about harm from today’s The implicit assumption in an observational
historically low levels of PM2.5 and ozone are essen- study is that after researchers have controlled for all
tially a “done deal” with which no reasonable person known non-pollution factors that might be corre-
could disagree. lated with pollution levels and health outcomes (e.g.,
Part of the answer has already been discussed. weather, smoking, diet, etc.) any remaining correlation
Spengler and Levy omit contrary evidence, claim between air pollution and health represents a genuine
some studies report harm from air pollution when in causal linkage between the two. A wide range of evi-
fact they don’t, and ignore weaknesses in studies that dence shows that this assumption is false and that ob-
do report harm from air pollution. servational studies tend to “find” effects where no real
Nevertheless, it is still true that there are hun- effects exist.34
dreds of studies in the scientific literature that report Indeed, many prominent epidemiologists are
statistically significant associations between air pollu- wringing their hands over the widespread problem
tion and health outcomes, such as risk of death, asthma and embarrassment of spurious health claims from ob-
attacks, etc. These studies are known as “observation- servational epidemiology studies and are questioning
al” epidemiology studies—that is, studies that use data whether observational studies are even capable of pro-

John Locke Founation


Where the Bodies are Buried | OBSERVATIONAL EPIDEMIOLOGY STUDIES 

viding valid evidence on health risks.35 Unfortunately, Publication bias arises because there are more
this acknowledgement of the limits of observational rewards for publishing positive or at least sta-
studies in the wider community of epidemiologists tistically significant findings. It is a common if
has had little effect on the relatively insular world of not universal problem in our research culture.
air pollution epidemiology specifically. Nevertheless, In the case of time-series studies using routine
there have been some critiques even within air pollu- data there are particular reasons why publica-
tion epidemiology. Here for example is one caution on tion bias might occur. One is that the data are
the validity of observational studies of air pollution’s relatively cheap to obtain and analyse, so that
health effects: there may be less determination to publish “un-
estimation of very weak associations in the interesting” findings. The other is that each
presence of measurement error and strong con- study can generate a large number of results for
founding is inherently challenging. In this situ- various outcomes, pollutants and lags and there
ation, prudent epidemiologists should recognize is quite possibly bias in the process of choos-
that residual bias can dominate their results. ing amongst them for inclusion in a paper. In the
Because the possible mechanisms of action and field of air pollution epidemiology, the question
their latencies are uncertain, the biologically of publication bias has only recently begun to be
correct models are unknown. This model selec- formally addressed.37
tion problem is exacerbated by the common In many areas of health research, randomized
practice of screening multiple analyses and trials—a gold standard methodology that reduces or
then selectively reporting only a few important eliminates the biases inherent in observational stud-
results.36 (emphasis added) ies—can be conducted to test claims made based on
The highlighted portion is key. Researchers observational studies. In such cases, observational
make many subjective choices in developing statistical studies are routinely contradicted when checked with
models relating air pollution to health. Furthermore, randomized trials.38 In the case of air pollution, how-
the studies are funded with the explicit goal of finding ever, ethical and practical concerns make it impossible
harm from air pollution. In this environment, research- to do a randomized trial to test whether today’s his-
ers tend to choose statistical models that maximize the torically low air pollution levels are deadly. Still, if
effect they “expect” or “hope” to find—a problem observational studies are invalid in all other areas of
known as data-mining. As a result, observational stud- health research, there’s no reason to expect them to do
ies become statistical fishing expeditions that turn up any better on air pollution.
chance correlations rather than real effects. A range of additional evidence also suggests that
An additional bias is that researchers are more air pollution risks claimed in observational studies are
likely to seek publication of, and journal editors are spurious. Much of this evidence has already been pre-
more likely to accept for publication, studies that find sented, for example, the direct evidence that nitrate and
an effect, while studies that don’t find any effects sulfate particulate matter is harmless and the evidence
end up packed away into filing cabinets. The result is that the health-effects literature is much less consistent
a problem known as “publication bias.” The overall and robust than Spengler and Levy claim.
result is that the scientific literature includes lots of Animal studies provide a further check. If air
studies reporting “effects” that aren’t real. Once again, pollution at today’s low ambient levels is deadly to
some air pollution epidemiologists have noted the people, then we would expect that much higher lev-
problem: els of air pollution would kill at least some laboratory

Policy Report
10 Where the Bodies are Buried | OBSERVATIONAL EPIDEMIOLOGY STUDIES

animals. However, researchers have not been able to lost population during the 1980s—Midwest “rust belt”
kill various species of animals even with air pollution cities—also had higher PM2.5 levels. People left these
at levels many times greater than are ever found in cities, which were in economic decline, in search of
ambient air. A recent review of particulate matter toxi- work in more economically dynamic parts of the coun-
cology concluded, “It remains the case that no form try. But people who work and have the wherewithal to
of ambient PM—other than viruses, bacteria, and bio- migrate also tend to be healthier than the average per-
chemical antigens—has been shown, experimentally son. Hence, what appeared to be an effect of PM2.5 was
or clinically, to cause disease or death at concentra- actually the result of differential migration. Migration
tions remotely close to US ambient levels.”39 was just one of several confounding factors that di-
The same is true for ozone. The current federal minished or erased the apparent harm from PM2.5, but
ozone standard is 0.075 parts per (ppm), measured that were not accounted for by the original researchers.
over an 8-hour average. But ozone does not kill ani- Regulators and air pollution epidemiologists (includ-
mals, even after the equivalent of years of exposure to ing the HEI researchers who did the reanalysis) have
levels as high as 1.0 ppm—more than 13 times the fed- ignored this refutation of the ACS results and continue
eral ozone standard.40 to claim the ACS study provides proof of harm from
Although obser- air pollution.
A recent review of particulate matter
vational air pollution Spengler and Levy also cite the National Mor-
toxicology concluded, “It remains studies in humans can- bidity Mortality and Air Pollution Study (NMMAPS)
the case that no form of ambient PM not be checked against to support the claim that daily fluctuations in ozone
randomized trials, a and PM are deadly.43 NMMAPS assessed the associa-
... has been shown, experimentally number of researchers tion between daily ozone and PM levels and mortality
or clinically, to cause disease or have provided other in 95 U.S. cities. Spengler and Levy fail to mention
types of direct evi- that although NMMAPS reported a small association
death at concentrations remotely
dence that observation- between higher air pollution and premature death on
close to US ambient levels.” al studies are produc- average, higher air pollution was associated with a
ing a false appearance lower risk of death in more than one-third of the 95
of harm. For example, cities.44
Spengler and Levy cite the American Cancer Society One would never know about these problems
(ACS) study of PM2.5 and mortality (Pope et al. (1995, with observational studies from reading Spengler and
2002)) as evidence that any amount of particulate mat- Levy’s expert report. For example, they claim “The
ter in the air is deadly.41 The ACS study assessed the body of epidemiological literature for health effects of
long-term effects of PM2.5 exposure in different cities O3 [ozone] and particulate matter is large and robust,
around the U.S. But reanalyses of the ACS data have and is supported by good mechanistic understanding
demonstrated the extent to which observational stud- of how these pollutants can influence human health.
ies can give spurious results when researchers leave Premature mortality and morbidity attributable to fos-
out important confounding variables. sil fuel-related particulate matter and O3 persist in the
For example, in a reanalysis by the Health Ef- U.S. and reduction in emissions from coal-fired power
fects Institute (HEI), when migration rates into and out plants will have health benefits of the magnitude esti-
of various cities over time were added to the statistical mated within this report.”45 These claims are contra-
model relating PM2.5 and risk of death, the apparent dicted by large bodies of evidence summarized here,
effect of PM2.5 disappeared.42 Here’s why: Cities that but omitted from Spengler and Levy’s expert report.

John Locke Founation


Where the Bodies are Buried | CORRECTING ERRORS AND EXAGGERATIONS 11

Correcting the Experts’ Errors and Exaggerations

Combining Spengler and Levy’s health-benefit the fact that ozone does not cause premature mortal-
claims with Deck’s cost-benefit analysis, reductions ity eliminates another 1.4 percent of the benefits. We
in sulfate and nitrate particulate matter account for also showed that Spengler and Levy exaggerated other
98.5 percent of the total benefits of TVA emissions effects of ozone, such as school absences and emer-
reductions, while reductions in ozone account for the gency room visits, meaning that even the remaining
remaining 1.5 percent of benefits.46 Of the ozone ben- 0.1 percent of benefits are exaggerated.
efits, 1.4 percent accrue from reductions in premature In sum, correcting the experts’ false assump-
mortality, and 0.1 percent from reductions in all of the tions and mistaken health claims eliminates more than
other health effects attributed to ozone. 99.9 percent of the benefits they claim for TVA power
In this report, we have shown that sulfate and plant emissions reductions. As a result, the cost of
nitrate particulate matter are harmless, which means those emissions reductions will be more than 50 times
that 98.5 percent of the benefits claimed by the At- greater than the benefits.
torney General’s experts are not real. Accounting for

Conclusion

North Carolina Attorney General Roy Cooper’s at the relatively low levels found in U.S. air. By us-
experts claim that reducing emissions from the Ten- ing these false assumptions and omitting contrary evi-
nessee Valley Authority’s power plants will improve dence, the Attorney General’s experts made the ben-
Americans’ health to the tune of nearly $11 billion efits of power plant emissions reductions appear to be
per year. But 98.5 percent of these benefits rely on the more than a thousand times greater than they actually
false assumption that sulfate and nitrate particulate are. After correcting the experts’ false claims, the cost
matter is toxic. Another 1.4 percent of these benefits of the TVA emissions reductions is more than 50 times
rely on the false assumption that ozone is deadly even greater than the benefits.

Policy Report
12 Where the Bodies are Buried | NOTES

Notes

1. North Carolina Department of Justice, “AG and overall cost-benefit analysis of the power
Cooper Seeks to Stop TVA from Unlawfully Pollut- plant emission reductions.
ing NC Air,” press release, January 30, 2006, http:// For the sake of brevity, hereafter these reports
www.ncdoj.com/DocumentStreamerClient?director will be cited, respectively as: Spengler and Levy;
y=PressReleases/file=clean%20air%20TVA%20su Deck; Staudt; and Chinkin and Wheeler.
it%20final%20corrected%20version.pdf. Also see, 3. The amount of emission reduction is based
Elizabeth Shogren, “North Carolina Sues TVA to on the assumption that the TVA plants would have to
Clean Up Pollution,” National Public Radio, Novem- meet the same requirements as power plants in North
ber 1, 2006, http://www.npr.org/templates/story/story. Carolina must meet under that state’s Clean Smoke-
php?storyId=6417740. stacks Act.
2. The four expert reports are: John D. Spen- 4. Spengler and Levy, Tables B.3 and B.4.
gler and Jonathan I. Levy, Public Health Benefits
5. Deck and Staudt expert reports. These are
of Additional Emission Controls on Tennessee Valley
the total benefits for all states affected by TVA power
Authority Coal-Fired Power Plants, prepared for the
plant emissions. For North Carolina specifically, the
North Carolina Department of Justice (Newton, Mass.:
estimated benefits amounted to $792 million. These
Environmental Health & Engineering, Inc., October
are benefit estimates for the year 2013.
30, 2006); Leland B. Deck, Economic Benefits Analy-
sis of the Health Effects from Controlling Emissions 6. “Control of SO2 contributes a significant ma-
from Tennessee Valley Authority Coal-Fired Power jority of the mortality and morbidity benefits that we
Plants, prepared for the North Carolina Department of estimated for additional controls on the TVA plants.”
Justice (Washington, D.C.: Stratus Consulting, Octo- Spengler and Levy, p. 47.
ber 27, 2006); James E. Staudt, Expert Report [on 7. Deck, p. 6.
cost of controlling emissions from TVA power plants],
8. Spengler and Levy, p. 13. In addition, Spen-
October 13, 2006; Lyle R. Chinkin and Neil J. M.
gler and Levy later state “CMAQ model runs predicted
Wheeler, Air Quality Modeling and Analysis of Addi-
lower concentrations of three components—sulfate,
tional Emission Controls on Tennessee Valley Author-
nitrate, and ammonium—of fine particles as a result of
ity Coal-Fired Power Plants, prepared for the North
reduced emissions of SO2 and NOx from the coal-fired
Carolina Department of Justice (Petaluma, CA: So-
TVA facilities. Lower concentrations of sulfate, gener-
noma Technology, August 29, 2006).
ally found in the form of ammonium sulfate, are attrib-
Each report addresses a different aspect of the
utable to reduced SO2. Similarly, lower concentrations
issue, as follows:
of nitrate, often in the form of ammonium nitrate, are
Staudt: Cost of controlling NOx and SO2 emis-
attributable to reduced emissions of NOx.”
sions from TVA power plants.
Chinkin and Wheeler: Reduction in ambient 9. The remaining benefits come from ozone re-
levels of PM2.5 and ozone due to the power plant ductions, which are discussed later in this report. The
emissions reductions. portion of benefits attributed respectively to PM2.5 and
Spengler and Levy: Reduction in premature ozone were calculated by multiplying the number of
mortality, hospital visits, and other health effects cases of each health effect prevented (Spengler and
as a result of the power plant emissions reduc- Levy, Tables B.3 and B.4) by the dollar cost attributed
tions. to each health effect (Deck, Table 6, using the column
Deck: Dollar value of the health improvements for 2006 prices and incomes).

John Locke Founation


Where the Bodies are Buried | NOTES 13

10. J. Q. Koenig, K. Dumler, V. Rebolledo et 14. See, for example, M. Blitz, S. Blitz, R.
al., “Respiratory Effects of Inhaled Sulfuric Acid on Hughes et al., “Aerosolized Magnesium Sulfate for
Senior Asthmatics and Nonasthmatics,” Archives of Acute Asthma: A Systematic Review,” Chest 128
Environmental Health 48 (1993): 171-5. (2005): 337-44.
11. The parenthetical “(ammonium sulfate)” is 15. M. T. Kleinman, W. S. Linn, R. M. Bailey et
in the original publication. Ibid. al., “Effect of Ammonium Nitrate Aerosol on Human
12. For example, Sackner et al. (1977) exposed Respiratory Function and Symptoms,” Environmental
volunteers to 1,000 μg/m3 (sic) of sulfate particulate Research 21 (1980): 317-26; R. W. Stacy, E. Seal, Jr.,
matter and concluded “Brief exposure to microaero- D. E. House et al., “A Survey of Effects of Gaseous and
sols of sulfate particulate matter do not appear to ad- Aerosol Pollutants on Pulmonary Function of Normal
versely affect cardiopulmonary function of normal Males,” Archives of Environmental Health 38 (1983):
humans even in concentrations up to 20 times greater 104-15; M. J. Utell, A. J. Swinburne, R. W. Hyde et
than the highest environmental urban concentrations al., “Airway Reactivity to Nitrates in Normal and Mild
recorded.” Utell et al. (1983) had 17 asthmatics inhale Asthmatic Subjects,” Journal of Applied Physiology
ammonium sulfate and other sulfates at levels ranging 46 (1979): 189-96.
from 100 μg/m3 to 1,000 μg/m3 and concluded: “At the 16. L. C. Green and S. R. Armstrong, “Particu-
1,000 μg/m3 concentration, the Threshold Limit Value late Matter in Ambient Air and Mortality: Toxicologic
for occupational exposure, H2SO4 [sulfuric acid] and Perspectives,” Regulatory Toxicology and Pharmacol-
NH4HSO4 [ammonium bisulfite] inhalation produced ogy 38 (2003): 326-35; R. B. Schlesinger, “The Health
significant reductions in specific airway conductance Impact of Common Inorganic Components of Fine
(SGaw) (p less than 0.05) and forced expiratory vol- Particulate Matter (PM2.5) in Ambient Air: A Critical
ume in one second (p less than 0.01) compared with Review,” Inhalation Toxicology 19 (2007): 811-32; R.
NaCl [table salt] or pre-exposure values. At the 450 B. Schlesinger and F. Cassee, “Atmospheric Second-
μg/m3 concentration, only H2SO4 inhalation produced ary Inorganic Particulate Matter: The Toxicological
a significant reduction in SGaw (p less than 0.01). At
Perspective as a Basis for Health Effects Risk Assess-
100 μg/m3, a level 3 to 5 times greater than peak ur-
ment,” Inhalation Toxicology 15 (2003): 197-235.
ban levels, no significant change in airway function
17. Deck, p. 6.
occurred after any sulfate exposure.” M. A. Sackner,
18. F. W. Lipfert, J. Zhang, and R. E. Wyzga,
D. Ford and R. Fernandez, “Effect of Sulfate Aerosols
“Infant Mortality and Air Pollution: A Comprehensive
on Cardiopulmonary Function of Normal Humans,”
American Review of Respiratory Diseases 115 (1977): Analysis of U.S. Data for 1990,” Journal of the Air
240; M. J. Utell, P. E. Morrow, D. M. Speers et al., and Waste Management Association 50 (2000): 1350-
“Airway Responses to Sulfate and Sulfuric Acid Aero- 66.
sols in Asthmatics. An Exposure-Response Relation- 19. Spengler and Levy, p. 35. B. Ritz, M. Wil-
ship,” American Review of Respiratory Disease 128 helm, and Y. Zhao, “Air Pollution and Infant Death
(1983): 444-50. in Southern California, 1989-2000,” Pediatrics 118
13. W. H. White, L. L. Ashbaugh, N. P. Hys- (2006): 493-502; T. J. Woodruff, J. D. Parker, and K.
lop et al., “Estimating Measurement Uncertainty in an C. Schoendorf, “Fine Particulate Matter (PM2.5) Air
Ambient Sulfate Trend,” Atmospheric Environment 39 Pollution and Selected Causes of Postneonatal Infant
(2005): 6857-67. Mortality in California,” Environmental Health Per-

Policy Report
14 Where the Bodies are Buried | NOTES

spectives 114 (2006): 786-90. 7.pdf.


20. Spengler and Levy, Table B.4. 27. Spengler and Levy, p. 38.
21. Spengler and Levy, p. 30. F. D. Gilliland, K. 28. The Criteria Document is EPA’s review
Berhane, E. B. Rappaport et al., “The Effects of Ambi- of ozone health effects science to support tighten-
ent Air Pollution on School Absenteeism Due to Re- ing the ozone standard. Environmental Protection
spiratory Illnesses,” Epidemiology 12 (2001): 43-54. Agency, Air Quality Criteria for Ozone and Related
22. The two studies are K. Berhane and D. C. Photochemical Oxidants (Washington, DC: February
Thomas, “A Two-Stage Model for Multiple Time Se- 2006), http://cfpub.epa.gov/ncea/cfm/recordisplay.
ries Data of Counts,” Biostatistics 3 (2002): 21-32; V. cfm?deid=149923.
Rondeau, K. Berhane, and D. C. Thomas, “A Three- 29. H. Desqueyroux, J. C. Pujet, M. Prosper et
Level Model for Binary Time-Series Data: The Effects al., “Short-Term Effects of Low-Level Air Pollution
of Air Pollution on School Absences in the Southern on Respiratory Health of Adults Suffering from Mod-
California Children’s Health Study,” Statistics in Med- erate to Severe Asthma,” Environmental Research 89
icine 24 (2005): 1103-15. (2002): 29-37.
23. An “exacerbation” means increases in symp- 30. K. M. Mortimer, L. M. Neas, D. W. Dockery
toms such as coughing, wheezing, and chest tightness. et al., “The Effect of Air Pollution on Inner-City Chil-
Spengler and Levy, Table B. 3. dren with Asthma,” European Respiratory Journal 19
24. Spengler and Levy, Tables B. 3 and B.4. (2002): 699-705.

25. In the eastern half of the U.S., summer is 31. Spengler and Levy only included studies that
also the season with the highest particulate levels. reported an overall daily “symptom score” for asthma.
Gent et al. (2003) reported results for each symptom
26. For data on asthma emergency room vis-
separately (e.g., chest tightness, wheezing, etc.). J. F.
its and hospitalizations by month, see, for example,
Gent, E. W. Triche, T. R. Holford et al., “Association
Spokane Regional Health District, Asthma in Spokane
County (Spokane, Washington: April 2002), http:// of Low-Level Ozone and Fine Particles with Respira-
www.srhd.org/information/pubs/pdf/factsheets/Asth- tory Symptoms in Children with Asthma,” Journal of
maInSpokaneCounty.pdf; J. Stockman, N. Shaikh, J. the American Medical Association 290 (2003): 1859-
von Behren et al., California County Asthma Hospi- 67.
talization Chart Book, Data from 1998-2000 (Califor- 32. L. Clancy, P. Goodman, H. Sinclair et al.,
nia Department of Health Services, September 2003), “Effect of Air-Pollution Control on Death Rates in
http://www.ehib.org/cma/papers/Hosp_Cht_Book_ Dublin, Ireland: An Intervention Study,” Lancet 360
2003.pdf ; Texas Department of Health, Asthma Prev- (2002): 1210-4.
alence, Hospitalizations and Mortality – Texas, 1999-
33. Spengler and Levy, p. 13.
2001 (Austin: November 21, 2003), http://archive.
dshs.state.tx.us/legacytdh/cphpr/asthma.htm; K. Tippy 34. S. Begley, “New Journals Bet ‘Negative
and N. Sonnenfeld, Asthma Status Report, Maine 2002 Results’ Save Time, Money,” Wall Street Journal,
(Augusta, Maine: Maine Bureau of Health, November September 15, 2006, B1, http://online.wsj.com/ar-
25, 2002); K. R. Wilcox and J. Hogan, An Analysis ticle/SB115827169620563571-email.html; J. P. Ioan-
of Childhood Asthma Hospitalizations and Deaths in nidis, “Why Most Published Research Findings Are
Michigan, 1989-1993 (Lansing, Mich.: Michigan De- False,” PLoS Med 2 (2005): e124; J. P. A. Ioannidis,
partment of Community Health, undated), http://www. “Contradicted and Initially Stronger Effects in Highly
michigan.gov/documents/Childhood_Asthma_6549_ Cited Clinical Research,” Journal of the American

John Locke Founation


Where the Bodies are Buried | NOTES 15

Medical Association 294 (2005): 218-28; G. Taubes, ing to look at it as a biologist and trying to figure out
“Epidemiology Faces Its Limits,” Science 269 (1995): whether [ozone] exposure kills people. And I’ve never
164-69; G. Taubes, “Do We Really Know What killed a rat in 35 years…never killed a monkey in 35
Makes Us Healthy?” New York Times, September 16, years” (transcript of CASAC meeting, December 8,
2007, http://www.nytimes.com/2007/09/16/magazine/ 2005, p. 148). Indeed, dozens of studies have been
16epidemiology-t.html?_r=3&ref=magazine&oref=s performed on monkeys, rats, mice, dogs, and other
login&oref=slogin&oref=slogin.
animals, with daily exposures as high as 1.0 ppm and
34. S. Ebrahim and M. Clarke, “STROBE: New often continuing for the equivalent of years, but none
Standards for Reporting Observational Epidemiology, has reported any deaths, despite the enormous ozone
a Chance to Improve,” International Journal of Epide- exposures.
miology 36 (2007): 946-48; S. J. Pocock, T. J. Collier,
41. Spengler and Levy, p. 16. C. A. Pope, M. J.
K. J. Dandreo et al., “Issues in the Reporting of Epi-
Thun, M. M. Namboodiri et al., “Particulate Air Pollu-
demiological Studies: A Survey of Recent Practice,”
tion as a Predictor of Mortality in a Prospective Study
British Medical Journal 329 (2004): 883; G. D. Smith
of U.S. Adults,” American Journal of Respiratory and
and S. Ebrahim, “Epidemiology - Is It Time to Call
It a Day?” International Journal of Epidemiology 30 Critical Care Medicine 151 (1995): 669-74; C. A.
(2001): 1-11; E. von Elm and M. Egger, “The Scandal Pope, R. T. Burnett, M. J. Thun et al., “Lung Cancer,
of Poor Epidemiological Research,” British Medical Cardiopulmonary Mortality, and Long-Term Expo-
Journal 329 (2004): 868-69. sure to Fine Particulate Air Pollution,” Journal of the
36. T. Lumley and L. Sheppard, “Time Series American Medical Association 287 (2002): 1132-41.
Analyses of Air Pollution and Health: Straining at 42. D. Krewski, R. T. Burnett, M. S. Goldberg
Gnats and Swallowing Camels?” Epidemiology 14 et al., Reanalysis of the Harvard Six Cities Study and
(2003): 13-4. the American Cancer Society Study of Particulate Air
37. H. Anderson, R. Atkinson, J. Peacock et Pollution and Mortality (Cambridge, Mass.: Health
al., Meta-Analysis of Time-Series Studies and Panel Effects Institute, July, 2000).
Studies of Particulate Matter (PM) and Ozone (World 43. Spengler and Levy, p. 28.
Health Organization, 2004), www.euro.who.int/docu- 44. Of particular interest for North Carolina,
ment/e82792.pdf. higher ozone was associated with slightly lower risk
38. Begley, “New Journals Bet ‘Negative Re- of death in Raleigh (not statistically significant) and no
sults’ Save Time, Money.”; Ioannidis, “Why Most change in risk in Charlotte. Higher PM was associated
Published Research Findings Are False.”; Taubes, “Do with a higher risk of death in Charlotte and a lower
We Really Know What Makes Us Healthy?” risk of death in Raleigh (neither statistically signifi-
39. Green and Armstrong, “Particulate Matter cant). F. Dominici, A. McDermott, M. Daniels et al.,
in Ambient Air and Mortality: Toxicologic Perspec- Revised Analyses of the National Morbidity, Mortality,
tives.” and Air Pollution Study, Part II (Boston: Health Ef-
fects Institute, May 2003); Environmental Protection
40. During EPA’s review of the federal ozone
Agency, Air Quality Criteria for Ozone and Related
standard, UC Davis professor Charles Plopper, a mem-
ber of EPA’s Clean Air Science Advisory Committee, Photochemical Oxidants.
noted that for decades he had been exposing animals 45. Spengler and Levy, p. 49.
to very high concentrations of ozone but that he had 46. Calculated from Deck, Table 6 and Spengler
never killed any. As Professor Plopper said, “I’m try- and Levy, Tables B.3 and B.4. See note 9 for details.

Policy Report
About the Author

Joel Schwartz is a visiting scholar at the American Enterprise Institute and the author of “Air Quality in Amer-
ica: A Dose of Reality on Air Pollution Levels, Trends, and Health Risks” (AEI Press, 2008).

Mr. Schwartz formerly directed the Reason Public Policy Institute’s Air Quality Project and has also published
studies on chemical risks and extended producer responsibility. Prior to joining Reason, he was Executive Of-
ficer of the California Inspection and Maintenance Review Committee, a government agency charged with
evaluating California’s vehicle emissions inspection program and making recommendations to the legislature
and governor on program improvements. He has worked at the RAND Corporation, the South Coast Air Quality
Management District, and the Coalition for Clean Air.

Mr. Schwartz received his bachelor’s degree in chemistry from Cornell University and his master’s degree in
planetary science from the California Institute of Technology.

About the John Locke Foundation

The John Locke Foundation is a nonprofit, nonpartisan policy institute based in Raleigh, North Carolina. Its
mission is to develop and promote solutions to the state’s most critical challenges. The John Locke Founda-
tion seeks to transform state and local government through the principles of competition, innovation, personal
freedom, and personal responsibility in order to strike a better balance between the public sector and private
institutions of family, faith, community, and enterprise.

To pursue these goals, the John Locke Foundation operates a number of programs and services to provide in-
formation and observations to legislators, policymakers, business executives, citizen activists, civic and com-
munity leaders, and the news media. These services and programs include the Foundation’s monthly newspa-
per, Carolina Journal; its daily news service, CarolinaJournal.com; its weekly e-newsletter, Carolina Journal
Weekly Report; its quarterly newsletter, The Locke Letter; and regular events, conferences, and research reports
on important topics facing state and local governments.

The Foundation is a 501(c)(3) public charity, tax-exempt education foundation and is funded soley from vol-
untary contributions from individuals, corporations, and charitable foundations. It was founded in 1990. For
more information, visit www.JohnLocke.org.
“To prejudge other men’s notions
before we have looked into them
is not to show their darkness
but to put out our own eyes.”
JOHN LOCKE (1632-1704)
Author, Two Treatises of Government and
Fundamental Constitutions of Carolina

200 West Morgan St.


Raleigh, NC 27601
V: 919-828-3876
F: 919-821-5117
www.johnlocke.org
info@johnlocke.org

Você também pode gostar