Você está na página 1de 17

Behavior Research Methods

2007, 39 (2), 175-191

G*Power3: A flexible statistical power analysis


program for the social, behavioral, and
biomedical sciences
Franz Faul
Christian-Albrechts-Universitt Kiel, Kiel, Germany

Edgar Erdfelder
Universitt Mannheim, Mannheim, Germany
and

Albert-Georg Lang and Axel Buchner


Heinrich-Heine-Universitt Dsseldorf, Dsseldorf, Germany

G*Power (Erdfelder, Faul, & Buchner, 1996) was designed as a general stand-alone power analysis program
for statistical tests commonly used in social and behavioral research. G*Power3 is a major extension of, and
improvement over, the previous versions. It runs on widely used computer platforms (i.e., Windows XP, Win-
dows Vista, and Mac OS X 10.4) and covers many different statistical tests of the t, F, and c2 test families. In
addition, it includes power analyses for ztests and some exact tests. G*Power3 provides improved effect size
calculators and graphic options, supports both distribution-based and design-based input modes, and offers all
types of power analyses in which users might be interested. Like its predecessors, G*Power3 is free.

Statistics textbooks in the social, behavioral, and biomed- reviews of which we are aware (Kornbrot, 1997; Ortseifen,
ical sciences typically stress the importance of power analy- Bruckner, Burke, & Kieser, 1997; Thomas & Krebs, 1997).
ses. By definition, the power of a statistical test is the prob- It has been used in several power tutorials (e.g., Buchner,
ability that its null hypothesis (H0) will be rejected given that Erdfelder, & Faul, 1996, 1997; Erdfelder, Buchner, Faul, &
it is in fact false. Obviously, significance tests that lack sta- Brandt, 2004; Levin, 1997; Sheppard, 1999) and in statis-
tistical power are of limited use because they cannot reliably tics textbooks (e.g., Field, 2005; Keppel & Wickens, 2004;
discriminate between H0 and the alternative hypothesis (H1) Myers & Well, 2003; Rasch, Friese, Hofmann, & Naumann,
of interest. However, although power analyses are indispens- 2006a, 2006b). Nevertheless, the user feedback that we re-
able for rational statistical decisions, it was not until the late ceived coincided with our own experience in showing some
1980s that power charts (see, e.g., Scheff, 1959) and power limitations and weaknesses of G*Power2 that required a
tables (see, e.g., Cohen, 1988) were supplemented by more major extension and revision.
efficient, precise, and easy-to-use power analysis programs In the present article, we describe G*Power3, a program
for personal computers (Goldstein, 1989). G*Power2 (Erd- that was designed to address the problems of G*Power2.
felder, Faul, & Buchner, 1996) can be seen as a second- We begin with an outline of the major improvements in
generation power analysis program designed as a stand- G*Power3 and then discuss the types of power analyses cov-
alone application to handle several types of statistical tests ered by this program. Next, we describe program handling
commonly used in social and behavioral research. In the past and the types of statistical tests to which it can be applied.
10years, this program has been found useful not only in the We then discuss the statistical algorithms of G*Power3 and
social and behavioral sciences but also in many other disci- their accuracy. Finally, program availability and some Inter-
plines that routinely apply statistical tests, including biology net resources supporting users of G*Power3 are described.
(Baeza & Stotz, 2003), genetics (Akkad etal., 2006), ecol-
ogy (Sheppard, 1999), forest and wildlife research (Mellina, Improvements in G*Power3 in
Hinch, Donaldson, & Pearson, 2005), the geosciences (Bus- Comparison With G*Power2
bey, 1999), pharmacology (Quednow etal., 2004), and med-
ical research (Gleissner, Clusmann, Sassen, Elger, & Helm- G*Power3 is an improvement over G*Power2 in five
staedter, 2006). G*Power2 was evaluated positively in the major respects. First, whereas G*Power2 requires the

E. Erdfelder, erdfelder@psychologie.uni-mannheim.de

175 Copyright 2007 Psychonomic Society, Inc.


176 Faul, Erdfelder, Lang, and Buchner

DOS and MacOS 79 operating systems that were com- research process, and the specific research question, five
mon in the 1990s but are now outdated, G*Power3 runs different types of power analysis can be reasonable (cf.
on the personal computer platforms currently in widest Erdfelder etal., 2004; Erdfelder, Faul, & Buchner, 2005).
use: Windows XP, Windows Vista, and Mac OS X 10.4. We describe these methods and their uses in turn.
The Windows and Mac versions of the program are es-
sentially equivalent. They use the same computational APriori Power Analyses
routines and share very similar user interfaces. For this In apriori power analyses (Cohen, 1988), sample
reason, we will not differentiate between these versions in size N is computed as a function of the required power
what follows; users simply have to make sure to download level (12b), the prespecified significance level a, and
the version appropriate for their operating system. the population effect size to be detected with probability
Second, whereas G*Power2 is limited to three types 12b. A priori analyses provide an efficient method of
of power analyses, G*Power3 supports five different controlling statistical power before a study is actually con-
ways to assess statistical power. In addition to the apri- ducted (see, e.g., Bredenkamp, 1969; Hager, 2006) and
ori, posthoc, and compromise power analyses that were can be recommended whenever resources such as the time
already covered by G*Power2, the new program offers and money required for data collection are not critical.
sensitivity analyses and criterion analyses.
Third, G*Power3 provides dedicated power analysis Post Hoc Power Analyses
options for a variety of frequently used t, F, z, c2, and In contrast to apriori power analyses, post hoc power
exact tests in addition to the standard tests covered by analyses (Cohen, 1988) often make sense after a study
G*Power2. The tests captured by G*Power3 and their has already been conducted. In post hoc analyses, 12b
effect size parameters are described in the Program Han- is computed as a function of a, the population effect size
dling section. Importantly, users are not limited to these parameter, and the sample size(s) used in a study. It thus
tests because G*Power3 also offers power analyses for becomes possible to assess whether or not a published
generic t, F, z, c2, and binomial tests for which the non- statistical test in fact had a fair chance of rejecting an in-
centrality parameter of the distribution under H1 may correct H0. Importantly, posthoc analyses, like apriori
be entered directly. In this way, users are provided with analyses, require an H1 effect size specification for the
a flexible tool for computing the power of basically any underlying population. Post hoc power analyses should
statistical test that uses t, F, z, c2, or binomial reference not be confused with so-called retrospective power anal-
distributions. yses, in which the effect size is estimated from sample
Fourth, statistical tests can be specified in G*Power3 data and used to calculate the observed power, a sample
using two different approaches: the distribution-based ap- estimate of the true power.1 Retrospective power analy-
proach and the design-based approach. In the distribution- ses are based on the highly questionable assumption that
based approach, users select the family of the test statistic the sample effect size is essentially identical to the effect
(t, F, z, c2, or exact test) and the particular test within size in the population from which it was drawn (Zumbo &
that family. This is how power analyses were specified in Hubley, 1998). Obviously, this assumption is likely to be
G*Power2. In addition, a separate menu in G*Power3 false, and the more so the smaller the sample. In addition,
provides access to power analyses via the design-based sample effect sizes are typically biased estimates of their
approach: Users select (1)the parameter class to which population counterparts (Richardson, 1996). For these
the statistical test refers (correlations, means, proportions, reasons, we agree with other critics of retrospective power
regression coefficients, variances) and (2)the design of analyses (e.g., Gerard, Smith, & Weerakkody, 1998; Hoe-
the study (e.g., number of groups, independent vs. depen- nig & Heisey, 2001; Kromrey & Hogarty, 2000; Lenth,
dent samples). On the basis of the feedback we received 2001; Steidl, Hayes, & Schauber, 1997). Rather than use
about G*Power2, we expect that some users might find retrospective power analyses, researchers should specify
the design-based input mode more intuitive and easier to population effect sizes on apriori grounds. To specify the
use. effect size simply means to define the minimum degree
Fifth, G*Power3 supports users with enhanced graph- of violation of H0 a researcher would like to detect with
ics features. The details of these features will be outlined a probability not less than 12b. Cohens definitions of
in the Program Handling section. small, medium, and large effects can be helpful in such
effect size specifications (see, e.g., Smith & Bayen, 2005).
Types of Statistical Power Analyses However, researchers should be aware of the fact that
these conventions may have different meanings for differ-
The power (12b) of a statistical test is the complement ent tests (cf. Erdfelder etal., 2005).
of b, which denotes the TypeII or beta error probability
of falsely retaining an incorrect H0. Statistical power de- Compromise Power Analyses
pends on three classes of parameters: (1)the significance In compromise power analyses (Erdfelder, 1984;
level (i.e., the TypeI error probability) a of the test, (2)the Erdfelder etal., 1996; Mller, Manz, & Hoyer, 2002),
size(s) of the sample(s) used for the test, and (3)an effect both a and 12b are computed as functions of the ef-
size parameter defining H1 and thus indexing the degree fect size, N, and the error probability ratio q5 b/a. To
of deviation from H0 in the underlying population. De- illustrate, setting qto 1 would mean that the researcher
pending on the available resources, the actual phase of the prefers balanced TypeI and TypeII error risks (a5 b),
G*Power 3 177

whereas a qof 4 would imply that b5 4a (cf. Cohen, analyses defined in the previous section, (3)provide the
1988). Compromise power analyses can be useful both input parameters required for the analysis, and (4)click on
before and after data collection. For example, an apriori Calculate to obtain the results.
power analysis might result in a sample size that exceeds In the first step, the statistical test is chosen using
the available resources. In such a situation, a researcher the distribution-based or the design-based approach.
could specify the maximum affordable sample size and, G*Power2 users probably have adapted to the distribution-
using a compromise power analysis, compute a and 12b based approach: One first selects the family of the test
associated with, say, q 5 b/a 5 4. Alternatively, if a study statistic (t, F, z, c2, or exact test) using the Test fam-
has already been conducted but has not yet been analyzed, ily menu in the main window. The Statistical test menu
a researcher could ask for a reasonable decision criterion adapts accordingly, showing a list of all tests available for
that guarantees perfectly balanced error risks (i.e., a5b) the test family. For the two-groups t test, for example, one
given the size of the sample and the critical effect size would first select the t family of distributions and then
in which he or she is interested. Of course, compromise Means: Difference between two independent means (two
power analyses can easily result in unconventional sig- groups) in the Statistical test menu (see Figure1). Al-
nificance levels greater than a 5 .05 (in the case of small ternatively, one might use the design-based approach of
samples or effect sizes) or less than a 5 .001 (in the case test selection. With the Tests pull-down menu in the top
of large samples or effect sizes). However, we believe that row, it is possible to select (1) the parameter class to which
the benefit of balanced TypeI and TypeII error risks often the statistical test refers (i.e., correlation and regression,
offsets the costs of violating significance level conven- means, proportions, variances, or generic) and (2) the de-
tions (cf. Gigerenzer, Krauss, & Vitouch, 2004). sign of the study (e.g., number of groups, independent
vs. dependent samples). For example, a researcher would
Sensitivity Analyses select Means followed by Two independent groups to
In sensitivity analyses, the critical population effect size specify the two-groups t test (see Figure2). The design-
is computed as a function of a, 12b, and N. Sensitivity based approach has the advantage that test options refer-
analyses may be particularly useful for evaluating pub- ring to the same parameter class (e.g., means) are located
lished research. They provide answers to questions such as in close proximity, whereas in the distribution-based ap-
What effect size was a study able to detect with a power proach they may be scattered across different distribution
of 12b5 .80 given its sample size and a as specified families.
by the author? In other words, what is the minimum ef- In the second step, the Type of power analysis menu
fect size to which the test was sufficiently sensitive? In in the center of the main window should be used to choose
addition, it may be useful to perform sensitivity analyses the appropriate analysis type. In the third step, the power
before conducting a study to see whether, given a lim- analysis input parameters are specified in the lower left of
ited N, the size of the effect that can be detected is at all the main window. To illustrate, an apriori power analysis
realistic (or, for instance, much too large to be expected for a two-groups t test would require a decision between a
realistically). one-tailed and a two-tailed test, a specification of Cohens
(1988) effect size measure (d) under H1, the significance
Criterion Analyses level a, the required power (12b) of the test, and the
Finally, criterion analyses compute a (and the associ- preferred group size allocation ratio n2/n1. The final step
ated decision criterion) as a function of 12b, the effect consists of clicking on Calculate to obtain the output in
size, and a given sample size. Criterion analyses are alter- the lower right of the main window.
natives to posthoc power analyses. They may be reason- For instance, input parameters specifying a one-tailed
able whenever the control of a is less important than the t test, a medium effect size of d5 0.5, a5 .05, 12b5
control of b. In case of goodness-of-fit tests for statistical .95, and an allocation ratio of n2/n151 would result in
models, for example, it is most important to minimize the a total sample size of N5 176 (88 observation units in
b risk of wrong decisions in favor of the model (H0). Re- each group; see Figures1 and 2). The noncentrality pa-
searchers could thus use criterion analyses to compute the rameter d defining the t distribution under H1, the decision
significance level a which is compatible with b5 .05 for criterion to be used (i.e., the critical value of the t statis-
a small effect size. tic), the degrees of freedom2 of the t test, and the actual
Whereas G*Power2 was limited to the first three types power value are also displayed. Note that the actual power
of power analysis, G*Power3 covers all five types. On the will often be slightly larger than the prespecified power
basis of the feedback we received from G*Power2 users, in apriori power analyses. The reason is that noninteger
we believe that any question related to statistical power sample sizes are always rounded up by G*Power to obtain
that arises in research practice can be categorized under integer values consistent with a power level not lower than
one of these analysis types. the prespecified one.
In addition to the numerical output, G*Power3 dis-
Program Handling plays the central (H0) and the noncentral (H1) test statistic
distributions along with the decision criterion and the as-
Using G*Power3 typically involves the following sociated error probabilities in the upper part of the main
four steps: (1)Select the statistical test appropriate for window (see Figure1).3 This supports understanding of
the problem, (2)choose one of the five types of power the effects of the input parameters and is likely to be a
178 Faul, Erdfelder, Lang, and Buchner

Figure1. The distribution-based approach of test specification in G*Power3.0.

useful visualization tool in the teaching of, or the learning (s) in the populations underlying the groups to calculate
about, inferential statistics. The distributions plot can be Cohens d5 | m12 m2 |/s. Clicking on the Calculate and
printed, saved, or copied by clicking on the right mouse transfer to main window button copies the computed ef-
button inside the plot area. fect size to the appropriate field in the main window.
The input and output of each power calculation in a Another useful option is the Power Plot window (see
G*Power session is automatically written to a protocol Figure3), which is opened by clicking on XY plot for a
that can be displayed by selecting the Protocol of power range of values on the lower right side of the main win-
analyses tab in the main window. It is possible to clear dow (see Figures1 and 2).
the protocol or to print, save, and copy the protocol in the By selecting the appropriate parameters for the y- and
same way as the distributions plot. xaxes, one parameter (a, 12b, effect size, or sample size)
Because Cohens (1988) book on power analysis appears can be plotted as a function of any other parameter. Of the
to be well-known in the social and behavioral sciences, we remaining two parameters, one can be chosen to draw a fam-
made use of his effect size measures whenever possible. ily of graphs, whereas the fourth parameter is kept constant.
Researchers unfamiliar with these measures and users For instance, sample size can be drawn as a function of the
who prefer to compute Cohens measures from more basic power 12b for several different population effects sizes
parameters can click on the Determine button to the left while a is kept at a particular value. The plot may be printed,
of the Effect size input field (see Figures1 and2). A saved, or copied by clicking on the right mouse button inside
drawer will open next to the main window and provide the plot area. Selecting the Table tab reveals the data un-
access to an effect size calculator tailored to the selected derlying the plot; they may be copied to other applications.
test (see Figure2). For the two-groups t test, for example, The Power Plot window inherits all input parameters of
users can specify the means (m1, m2) and the common SD the analysis that is active when the XY plot for a range of
G*Power 3 179

Figure2. The design-based approach of test specification in G*Power3.0 and the Effect size drawer.

Figure3. The Power Plot window of G*Power3.0.


180 Faul, Erdfelder, Lang, and Buchner

values button is clicked. Only some of these parameters esis that adding more predictors increases the value of R2
can be directly manipulated in the Power Plot window. For (Cohen, 1988, chap.9). According to Cohens criteria,
instance, switching from a plot of a two-tailed test to a plot effect sizes ( f 2)of 0.02, 0.15, and 0.35 are considered
of a one-tailed test requires choosing the Tail(s): One small, medium, and large, respectively.
option in the main window and then clicking on the XY
plot for a range of values button. Tests for Means (Univariate Case)
Table3 summarizes the power analysis procedures for
Types of Statistical Tests tests on means. G*Power3 supports all cases of the t test
for means described by Cohen (1988, chap.2): the test for
G*Power3 provides power analyses for test statistics independent means, the test of the null hypothesis that the
following t, F, c2, or standard normal distributions under population mean equals some specified value (one sample
H0 (either exact or asymptotic) and noncentral distributions case), and the test on the means of two dependent samples
of the same test families under H1. In addition, it includes (matched pairs). Cohens d and dz are used as effect size
power analyses for some exact tests. In Tables29, we indices. Cohen defines ds of 0.2, 0.5, and 0.8 as small,
briefly describe the tests currently covered by G*Power3. medium, and large effects, respectively. Effect size dialogs
Table1 lists the symbols used in Tables29 and their are available to compute the appropriate effect size param-
meanings. eter from means and SDs. For example, assume we want to
compare visual search times for targets embedded in rare
Tests for Correlation and Regression versus frequent local contexts in a within-subjects design
Table2 summarizes the procedures supported for test- (cf. Hoffmann & Sebald, 2005, Experiment1). It is ex-
ing hypotheses on correlation and regression. One-sample pected that the mean search time for targets in rare contexts
tests are provided for the pointbiserial modelthat is, (e.g., 600msec) should decrease by at least 10msec (i.e.,
the model for correlations between a binary variable and to 590msec) in frequent contexts as a consequence of local
a continuous variableand for correlations between two contextual cuing. If prior evidence suggests population
normally distributed variables (Cohen, 1988, chap.3).4 SDs of, say, s5 25msec in each of the conditions and a
The latter test uses the exact sample correlation coefficient correlation of r5 .70 between search times in the two con-
distribution (Barabesi & Greco, 2002) or, optionally, a ditions, we can use the Effect size drawer of G*Power3
large-sample approximation based on Fishers r-to-z trans- for the matched pairs t test to calculate the effect size dz5
formation. The two-sample test for differences between 0.516 (see the second row of Table3 for the formula). By
two correlations uses Cohens (1988, chap.4) effect size q selecting a post hoc power analysis for one-tailed matched
and is based on Fishers r-to-z transformation. Cohen de- pairs t tests, we easily see that for dz5 0.516, a5 .05, and
fines qs of 0.10, 0.30, and 0.50 as small, medium, and large N5 16participants, the power (12b) is only .47. Thus,
effects, respectively. provided that the assumptions outlined above are appropri-
The two procedures available for the multiple regres- ate, the nonsignificant statistic [t(15)5 1.475] obtained by
sion model handle the cases of (1) a test of an overall Hoffmann and Sebald (2005, Experiment1, p. 34) might
effectthat is, the hypothesis that the population value in fact be due to a Type II error. This interpretation would
of R2 is different from zeroand (2) a test of the hypoth- be consistent with the fact that Hoffmann and Sebald ob-

Table 1
Symbols and Their Meanings As Used in the Tables
Symbols Meaning
m (mi) population mean (in group i)
m (mi) vector of population means (in group i)
mx2y population mean of the difference
N total sample size
ni sample size in group i
s standard deviation in the population
sm standard deviation of the effect
sx2y standard deviation of the difference
l noncentrality parameter of the noncentral F and 2 distribution
d noncentrality parameter of the noncentral t distribution
df degrees of freedom
df1, df2 numerator and denominator degrees of freedom, respectively
r (ri) population correlation (in group i)
2 2
RYA , RYA,B squared multiple correlation coefficients, corresponding to the proportion of Y
variance that can be accounted for by multiple regression on the set of predictor
variables A and AB, respectively
S population variancecovariance matrix
M matrix of regression parameters (population means)
C contrast matrix (contrasts between rows of M)
A contrast matrix (contrasts between columns of M)
p (pi) probability of success (in group i)
G*Power 3 181

Table 2
Tests for Correlation and Regression
Test Null Noncentrality Parameter
Test Family Hypothesis Effect Size Other Parameters and Degrees of Freedom
Difference from t tests r50 r 2
zero: point biserial = N
model 1 2
df 5 N 2 2
Difference from exact r5c r Constant
constant tests correlation c
(bivariate normal)
Inequality of two z tests r1 5 r2 q 5 z1 2 z2 q
m1 =
correlation s
1 + i
coefficients zi = 1 ln n1 + n2 6
2 1 i s=
(n 1
3) ( n2 3)

Multiple F tests RY2 A5 0 RY2 A Number of l 5 f 2N


regression: f2 = predictors p (#A) df1 5 p
1 RY2 A
deviation of R2 df2 5 N 2 p 2 1
from zero
Multiple F tests RY2 A,B5 RY2 A RY2 A,B RY2 A Total number of l 5 f 2N
regression: f2 = predictors p df1 5 q
1 R 2
increase of R2 Y A,B (#A 1 #B) df2 5 N 2 p 2 1
Number of tested
predictors q (#B)

served significant local contextual cuing effects in each of to compensate for such adverse effects in tests of within
the other four experiments they reported. effects or betweenwithin interactions, the noncentrality
The procedures provided by G*Power3 to test effects in parameter and the degrees of freedom of the F distribu-
between-subjects designs with more than two groups (i.e., tion can be multiplied by a correction factor e (Geisser &
one-way ANOVA designs and general main effects and Greenhouse, 1958; Huynh & Feldt, 1970). e51 if the
interactions in factorial ANOVA designs of any order) are sphericity assumption is met and approaches 1/(m21)
identical to those in G*Power2 (Erdfelder etal., 1996). In with increasing degrees of violation of sphericity, where
all these cases, the effect size f as defined by Cohen (1988) m denotes the number of repeated measurements.
is used. In a one-way ANOVA, the Effect size drawer G*Power provides three separate yet very similar rou-
can be used to compute f from the means and group sizes tines to calculate power in the univariate approach for
of k groups and an SD common to all groups. For tests of between effects, within effects, and interactions. If the to-
effects in factorial designs, the Effect size drawer offers be-detected effect size f is known, these procedures are
the possibility of computing effect size f from the vari- very easy to apply. To illustrate, Berti, Mnzer, Schrger,
ance explained by the tested effect and the error variance. and Pechmann (2006) compared the pitch discrimination
Cohen defines fs of 0.1, 0.25, and 0.4 as small, medium, ability of 10musicians and 10control subjects (between-
and large effects, respectively. subjects factor A) for 10 different interference conditions
New in G*Power3 are procedures for analyzing main (within-subjects factor B). Assuming that A, B, and A 3
effects and interactions for A 3 B mixed designs, where B effects of medium size ( f5 0.25; see Cohen, 1988;
A is a between-subjects factor (or an enumeration of Table3 of the present article) should be detected given a
the groups generated by cross-classification of several correlation of r5 .50 between repeated measures and a
between-subjects factors) and B is a within-subjects fac- significance level of a5 .05, the power values of the F
tor (or an enumeration of the repeated measures generated tests for the A main effect, the B main effect, and the A 3
by cross-classification of several within-subjects factors). B interaction are easily computed as .30, .95, and .95, re-
Both the univariate and the multivariate approaches to re- spectively, by inserting f5 0.25, a5 .05, the total sample
peated measures (OBrien & Kaiser, 1985) are supported. size (20), the number of groups (2), the number of repeti-
The multivariate approach will be discussed below. The tions (10), and r5 .50 into the appropriate input fields of
univariate approach is based on the sphericity assump- the procedures designed for these tests.
tion. This assumption is correct if (in the population) all If the to-be-detected effect size f is unknown, it must be
variances of the repeated measurements are equal and all computed from more basic parameters characterizing the
correlations between pairs of repeated measurements are expected population scenario under H1. To demonstrate
equal. If all the distributional assumptions are met, then the the general procedure, we will show how to do posthoc
univariate approach is the most powerful method (Muller power analyses in the scenario illustrated in Figure4 as-
& Barton, 1989; OBrien & Kaiser, 1985). Unfortunately, suming the variance and correlations structure defined
the assumption of equal correlations is violated quite in matrix SR1. We first consider the power of the within
often, which can lead to very misleading results. In order effect: We select the F tests family, the Repeated mea-
182 Faul, Erdfelder, Lang, and Buchner

Table 3
Tests for Means (Univariate Case)
Test Null Noncentrality Parameter
Test Family Hypothesis Effect Size Other Parameters and Degrees of Freedom
__
Difference from t tests m5c c d 5 dN

d =
constant (one- df 5 N 2 1
sample case)
__
Inequality of t tests mx2y 5 0 x y d 5 dzN

two dependent dz = df 5 N 2 1
means x y
(matched pairs) x y = x2 + y2 2 x y

Inequality of t tests m1 5 m2 1 2
d = n1n2
two independent =d
n1 + n2
means
df 5 N 2 2
ANOVA, fixed F tests mi 2 m 5 0 Number of l 5 f 2N
f =
effects, one i 5 1, ... , k groups k df1 5 k 2 1
way: inequality k df2 5 N 2 k
n ( )
2
of multiple j i
means =2

i =1
N
ANOVA, fixed F tests mi 2 m 5 0 Total number of l 5 f 2N
f =
effects, i 5 1, ... , k cells in the df1 5 q
multifactor design k df2 5 N 2 k
designs, and Degrees of
planned freedom of the
comparisons tested effect q
ANOVA: F tests mi 2 m 5 0 Levels of l 5 f 2uNe
f =
repeated i 5 1, ... , k between factor k u= m
measures, 1 + ( m 1)
between effects Levels of df1 5 k 2 1
repeated measures df2 5 N 2 k
factor m
ANOVA: F tests mi 2 m 5 0 l 5 f 2uN
f =
repeated i 5 1, ... , m u= m
measures, Population 1
within effects correlation df1 5 (m 2 1)e
among repeated df2 5 (N 2 k)(m 2 1)e
measures r
ANOVA: F tests mij 2 mi 2 ... l 5 f 2uNe
f =
repeated mj 1 m 5 0 u= m
measures, i 5 1, ... , k For within and 1
betweenwithin j 5 1, ... , m withinbetween df1 5 (k 2 1)(m 2 1)e
interactions interactions: df2 5 (N 2 k)(m 2 1)e
Nonsphericity
correction

sures: Within factors, ANOVA-approach test, and post to matrix SR1, we insert .3 in the Corr among rep mea-
hoc as the type of power analysis. Both the Number of sures input field andsince sphericity obviously holds
groups and Repetitions fields are set to 3. Total sample in this caseset nonsphericity correction e to 1. To deter-
size is set to 90 and a error probability to .05. Referring mine effect size f, we first calculate sm2, the variance of the

Time 1 Time 2 Time 3 mi ni


Group 1 10 15 20 15 30 10 0.3 0.1 9 0.3 0.3
Group 2 10 12 15 12.333 30 sr 2 = 0.3 9 0.3 sr1 = 0.3 9 0.3

Group 3 10 12 12 11.333 30 0.1 0.3 8 0.3 0.3 9
mj 10 13 15.667 m 5 12.889

Figure4. Sample 3 3 3 repeated measures designs. Three groups are repeatedly measured at three dif-
ferent times. The shaded portion of the table is the postulated matrix M of population means mij. The last
column of the table contains the sample size of each group. The symmetric matrices SRi specify two dif-
ferent covariance structures between measurements taken at different times: The main diagonal contains
the SDs of the measurements at each time, and the off-diagonal elements contain the correlations between
pairs of measurements taken at different times.
G*Power 3 183

within effect. From the three column means mj of matrix that the vector of population means is identical to a speci-
M and the grand mean m , we get fied constant mean vector. The Effect size drawer can
be used to calculate the effect size D from the difference
2 = m2c and the expected variancecovariance matrix under
(10 12.889)2 + (13 12.889)2 + (15.667 12.889)2 H1. For example, assume that we have two variables, a
difference vector m2c5 (1.88, 1.88) under H1, vari-
3 ances s125 56.79, s225 29.28, and a covariance of 11.98
= 5.35679. (Rencher, 1998, p.106). To perform a posthoc power
Clicking on the Determine button next to the Effect analysis, choose F tests, then Multivariate: Hotelling
size label opens the Effect size drawer. We choose the T 2, one group and set the analysis type to Post hoc.
From variances option and set Variance explained by Enter 2 in the Response variables field and then click
special effect to 5.357 and Variance within groups to on the Determine button next to the Effect size label.
925 81. Clicking on the Calculate and transfer to main In the Effect size drawer, at Input method: Means and
window button calculates an effect size f5 0.2572 and ... , choose Variancecovariance matrix and click on
transfers f to the effect size field in the main window. Specify/edit input values. Under the Means tab, insert
Clicking on Calculate yields the results: The power is 1.88 in both input fields; under the Cov sigma tab, in-
.997, the critical F value with df15 2 and df25 174 is sert 56.79 and 29.28 in the main diagonal and 11.98 as the
3.048, and the noncentrality parameter l is 25.52. The off-diagonal element in the lower left cell. Clicking on the
procedure for tests of betweenwithin interactions ef- Calculate and transfer to main window button initiates
fects (Repeated measures: Withinbetween interac- the calculation of the effect size (0.380) and transfers it to
tions, ANOVA-approach) is almost identical to that just the main window. For this effect size, a5 .05, and a total
described. The only difference is in how the effect size f sample size of N5 100, the power amounts to .9282. The
is computed. Here, we first calculate the variance of the procedure in the two-group case is exactly the same, with
residual values mij2mi2mj1m of matrix M: the following exceptions. First, in the Effect size drawer
two mean vectors have to be specified. Second, the group
2 = sizes may differ.
(10 10 15+12.889)2 + . . . + (12 15.667 11.333+12.889)2 The MANOVA tests in G*Power3 refer to the multi-
9.0 variate general linear model (OBrien & Muller, 1993;
= 1.90123 . OBrien & Shieh, 1999): Y5XB 1 e, where Y is N 3
p of rank p, X is N 3 r of rank r, and the r 3 p matrix
Using the Effect size drawer in the same way as above, B contains fixed coefficients. The rows of e are taken to
we get an effect size f5 0.1532, which results in a power of be independent p-variate normal random vectors with
.653. To test between effects, we choose Repeated measures: mean 0 and p 3 p positive definite covariance matrix S.
Between factors, ANOVA-approach and set all parameters The multivariate general linear hypothesis is H0: CBA5
to the same values as before. Note that in this case we do not Q0, where C is c 3 r with full row rank and A is p 3 a
need to specify eno correction is necessary because tests with full column rank (in G*Power3, Q0 is assumed to be
of between factors do not require the sphericity assumption. zero). H0 has df15a c degrees of freedom. All tests of
To calculate the effect size, we use Effect size from means the hypothesis H0 refer to the matrices
in the Effect size drawer. We select three groups, set SD
s within each group to9, and insert for each group the cor- h=
responding row mean mi of M (15, 12.3333, 11.3333) and 1
(
N ( CBU 0 ) C XT wX ) CT
1
an equal group size of30. Effect size f5 0.1719571 is cal-
T
(CBU 0 )
culated, and the resulting power is .488.
Note that G*Power3 can easily handle pure repeated = Nh*
measures designs without any between-subjects factors and
(see, e.g., Frings & Wentura, 2005; Schwarz & Mller,
E = UT U( N r ),
2006) by choosing the Repeated measures: Within fac-
tors, ANOVA-approach procedure and setting the num- where X is a q 3 q essence model matrix, W is a q 3 q di-
ber of groups to1. agonal matrix containing weights wj5nj /N, and XT X5
N(X T WX) (see OBrien & Shieh, 1999, p.14). Let {f1*,
Tests for Mean Vectors (Multivariate Case) ... , fs } be the s5 min(a,c) eigenvalues of E21H* and
*
G*Power3 contains several procedures for performing {f1, ..., fs} the s eigenvalues of E21H/(N2 r)that is,
power analyses in multivariate designs (see Table4). All fi5 f*i N/(N2 r).
these tests belong to the F test family. G*Power3 offers power analyses for the multivariate
The Hotelling T 2 tests are extensions of univariate model following either the approach outlined in Muller and
t tests to the multivariate case, in which more than one Peterson (1984; Muller, LaVange, Landesman-Ramey, &
dependent variable is measured: Instead of two single Ramey, 1992) or, alternatively, the approach of OBrien and
means, two mean vectors are compared, and instead of a Shieh (1999; Shieh, 2003). Both approaches approximate the
single variance, a variancecovariance matrix is consid- exact distributions of Wilkss U (Rao, 1951), the Hotelling
ered (Rencher, 1998). In the one-sample case, H0 posits Lawley T 1 (Pillai & Samson, 1959), the HotellingLawley
184 Faul, Erdfelder, Lang, and Buchner

Table 4
Tests for Mean Vectors (Multivariate Case)
Test Null Noncentrality Parameter
Test Family Hypothesis Effect Size
_______
Other Parameters and Degrees of Freedom
Hotelling T 2: F tests
m 5 c v T S21 v
D 5 Number of l 5 D2N

difference from v5m 2 c response df1 5 k
constant mean variables k df2 5 N 2 k
vector
_______
Hotelling T 2: F tests
m
1 5 m2 v T S21 v
D 5 Number of n1n2
= 2
difference v5m
1 2 m2
response n1 + n2
between two variables k df1 5 k
mean vectors df2 5 N 2 k 2 1
MANOVA: F tests CM 5 0 Effect size Number of Noncentrality parameter
global effects Means matrix fmult groups g and degrees of freedom
M depends on the test Number of depend on the test statistic
Contrast statistics: response and algorithm used (see
matrix C Wilkss U variables k Effect Size column and
Hotelling Table 5).
Lawley T 1
Hotelling
MANOVA: F tests Number of
Lawley T 2
special effects groups g
Pillais V Number of
and algorithms: predictors p
Muller & Number of
Peterson response
(1984) variables k
OBrien &
MANOVA: F tests CMA 5 0 Shieh Levels of
repeated Means matrix (1999) between factor
measures, M k
between Between Levels of
effects contrast repeated
matrix C measures factor
MANOVA: F tests
Within m
repeated
contrast
measures,
matrix A
within effects
MANOVA: F tests
repeated
measures,
betweenwithin
interactions

T 2 (McKeon, 1974), and Pillais V (Pillai & Mijares, 1959) effects and interactions in factorial MANOVA designs.
by F distributions and are asymptotically equivalent. Table5 These procedures are the direct multivariate analogues
outlines details of both approximations. The type of statistic of the ANOVA routines described above. Table5 sum-
(U, T 1, T 2, V ) and the approach (Muller & Peterson, 1984, marizes information that is needed in addition to the
or OBrien & Shieh, 1999) can be selected in an Options formulas given above to calculate effect size f from hy-
dialog that can be evoked by clicking on the Options but- pothesized values for mean matrix M (corresponding to
ton at the bottom of the main window. matrix B in the model), covariance matrix S, and contrast
The approach of Muller and Peterson (1984) has found matrix C, which describes the effect under scrutiny. The
widespread use; for instance, it has been adopted in the Effect size drawer can be used to calculate f from known
SPSS software package. We nevertheless recommend the values of the statistic U, T 1, T 2, or V. Note, however, that
approach of OBrien and Shieh (1999) because it has a the transformation of T 2 to f depends on the sample size.
number of advantages: (1)Unlike the method of Muller Thus, this test statistic seems not very well suited for
and Peterson, it provides the exact noncentral F distri- apriori analyses. In line with Bredenkamp and Erdfelder
bution whenever the hypothesis involves at most s51 (1985), we recommend V as the multivariate test statistic.
positive eigenvalues; (2)its approximations for s.1 Another group of procedures in G*Power3 supports
eigenvalues are almost always more accurate than those the multivariate approach to power analyses of repeated
of Muller and Petersons method (which systematically measures designs. G*Power provides separate but very
underestimates power); and (3)it provides a simpler form similar routines for the analysis of between effects, within
of the noncentrality parameterthat is, l5 l* N, where effects, and interactions in simple A 3 B designs, where
l* is not a function of the total sample size. A is a between-subjects factor and B a within-subjects
G*Power3 provides procedures to calculate the power factor. To illustrate the general procedure, we describe
for global effects in a one-way MANOVA and for special in some detail a post hoc analysis of the within effect for
G*Power 3 185

Table 5
Approximating Univariate Statistics for Multivariate Hypotheses
Effect Size and
Statistic Formula Numerator df2 Noncentrality Parameter
s 1/ g
Wilkss U df2 5g(N 2 g1) 2 g2
(1 + k ) f (U )2 = 1 U
1
U =
MP k =1 g1 = r + a c + 1 U 1/ g
2 l 5 f (U)2df2
g2 = ca 2
(1 + k* )
s 1
Wilkss U 1/ g
OS
U = 2 f (U )2 = 1 U
1/ g
k =1 1 ca 3 U
l 5 Ng f (U)2
g = ( ca )2 4
2 ca 4
c + a2 5
s V
Pillais V df2 5 s(N 2 r 2 a 1 s)
MP
V = k / (1 + k ) f (V )2 =
(s V )
k =1
l 5 f (V )2 df2

k* / (1 + k* )
s V
Pillais V f (V )2 =
V = (s V )
OS k =1
l 5 Ns f (V)2
s
Hotelling df2 5 s(N 2 r 2 a 2 1) 1 2 f (T )2 5 T/s
Lawley T 1
T = k l 5 f (T )2 df2
k =1
MP
s
Hotelling f (T )2 5 T/s
Lawley T 1
T = k* l 5 Ns f (T)2
k =1
OS

s
Hotelling df2 5 4 1 (ca 1 2)g f (T )2 5 T/h
Lawley T 2
T = k 2 l 5 f (T )2 df2
k =1 ( N r ) ( N r ) g4 + g3
MP g=
( N r ) g2 g1
s
Hotelling f (T )2 5 T/h
Lawley T 2
T = k* g1 5 c 1 2a 1 a2 2 1
l 5 Nh f (T )2
k =1 g2 5 c 1 a 1 1
OS g3 5 a(a 1 3)
g4 5 2a 1 3
df2 2
h=
N r a 1
NoteMP, MullerPeterson algorithm; OS, OBrien and Shieh algorithm. f and f* are eigenvalues of
the effect size matrix (for details and the meaning of the variables a, c, r, and N, see text on p.183).

the scenario illustrated in Figure4, assuming the variance window, we get a value of 0.1791 for Pillais V and the
and correlations structure defined in matrix SR2. We first effect size f(V )5 0.4672. Clicking on Calculate shows
choose F tests, then Repeated measures: Within factors, that the power is .980. The analyses of between effects and
MANOVA-approach. In the Type of power analysis interaction effects are performed analogously.
menu, we choose Post hoc. We click on the Options
button to open a dialog in which we deselect the Use mean Tests for Proportions
correlation in effect size calculation option. We choose The support for tests on proportions has been greatly
Pillais V statistic and the OBrien and Shieh algorithm. enhanced in G*Power3. Table6 summarizes the tests that
Back at the main window, we set both number of groups are currently implemented. In particular, all tests on pro-
and repetitions to 3, total sample size to 90, and a error portions considered by Cohen (1988) are now available,
probability to .05. To compute the effect size f(V ) for the including the sign test (chap.5), the ztests for the differ-
Pillai statistic, we open the Effect size drawer by clicking ence between two proportions (chap.6), andthe c2 tests
on the Determine button next to the Effect size label. for goodness-of-fit and contingency tables (chap.7).
In the Effect size drawer, select, as procedure, Effect The sign test is implemented as a special case (c5.5) of
size from mean and variancecovariance matrix and, as the more general binomial test (also available in G*Power3)
input method, SD and correlation matrix. Clicking on that a single proportion has a specified valuec. In both
Specify/edit matrices opens another window, in which we procedures, Cohens (1988) effect sizeg is used and exact
specify the hypothesized parameters. Under the Means power values based on the binomial distribution are cal-
tab, we insert our means matrix M; under the Cov sigma culated. Note, however, that, due to the discrete nature of
tab, we choose SD and correlation and insert the values the binomial distribution, the nominal value of a usually
of SR2. Because this matrix is always symmetric, it suf- cannot be realized. Since the tables in chapter 5 of Cohens
fices to specify the lower diagonal values. After closing book use the a value closest to the nominal value, even if it
the dialog and clicking on Calculate and transfer to main is higher than the nominal value, the tabulated power values
186 Faul, Erdfelder, Lang, and Buchner

Table 6
Tests for Proportions
Test Noncentrality
Test Family Hypothesis Effect Size Other Parameters Parameter
Contingency 2 tests p1i 5 p0i l 5 w2N
tables and i 5 1, . . . , k
k (1i 0i )2
w= 0i
goodness of fit k
i =1
0i =1
i =1

Difference from exact p5c g5p2c constant proportion c


constant (one- tests
sample case)
Inequality of two exact p12/p21 5 1 odds ratio 5 p12/p21 proportion of discordant
dependent tests pairs 5 p12 1 p21
proportions
(McNemar)
Sign test exact p 5 1/2 g 5 p 2 1/2
tests
Inequality of two z tests p1 5 p2 (A) alternate proportion: p2 (A) null proportion: p1
independent (B) h 5 f1 2 f2 __
proportions (A) fi 5 2 arcsin
p i
Inequality of two exact p1 5 p2 alternate proportion: p1 null proportion: p2
independent tests
proportions
(Fishers exact
test)
Inequality of exact p1 5 p2 (A) alternate proportion: p1 null proportion: p2
two independent tests (B) difference: p2 2 p1
proportions (C) risk ratio: p2/p1
(unconditional) / (1 1 )
(D) odds ratio: 1
2 / (1 2 )
Inequality with exact p1 5 p2 1 c (A) alternate proportion: p1|H1 (A) proportion: p1|H0
offset of two tests (B) difference: p2 2 p1|H1 (B) difference: p2 2 p1|H0
independent (C) risk ratio: p2/p1|H1 (C) risk ratio: p2/p1|H0
proportions
(unconditional) (D) odds ratio: 1
(
1|H / 1 1|H
1
) (D) odds ratio: 0
(
1|H / 1 1|H
0
)
2 / (1 2 ) 2 / (1 2 )
(A) null proportion: p2
Note(A)(D) indicate alternative effect size measures.

are sometimes larger than those calculated by G*Power3. unconditional power. However, despite the highly opti-
G*Power3 always requires the actual a not to be larger than mized algorithm used in G*Power3, long computation
the nominal value. times may result for large sample sizes (e.g., N. 1,000).
Numerous procedures have been proposed to test the Therefore, a limiting N can be specified in the Options
null hypothesis that two independent proportions are iden- dialog that determines at which sample size G*Power3
tical (Cohen, 1988; DAgostino, Chase, & Belanger, 1988; switches to a large sample approximation.
Suissa & Shuster, 1985; Upton, 1982), and G*Power3 A third variant calculates the exact unconditional power
implements several of them. The simplest procedure is a z for approximate test statistics T (Table7 summarizes the
test with optional arcsin transformation and optional conti- supported statistics). The logic underlying this procedure
nuity correction. Besides these two computational options, is to enumerate all possible outcomes for the 2 3 2 bi-
one can also choose whether Cohens effect size measureh nomial table, given fixed sample sizes n1, n2 in the two
or, alternatively, two proportions are used to specify the respective groups. This is done by choosing, as success
alternate hypothesis. With the options Use continuity cor- frequencies x1 and x2 in the first and the second groups,
rection off and Use arcsin transform on, the procedure respectively, any combination of the values 0, x1# n1
calculates power values close to those tabulated by Cohen and 0, x2# n2. Given the success probabilities p1, p2 in
(1988, chap.6). With both Use continuity correction and the two respective groups, the probability of observing a
Use arcsin transform off, the uncorrected c2approxima- table X with success frequencies x1, x2 is
tion is computed (Fleiss, 1981); with Use continuity cor-
rection on and Use arcsin transform off, the corrected P ( X | 1, 2 ) =
c2approximation is computed (Fleiss, 1981). n1 x1 n1 x1 n2 x2
x 1 (1 1 ) x 2 (1 2 )
n2 x2
A second variant is Fishers exact conditional test (Hase- .
man, 1978). Normally, G*Power3 calculates the exact 1 2
G*Power 3 187

Table 7
Test Statistics Used in Tests of the Difference Between Two Independent Proportions
No. Name Statistic
1 ztest pooled variance 1 2 n + n2 2
z= ; = (1 ) 1 + 1 ; = 1 1
n1 n2 n1 + n2
2 ztest pooled variance
with continuity 1 2 + k 1 + 1
2 n1 n2 1 lower tail
correction z= ; ( see No. 1); k =
+1 upper tail
3 ztest unpooled variance 1 2 1 (1 1 ) 2 (1 2 )
z= ; = +
n1 n2
4 ztest unpooled variance
with continuity 1 2 + k 1 + 1
2 n1 n2 1 lower tail
correction z= ; ( see No. 3); k =
+1 upper tail
5 MantelHaenszel test x1 E ( x1 ) n1 ( x1 + x2 ) n n ( x + x ) ( N x1 x2 )
z= ; E ( x1 ) = ; V ( x1 ) = 1 2 1 2 2
V ( x1 ) N N ( N 1)
6 Likelihood ratio t ( x ) + t ( x2 ) + t (1 x1 ) + t (1 x2 ) + t ( N ) . . .
(Upton, 1982) lr = 2 1 ; t ( x ) := x ln( x )
t ( n1 ) t ( n2 ) t ( x1 + x2 ) t ( N x1 x2 )
...

7 t test with df 5 N22 N 2


tN 2 = x1 (1 x2 ) x2 (1 x1 )
(DAgostino et al., 1988) N n2 x1 (1 x1 ) + n1x2 (1 x2 )
Notexi, success frequency in group i; ni, sample size in group i; N 5 n1 1 n2, total sample size; p i 5 xi /ni. The
ztests in the table are more commonly known as 2 tests (the equivalent z test is used to provide two-sided tests).

To calculate power and the actual TypeI error a*, the two proportions. The specific choice has no influence on
test statistic T is computed for each table and compared the results. In the case of tests with offset, however, each
with the critical value Ta. If A denotes the set of all ta- input method has a different set of available test statistics.
bles X rejected by this criterionthat is, those with T. The preferred input method (see Table6) and the test sta-
Tathen the power and the a level are given by tistic to use (see Table8) can be changed in the Options
dialog. As in the other exact procedures, the computation
1 = X A
P ( X | 1, 2 ) may be time-consuming, and a limiting N can be specified
and in the Options dialog that determines at which sample size
* = X A
P ( X | 2 , 2 ), G*Power switches to large sample approximations.
Also new in G*Power3 is an exact procedure to calcu-
where p2 denotes the success probability in both groups late the power for the McNemar test. The null hypothesis of
as assumed in the null hypothesis. Note that the actual a this test states that the proportions of successes are identi-
level can be larger than the nominal level! The preferred cal in two dependent samples. Figure5 shows the structure
input method (proportions, difference, risk ratio, or odds of the underlying design: A binary response is sampled
ratio; see Table6) and the test statistic to use (see Table7) from the same subject or a matched pair in a standard con-
can be changed in the Options dialog. Note that the test dition and in a treatment condition. The null hypothesis,
statistic actually used to analyze the data must be chosen. ps5 pt, is formally equivalent to the hypothesis for the
For large sample sizes, the exact computation may take odd ratio: OR5 p12/p2151. To fully specify H1, we need
too much time. Therefore, a limiting N can be specified in to specify not only the odds ratio but also the proportion
the Options dialog that determines at which sample size of discordant pairs (pD)that is, the expected proportion
G*Power switches to large sample approximations. of responses that differ in the standard and the treatment
G*Power3 also provides a group of procedures to test conditions. The exact procedure used in G*Power3 calcu-
the hypothesis that the difference, risk ratio, or odds ratio lates the unconditional power for the exact conditional test,
of a proportion with respect to a specified reference pro- which calculates the power conditional on the number of
portion p is different under H1 from a difference, risk ratio, discordant pairs (nD). Let p(nD5i) be the probability that
or odds ratio of the same reference proportion assumed the number of discordant pairs is i. Then, the unconditional
in H0. These procedures are available in the Exact test power is the sum over all i {0, ..., N} of the conditional
family as Proportions: Inequality (offset), two indepen- power for nD5 i weighted with p(nD5 i). This procedure
dent groups (unconditional). The enumeration proce- is very efficient, but for very large sample sizes the exact
dure described above for the tests on differences between computation may take too much time. Again, a limiting N
proportions without offset is also used in this case. In the that determines at which sample size G*Power switches to
tests without offset, the different input parameters (e.g., a large sample approximation can be specified in the Op-
differences, risk ratio) are equivalent ways of specifying tions dialog. The large sample approximation calculates
188 Faul, Erdfelder, Lang, and Buchner

Table 8
Test Statistics Used in Tests of the Difference With Offset Between Two Independent Proportions
No. Name Statistic
1 z test pooled variance 1 2 n + n2 2
z= ; = (1 ) (1 / n1 + 1 / n2 ) ; = 1 1
n1 + n2
2 z test pooled variance with 1 2 + k / 2 (1 / n1 + 1 / n2 ) 1 lower tail
continuity correction z= ; ( see No. 1); k =
+1 upper tail
3 z test unpooled variance 2
z= 1 ; = 1 (1 1 ) / n1 + 2 (1 2 ) / n2

4 z test unpooled variance with 2 + k / 2 (1 / n1 + 1 / n2 ) 1 lower tail
continuity correction z= 1 ; ( see No. 3); k =
+1 upper tail
5 t test with df5 N22 tN 2 = ( x1 + n1 ) (1 x2 ) x2 (1 x1 n1 ) K ;
(DAgostino et al., 1988)
K = {
( N 2 ) / N n2 x1 (1 x1 ) + n1x2 (1 x2 ) }
6 Likelihood score ratio (difference) 2
Miettinen & Nurminen (1985) z= 1 ; = ~1 (1 ~1 ) / n1 + ~2 (1 ~2 ) / n2 K

Farrington & Manning (1990) Miettinen & Nurminen: K5 N/(N21); Farrington & Manning: K 5 1
Gart & Nam (1990) p~ 1 5 2u cos(w) 2 b/(3a); p~ 2 5 p~ 1 2 d
q 5 n2/n1; a 5 1 1 q; b 5 2[1 1 q 1 p 1 1 q p 2 1 d(q 1 2)]
c 5 d2 1 d(2 p 1 1 q 1 1) 1 p 1 1 q p 2; d 5 2 p 1d(1 1 d)
v 5 b3/(3a)3 ______________
2 bc/(6a2) 1 d/(2a); w 5 [3.14159 1 cos21(v/u3)]/3
u 5 sgn(v) b 2/(3a)2 2 c/(3a)

Skewness corrected z (Gart & Nam, 1990); z according to Farrington & Manning:
_____________
z 5 [ 1 1 4j(j 1 z)2 1]/2j; V 5 [ p~ 1(1 2 p~ 1)/n1 1 p~ 2(1 2 p~ 2)/n2]21
j 5 V 2/3/6[ p~ 1(1 2 p~ 1)(1 2 2 p~ 1)/n1 1 p~ 2(1 2 p~ 2)(1 2 2 p~ 2)/n2]
7 Likelihood score ratio (risk ratio) 1 2
Miettinen & Nurminen (1985) z= ; = ~1 (1 ~1 ) / n1 + 2~2 (1 ~2 ) / n2 K

Farrington & Manning (1990) Miettinen & Nurminen: K5 N/(N21); Farrington & Manning: K 5 1
Gart & Nam (1988) b b 2 4 N ( x + x )
~1 = ~2 ; ~2 = 1 2
; b = ( n1 + x2 ) x1 n2
2 N
Skewness corrected
_____________ z (Gart & Nam, 1988); z according to Farrington & Manning:
z 5 [ 1 1 4j(j 1 z)2 1]/2j; V 5 (1 2 p~ 1)/( p~ 1n1) 1 (1 2 p~ 2)/( p~ 2n2)

j 5 1/(6V 2/3)[(1 2 p~ 1)(1 2 2 p~ 1)/(n1 p~ 1)2 1 (1 2 p~ 2)(1 2 2 p~ 2)/(n2 p~ 2)2]
8 Likelihood score ratio (odds ratio)
Miettinen & Nurminen (1985)
(1 ~1 ) / ~1 (1 ~1 ) ( 2 ~2 ) / ~2 (1 ~2 )
z=
1 / n1~1 (1 ~1 ) + 1 / n2~2 (1 ~2 ) K
Miettinen & Nurminen: K5 N/(N21); Farrington & Manning: K 5 1
______________
p~ 1 5 p~ 2w/[1 1 p~ 2(w 2 1)]; p~ 2 5 [2b 1 b 2 1 4a(x1 1
x2)]/(2a)
a 5 n2(w 2 1); b 5 n1w 1 n2 2 (x1 1 x2)(w 2 1)
Notexi, success frequency in group i; ni, sample size in group i; N 5 n1 1 n2, total sample size; p i 5 xi /ni ; , difference between
proportions postulated in H0; f, risk ratio postulated in H0; w, odds ratio postulated in H0.

the power on the basis of an ordinary one-sample binomial the null hypothesis that the population variance s2 has a
test with Bin(NpD, 0.5) as the distribution under H0 and specified value c is tested. The variance ratio s2/c is used
Bin[NpD, OR/(11 OR)] as the H1 distribution. as the effect size. The central and noncentral distributions,
corresponding to H0 and H1, respectively, are central c2
Tests for Variances distributions with N21 dfs (because H0 and H1 are based
Table9 summarizes important properties of the two on the same mean). To compare the variance distributions
procedures for testing hypotheses on variances that are under both hypotheses, the H1 distribution is scaled with
currently supported by G*Power3. In the one-group case, the value r postulated for the ratio s2/c in the alternate

Standard
Treatment Yes No
Proportion of discordant pairs: pD 5 p12 1 p21
Yes p11 p12 pt
Hypothesis: ps 5 pt or, equivalently, p12 5 p21
No p21 p22 1 2 pt
ps 1 2 ps 1

Figure5. Matched binary response design (McNemar test).


G*Power 3 189

Table 9
Tests for Variances
Test Null Other
Test Family Hypothesis Effect Size Parameters Noncentrality Parameter
Difference from 2 tests 2
=1 Variance ratio l50
2
(H1: central 2 distribution,
r=
constant (one c
sample case) c scaled with r)
df 5 N 2 1
Inequality of two F tests 22 Variance ratio l50
variances =1 2 (H1: central F distribution,
12 r = 22 scaled with r)
1 df1 5 n1 2 1
df2 5 n2 2 1

2
hypothesisthat is, the noncentral distribution is rcN21 DCDFLIB (available from www.netlib.org/random/),
(Ostle & Malone, 1988). In the two-groups case, H0 states which was slightly modified for our purposes. G*Power3
that the variances in two populations are identical (s2/ does not provide the approximate power analyses that
s151). As in the one-sample case, two central F distri- were available in the speed mode of G*Power2. Two ar-
butions are compared, the H1 distribution being scaled by guments guided us in supporting exact power calculations
the value of the variance ratio s2/s1 postulated in H1. only. First, four-digit precision of power calculations may
be mandatory in many applications. For example, both
Generic Tests compromise power analyses for very large samples, and
Besides the specific routines described in Tables29 error probability adjustments in case of multiple tests of
that cover a considerable part of the tests commonly used, significance may result in very small values of a or b
G*Power3 provides generic power analysis routines (Westermann & Hager, 1986). Second, as a consequence
that may be used for any test based on the t, F, c2, z, or of improved computer technology, exact calculations have
binomial distribution. In generic routines, the parameters become so fast that the speed gain associated with ap-
of the central and noncentral distributions are specified proximate power calculations is not even noticeable. Thus,
directly. from a computational standpoint, there is little advantage
To demonstrate the uses and limitations of these generic to using approximate rather than exact methods (cf. Brad-
routines, we will show how to do a two-tailed power analy- ley, Russell, & Reeve, 1998).
sis for the one-sample t test using the generic routine. The
results can be compared with those of the specific rou- Program Availability
tine available in G*Power for that test. First, we select the and Internet Support
ttests family and then Generic t test (the generic test
option is always located at the end of the list of tests). Next, To summarize, G*Power3 is a major extension of, and
we select Post hoc as the type of power analysis. We improvement over, G*Power2 in that it offers easy-to-
choose a two-tailed test and .05 as a error probability. We apply power analyses for a much larger variety of common
now need to specify the noncentrality parameter d and the statistical tests. Program handling is more flexible, easier
degrees of freedom for our test. We look up the definitions __ to understand, and more intuitive than in G*Power2,
for the one-sample test in Table3 and find that d5dN reducing the risk of erroneous applications. The added
and df5 N21. Assuming a medium effect of d5 0.5 graphical features should be useful for both research and
and N5 25, we arrive at d5 0.5 55 2.5 and df5 24. teaching purposes. Thus, G*Power3 is likely to become
After inserting these values and clicking on Calculate, a useful tool for empirical researchers and students of ap-
we obtain a power of 12b5 .6697. The critical value plied statistics.
t5 2.0639 corresponds to the specified a. In this posthoc Like its predecessor, G*Power3 is a noncommercial
power analysis, the generic routine is almost as simple as program that can be downloaded free of charge. Copies of
the specific routine. The main disadvantage of the generic the Mac and Windows versions are available only at www
routines is, however, that the dependence of the noncen- .psycho.uni-duesseldorf.de/abteilungen/aap/gpower3.
trality parameter on the sample size is implicit. As a con- Users interested in distributing the program in another
sequence, we cannot perform apriori analyses automati- way must ask for permission from the authors. Commer-
cally. Rather, we need to iterate N by hand until we find an cial distribution is strictly forbidden.
appropriate power value. The G*Power3 Web page offers an expanding Web-
based tutorial describing how to use the program, along
Statistical Methods and with examples. Users who let us know their e-mail ad-
Numerical Algorithms dresses will be informed of updates. Although considerable
effort has been put into program development and evalu-
The subroutines used to compute the distribution func- ation, there is no warranty whatsoever. Users are asked to
tions (and the inverse) of the noncentral t, F, c2, z, and kindly report possible bugs and difficulties in program
binomial distributions are based on the Cversion of the handling to gpower-feedback@uni-duesseldorf.de.
190 Faul, Erdfelder, Lang, and Buchner

Author Note Farrington, C.P., & Manning, G. (1990). Test statistics and sample
size formulae for comparative binomial trials with null hypothesis of
Manuscript preparation was supported by Grant SFB 504 (Project non-zero risk difference or non-unity relative risk. Statistics in Medi-
A12) from the Deutsche Forschungsgemeinschaft and a grant from the cine, 9, 1447-1454.
state of Baden-Wrttemberg, Germany (Landesforschungsprogramm Field, A.P. (2005). Discovering statistics with SPSS (2nd ed.). London:
Evidenzbasierte Stressprvention). Correspondence concerning this Sage.
article should be addressed to F.Faul, Institut fr Psychologie, Christian- Fleiss, J.L. (1981). Statistical methods for rates and proportions (2nd
Albrechts-Universitt, Olshausenstr. 40, D-24098 Kiel, Germany, or ed.). New York: Wiley.
to E.Erdfelder, Lehrstuhl fr Psychologie III, Universitt Mannheim, Frings, C., & Wentura, D. (2005). Negative priming with masked
Schloss Ehrenhof Ost 255, D-68131 Mannheim, Germany (email: ffaul@ distractor-only prime trials: Awareness moderates negative priming.
psychologie.uni-kiel.de or erdfelder@psychologie.uni-mannheim.de). Experimental Psychology, 52, 131-139.
Gart, J.J., & Nam, J. (1988). Approximate interval estimation of the
References ratio in binomial parameters: A review and correction for skewness.
Biometrics, 44, 323-338.
Akkad, D.A., Jagiello, P., Szyld, P., Goedde, R., Wieczorek,S., Gart, J.J., & Nam,J. (1990). Approximate interval estimation of the
Gross, W.L., & Epplen, J.T. (2006). Promoter polymorphism difference in binomial parameters: Correction for skewness and ex-
rs3087456 in the MHC class II transactivator gene is not associated tension to multiple tables. Biometrics, 46, 637-643.
with susceptibility for selected autoimmune diseases in German pa- Geisser,S., & Greenhouse, S.W. (1958). An extension of Boxs re-
tient groups. International Journal of Immunogenetics, 33, 59-61. sults on the use of the F distribution in multivariate analysis. Annals
Back, M.D., Schmukle, S.C., & Egloff,B. (2005). Measuring task- of Mathematical Statistics, 29, 885-891.
switching ability in the Implicit Association Test. Experimental Psy- Gerard, P.D., Smith, D.R., & Weerakkody, G. (1998). Limits of
chology, 52, 167-179. retrospective power analysis. Journal of Wildlife Management, 62,
Baeza, J.A., & Stotz, W. (2003). Host-use and selection of differ- 801-807.
ently colored sea anemones by the symbiotic crab Allopetrolisthes Gigerenzer, G., Krauss, S., & Vitouch, O. (2004). The null ritual:
spinifrons. Journal of Experimental Marine Biology & Ecology, 284, What you always wanted to know about significance testing but were
25-39. afraid to ask. In D.Kaplan (Ed.), The SAGE handbook of quantitative
Barabesi, L., & Greco, L. (2002). A note on the exact computation methodology for the social sciences (pp.391-408). Thousand Oaks,
of the Student t, Snedecor F, and sample correlation coefficient dis- CA: Sage.
tribution functions. Journal of the Royal Statistical Society, 51D, Gleissner, U., Clusmann, H., Sassen, R., Elger, C.E., & Helm-
105-110. staedter, C. (2006). Postsurgical outcome in pediatric patients with
Berti,S., Mnzer,S., Schrger,E., & Pechmann,T. (2006). Differ- epilepsy: A comparison of patients with intellectual disabilities, sub-
ent interference effects in musicians and a control group. Experimen- average intelligence, and average-range intelligence. Epilepsia, 47,
tal Psychology, 53, 111-116. 406-414.
Bradley, D.R., Russell, R.L., & Reeve, C.P. (1998). The accuracy Goldstein, R. (1989). Power and sample size via MS/PC-DOS comput-
of four approximations to noncentral F. Behavior Research Methods, ers. American Statistician, 43, 253-262.
Instruments, & Computers, 30, 478-500. Hager, W. (2006). Die Fallibilitt empirischer Daten und die Notwen-
Bredenkamp, J. (1969). ber die Anwendung von Signifikanztests bei digkeit der Kontrolle von falschen Entscheidungen [The fallibility
Theorie-testenden Experimenten [The application of significance tests of empirical data and the need for controlling for false decisions].
in theory-testing experiments]. Psychologische Beitrge, 11, 275-285. Zeitschrift fr Psychologie, 214, 10-23.
Bredenkamp,J., & Erdfelder,E. (1985). Multivariate Varianzanalyse Haseman, J.K. (1978). Exact sample sizes for use with the FisherIrwin
nach dem V-Kriterium [Multivariate analysis of variance based on the test for 2 3 2 tables. Biometrics, 34, 106-109.
V-criterion]. Psychologische Beitrge, 27, 127-154. Hoenig, J.N., & Heisey, D.M. (2001). The abuse of power: The perva-
Buchner,A., Erdfelder,E., & Faul,F. (1996). Teststrkeanalysen sive fallacy of power calculations for data analysis. American Statisti-
[Power analyses]. In E.Erdfelder, R.Mausfeld, T.Meiser, & cian, 55, 19-24.
G.Rudinger (Eds.), Handbuch Quantitative Methoden [Handbook of Hoffmann, J., & Sebald, A. (2005). Local contextual cuing in visual
quantitative methods] (pp.123-136). Weinheim, Germany: Psycholo- search. Experimental Psychology, 52, 31-38.
gie Verlags Union. Huynh, H., & Feldt, L.S. (1970). Conditions under which mean square
Buchner,A., Erdfelder,E., & Faul,F. (1997). How to use G*Power ratios in repeated measurements designs have exact F-distribution.
[Computer manual]. Available at www.psycho.uni-duesseldorf.de/ Journal of the American Statistical Association, 65, 1582-1589.
aap/projects/gpower/how_to_use_gpower.html. Keppel, G., & Wickens, T.D. (2004). Design and analysis. A research-
Busbey, A.B.I. (1999). Macintosh shareware/freeware earthscience ers handbook (4th ed.). Upper Saddle River, NJ: Pearson Education
software. Computers & Geosciences, 25, 335-340. International.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences Kornbrot, D.E. (1997). Review of statistical shareware G*Power. Brit-
(2nd ed.). Hillsdale, NJ: Erlbaum. ish Journal of Mathematical & Statistical Psychology, 50, 369-370.
DAgostino, R.B., Chase,W., & Belanger,A. (1988). The appropri- Kromrey,J., & Hogarty, K.Y. (2000). Problems with probabilistic
ateness of some common procedures for testing the equality of two in- hindsight: A comparison of methods for retrospective statistical power
dependent binomial populations. American Statistician, 42, 198-202. analysis. Multiple Linear Regression Viewpoints, 26, 7-14.
Erdfelder, E. (1984). Zur Bedeutung und Kontrolle des b-Fehlers bei Lenth, R.V. (2001). Some practical guidelines for effective sample size
der inferenzstatistischen Prfung log-linearer Modelle [Significance determination. American Statistician, 55, 187-193.
and control of the b error in statistical tests of log-linear models]. Levin, J.R. (1997). Overcoming feelings of powerlessness in aging
Zeitschrift fr Sozialpsychologie, 15, 18-32. researches: A primer on statistical power in analysis of variance de-
Erdfelder,E., Buchner,A., Faul,F., & Brandt,M. (2004). GPOWER: signs. Psychology & Aging, 12, 84-106.
Teststrkeanalysen leicht gemacht [Power analyses made easy]. In McKeon, J.J. (1974). F approximations to the distribution of Hotel-
E.Erdfelder & J.Funke (Eds.), Allgemeine Psychologie und deduktivis lings T 02. Biometrika, 61, 381-383.
tische Methodologie [Experimental psychology and deductive method- Mellina, E., Hinch, S.G., Donaldson, E.M., & Pearson, G. (2005).
ology] (pp.148-166). Gttingen: Vandenhoeck & Ruprecht. Stream habitat and rainbow trout (Oncorhynchus mykiss) physiologi-
Erdfelder,E., Faul,F., & Buchner,A. (1996). GPOWER: A general cal stress responses to streamside clear-cut logging in British Colum-
power analysis program. Behavior Research Methods, Instruments, & bia. Canadian Journal of Forest Research, 35, 541-556.
Computers, 28, 1-11. Miettinen,O., & Nurminen,M. (1985). Comparative analysis of two
Erdfelder, E., Faul, F., & Buchner, A. (2005). Power analysis for rates. Statistics in Medicine, 4, 213-226.
categorical methods. In B.S. Everitt & D.C. Howell (Eds.), Encyclo- Mller,J., Manz,R., & Hoyer,J. (2002). Was tun, wenn die Test-
pedia of statistics in behavioral science (pp.1565-1570). Chichester, strke zu gering ist? Eine praktikable Strategie fr PrPost-Designs
U.K.: Wiley. [What to do if statistical power is low? A practical strategy for pre
G*Power 3 191

post-designs]. Psychotherapie, Psychosomatik, Medizinische Psy- Shieh, G. (2003). A comparative study of power and sample size cal-
chologie, 52, 408-416. culations for multivariate general linear models. Multivariate Behav-
Muller, K.E., & Barton, C.N. (1989). Approximate power for repeated- ioral Research, 38, 285-307.
measures ANOVA lacking sphericity. Journal of the American Statistical Smith, R.E., & Bayen, U.J. (2005). The effects of working memory
Association, 84, 549-555. resource availability on prospective memory: A formal modeling ap-
Muller, K.E., LaVange, L.M., Landesman-Ramey,S., & Ramey, proach. Experimental Psychology, 52, 243-256.
C.T. (1992). Power calculations for general linear multivariate models Steidl, R.J., Hayes, J.P., & Schauber,E. (1997). Statistical power
including repeated measures applications. Journal of the American analysis in wildlife research. Journal of Wildlife Management, 61,
Statistical Association, 87, 1209-1226. 270-279.
Muller, K.E., & Peterson, B.L. (1984). Practical methods for com- Suissa, S., & Shuster, J.J. (1985). Exact unconditional sample sizes
puting power in testing the multivariate general linear hypothesis. for 2 3 2 binomial trial. Journal of the Royal Statistical Society A,
Computational Statistics & Data Analysis, 2, 143-158. 148, 317-327.
Myers, J.L., & Well, A.D. (2003). Research design and statistical Thomas,L., & Krebs, C.J. (1997). A review of statistical power analysis
analysis (2nd ed.). Mahwah, NJ: Erlbaum. software. Bulletin of the Ecological Society of America, 78, 126-139.
OBrien, R.G., & Kaiser, M.K. (1985). MANOVA method for analyz- Upton, G.J.G. (1982). A comparison of alternative tests for the 232
ing repeated measures designs: An extensive primer. Psychological comparative trial. Journal of the Royal Statistical Society A, 145,
Bulletin, 97, 316-333. 86-105.
OBrien, R.G., & Muller, K.E. (1993). Unified power analysis for Westermann,R., & Hager,W. (1986). Error probabilities in educa-
t-tests through multivariate hypotheses. In L.K. Edwards (Ed.), Ap- tional and psychological research. Journal of Educational Statistics,
plied analysis of variance in behavioral science (pp.297-344). New 11, 117-146.
York: Dekker. Zumbo, B.D., & Hubley, A.M. (1998). A note on misconceptions
OBrien, R.G., & Shieh, G. (1999). Pragmatic, unifying algorithm concerning prospective and retrospective power. The Statistician, 47,
gives power probabilities for common F tests of the multivariate gen- 385-388.
eral linear hypothesis. Available at www.bio.ri.ccf.org/UnifyPow.
Ortseifen,C., Bruckner,T., Burke,M., & Kieser,M. (1997). An Notes
overview of software tools for sample size determination. Informatik,
Biometrie & Epidemiologie in Medizin & Biologie, 28, 91-118. 1. The observed power is reported in many frequently used computer
Ostle,B., & Malone, L.C. (1988). Statistics in research: Basic con- programs (e.g., the MANOVA procedure of SPSS).
cepts and techniques for research workers (4th ed.). Ames: Iowa State 2. We recommend checking the degrees of freedom reported by
Press. G*Power by comparing them, for example, with those reported by the
Pillai, K.C.S., & Mijares, T.A. (1959). On the moments of the trace program used to analyze the sample data. If the degrees of freedom do
of a matrix and approximations to its distribution. Annals of Math- not match, the input provided to G*Power is incorrect and the power
ematical Statistics, 30, 1135-1140. calculations do not apply.
Pillai, K.C.S., & Samson,P., Jr. (1959). On Hotellings generaliza- 3. Plots of the central and noncentral distributions are shown only
tion of T 2. Biometrika, 46, 160-168. for tests based on the t, F, z, c2, or binomial distribution. No plots are
Quednow, B.B., Khn, K.-U., Stelzenmueller,R., Hoenig,K., shown for tests that involve an enumeration procedure (e.g., the McNe-
Maier,W., & Wagner,M. (2004). Effects of serotonergic and norad- mar test).
renergic antidepressants on auditory startle response in patients with 4. We thank Dave Kenny for making us aware of the fact that the
major depression. Psychopharmacology, 175, 399-406. ttest (correlation) power analyses of G*Power2 are correct only in the
Rao, C.R. (1951). An asymptotic expansion of the distribution of pointbiserial case (i.e., for correlations between a binary variable and
Wilkss criterion. Bulletin of the International Statistical Institute, a continuous variable, the latter being normally distributed for each
33, 177-180. value of the binary variable). For correlations between two continu-
Rasch,B., Friese,M., Hofmann, W.J., & Naumann,E. (2006a). ous variables following a bivariate normal distribution, the t test (cor-
Quantitative Methoden 1: Einfhrung in die Statistik (2. Auflage) relation) procedure of G*Power2 overestimates power. For this reason,
[Quantitative methods 1: Introduction to statistics (2nd ed.)]. Heidel- G*Power3 offers separate power analyses for pointbiserial correlations
berg, Germany: Springer. (in the t family of distributions) and correlations between two normally
Rasch, B., Friese, M., Hofmann, W.J., & Naumann, E. (2006b). distributed variables (in the exact distribution family). However, power
Quantitative Methoden 2: Einfhrung in die Statistik (2. Auflage) values usually differ only slightly between procedures. To illustrate, as-
[Quantitative methods 2: Introduction to statistics (2nd ed.)]. Heidel- sume we are interested in the power of a two-tailed test of H0: r5 .00 for
berg, Germany: Springer. continuously distributed measures derived from two Implicit Association
Rencher, A.C. (1998). Multivariate statistical inference and applica- Tests (IATs) differing in content. Assume further that, due to method-
tions. New York: Wiley. specific variance in both versions of the IAT, the true Pearson correlation
Richardson, J.T.E. (1996). Measures of effect size. Behavior Research is actually r5 .30 (effect size). Given a5 .05 and N5 57 (see Back,
Methods, Instruments, & Computers, 28, 12-22. Schmukle, & Egloff, 2005, p.173), an exact posthoc power analysis for
Scheff, H. (1959). The analysis of variance. New York: Wiley. Correlations: Differences from constant (one sample case) reveals the
Schwarz, W., & Mller, D. (2006). Spatial associations in number- correct power value of 12b5 .63. Choosing the incorrect Correla-
related tasks: A comparison of manual and pedal responses. Experi- tion: point biserial model procedure from the t test family would result
mental Psychology, 53, 4-15. in 12b5 .65.
Sheppard, C. (1999). How large should my sample be? Some quick
guides to sample size and the power of tests. Marine Pollution Bul- (Manuscript received December 8, 2006;
letin, 38, 439-447. accepted for publication January 23, 2007.)

Você também pode gostar