Analysis of Variance (ANOVA)

The F distribution
Good for two or more groups
The F distribution
F is a ratio of two independent estimates of
the variance of the population
Consequently, it depends on the analysis
(separating into parts) of the variance in a
set of scores.
We have already analyzed the variance in a
set of scores when we did t tests
The analysis of variance
The numerator of the t test is the difference
between two means. Since the variance is
the average of the differences from a mean,
the difference between two means drawn
from the same set of scores is one estimate
of variance.
The denominator of the t test, although
expressed as a standard deviation, is also an
estimate of variance.
The F ratio
A ratio of two estimates of variance drawn
from the same set of scores is called an F
ratio.
F = larger estimate of variance
smaller estimate of variance

F = variance estimate 1 of o
2

variance estimate 2 of o
2

Why use ANOVA?
We sometimes have independent variables
with more than two groups:
Grape Kool-Aid, Lemon Kool-Aid, and water
One marijuana cigarette, two, three, four
TQM in place for one month, two, three
Four styles of government
With more than two groups, multiple t tests
would be necessary.
Multiple t tests inflate the Type I error rate.

Logic of ANOVA
1. Find the total variance in a set of data.
2. Analyze the variance into
a. The part due to the treatment (plus people)
b. The part due to people without treatment
(individual differences and error)
3. Form an F ratio of the two parts
The ANOVA summary table
To keep track of the ANOVA process, start with a
summary table:

Source SS df MS ( s
2
) F p Decision
Between
Within
Total
Notation summary
N is the number of scores altogether.
n is the number of scores in a single group.
k is the number of groups.
g is a particular group.
The variance, s
2
, is also symbolized MS,
which stands for Mean Square.
SS total
To get SS
total
, simply group all of the scores
for all of the groups together and find the
SS as if there were only one group:

SS
total
= EX
2
- (EX)
2
/ N

Or SS
total
= EX
2
(G
2
/ N)

SS within groups
SS within groups is due to individual
differences and error.
To compute SS
within
,calculate SS normally for
each group separately, and add them up.
SS
within
= E(EX
2
- (EX)
2
/ n)
=SS
1
+SS
2
++SS
k

= EX
2
- (EX
1
)
2
(EX
2
)
2
(EX
k
)
2


n
1
n
2
n
k

+ + +
To get SS
between
, treat the sum of each group as
a score, and apply the be-bop version of the
sum of squares song:
SS
B
=


= (EX
1
)
2
(EX
2
)
2
(EX
k
)
2
- (EX)
2
N
( )
( )
X
n
X
N
g
g
k

(
(

2
1
2
SS between groups
n
1
n
2
n
k

+ + +
Completing the one-way
ANOVA
Source SS df MS ( s
2
) F p
Between k-1 SS
B
/df
B
MS
B
/MS
W

Within N-k SS
W
/df
W

Total N-1

To obtain p, either use the table to find the critical
value of F, or SPSS to find the probability of
the obtained value of F.
Making your decision
To decide whether the obtained F ratio is
significant, compare it to the table value
(the critical value). If the obtained F is equal to
or larger than the critical F, reject H
0
.
.05 level
Table value: Length of pier
Computed value:
Length of walk
Fishy zone:
Reject H
0

Decision rules for ANOVA
Find the critical values for F from the table. Use df
B
for the
(between) column, and df
W
for the (within) row in the table.
The first table has the critical value at the .05 level, and the
second table for the .01 level.
In the p column of the ANOVA summary table, enter <.01
if the obtained F ratio is greater than the value in the second
table; <.05 if it is greater than the value in the first table but
less than the value in the second table; and n.s. (for not
significant) if it is less than the value in the first table.
More ANOVA items
For two group studies, t
2
= F
Two-way factorial ANOVA
Main effects: Combines two (or more) studies
Fully crossed factors: A x B
Interaction effect: The effect of one
independent variable depends on the level of
the other independent variable
Try this one
Here are the number of errors on an analysis
of variance problem for each of nine
students after drinking grape Kool-Aid,
Frankenberry Punch, or water.
GKA FBP H2O
5 8 10
3 7 11
4 7 12
Effect size measures
Significant t and F ratios show that there is
a real effect of the treatment, a real
difference between the groups that cannot
be explained by chance.
Effect size measures show how big the
effect of the treatment is.
C.O.D. is one effect size measure:
C.O.D. = r
2
= SS
B
/SS
Total
= q
2
Effect sizes in samples vs.
populations
q
2
is a sample estimate of the proportion of
the variance in the dependent variable that
is accounted for by the independent
variable.
For population estimates of effect size, use
a different statistic, e
2

Computing e
2

For the t test for independent samples,
e
2
= t
2
1
t
2
+ N 1

For the analysis of variance,
e
2
= SS
B
(k 1)MS
W

SS
Total
+ MS
W

Concluding details
ANOVA assumptions are the same as the
assumptions for the t-test for independent
samples.
Try to have each group/sample be the same
size, that is, have equal ns. However, the
ANOVA computations will work with
unequal sample sizes.
Reporting ANOVA in APA format
Report the mean and standard deviation for each sample/group
in a table, and refer to it in a sentence reporting the F ratio:
Table 1 contains the means and standard deviations for the IQs,
which were significantly different, F(3, 36) = 9.47, p < .05.

Table 1. Tested IQ.
Grape Lemon Fberry Water
M 126 128 133 109
SD 15.5 14.8 15 16