Comparing between Groups (Parametric)

For comparison between groups, we use one factor ANOVA. ANOVA, short for "Analysis of Variance", is a statistical approach to determine whether there are significant differences between two or more independent groups. If this is performed for two groups, the results is identical to those in t-test. ANOVA can be used if your research data is interval or ratio, and normally distributed. Example : In a clinical trial, a new drug is tested for effectiveness towards lowering blood pressure level. There are three different compositional mix of a new drug ingredients (X1, X2 and X3). Thirty patients were chosen and ten were randomly allocated for each prescription. The percentages of reduction on blood pressure level were recorded after certain period of time and were as shown below. Is there an effect of drug composition towards the percentage of blood pressure reduction? X1 15 20 14 13 18 16 13 12 18 11 X2 21 25 29 18 26 22 26 24 28 21 X3 28 30 32 28 26 30 25 36 20 25

Analysis: Ho : There is no significant difference on blood pressure reduction due to the different drug composition H1 : There is a significant difference on blood pressure reduction due to the different drug composition

Mean Total Squared Total

X1 15 20 14 13 18 16 13 12 18 11 = 15 T1 = 150 T12 = 22500

X12 225 400 196 169 324 256 169 144 324 121 X12 = 2328

X2 21 25 29 18 26 22 26 24 28 21 = 24 T2 = 240 T22 = 57600

X22 441 625 841 324 676 484 676 576 784 441 X22 = 5868

X3 28 30 32 28 26 30 25 36 20 25 = 28 T3 = 280 T32 = 78400

X32 784 900 1024 784 676 900 625 1296 400 625 X32 = 8014

X = 670 (X)2 = 448900 X2 = 16210

T = total of scores in a group No. of conditions/groups, k = 3 No. of scores per group/condition, n = 10 Total no. of data, N = 30 bg= between group, wg = within group 1

Degrees of freedom: dftotal = N - 1 = 29 dfbg = k - 1 = 2 dfwg = dftotal - dfbg = 29 - 2 = 27 Sum of squares: = = 448900 = 16210 = 1246.67 30

= = 1246.67 886.67 = 360

22500 + 57600 + 78400 448900 = = 886.67 10 30

Mean squares: = =

= 443.33 ; =

= 13.33

Variance Ratio (F):

443.33 = = 33.26 13.33

Degrees of Freedom, df 2 27 29 Sums of Squares, SS 886.67 360.00 1246.67 Mean Square 443.33 13.33 Variance Ratio, F 33.26 Probability

ANOVA Summary
Souce of variation

Between Groups (bg) Within Groups (wg) Total

P < 0.01

For p<0.01, from table, F(2,27) = 3.35. 33.26 > 3.35 (significant) null hypothesis rejected. Different drug composition does have significant effects towards the percentages of blood pressure reduction.

ANOVA Post-Hoc Analysis

Post-Hoc is carried out only if Ho is rejected after performing the F-test (ANOVA). If the F-test fails to reject the null hypothesis post-hoc procedure should not be used. (1) Least Significant Difference (LSD) LSD method calculates difference between pairs of means and the difference calculated is compared to a calculated tstatistic, at certain confidence level. Procedures: 1. Calculate the LSD between two means (say, A and B) using the following formula. Note the t-test considered is two tailed. 1 1 , = /, +

| , , then we reject null hypothesis of Ho: A = B. 2. if | Example: From last example,

X1 = 15 X2 = 24 X3 = 28

ANOVA Summary
Souce of variation Degrees of Freedom, df 2 27 29 Sums of Squares, SS 886.67 360.00 1246.67 Mean Square 443.33 13.33 Variance Ratio, F 33.26 Probability

Between Groups (bg) Within Groups (wg) Total

P < 0.01

As null hypothesis is rejected, we use LSD to find out whether difference between two particular groups are significant. Consider two groups A and B, LSD between the two groups is defined as: 1 1 , = /, +
+

In this example, since n1 = n2 = n3 = 10, at = 0.05, t0.05/2,27 = 2.052. Thus, , = 2.05213.33 Thus, we can perform the following further LSD tests: | = 9 17.41 significant, reject null hypothesis of Ho: 1 = 2. |

| , , then we reject null hypothesis of Ho: A = B. if |

= 3.35

| = 13 17.41 significant, reject null hypothesis of Ho: 1 = 3. | | = 4 17.41 significant, reject null hypothesis of Ho: 2 = 3. | 3

(2) Tukey Test The Tukey HSD (honestly significant difference) test allows us to compare each pair of conditions to see if their difference is significant. To use this test, we need to calculate using the q-statistics. The statistic q is called Studentized range statistic. = Procedures:
. . .

, Thus =

1. Calculate the HSD using formula =

| , then we 2. if the difference between any two means, say from A and B, exceeds HSD value e.g. | reject null hypothesis of Ho: A = B. 3. Normally, for equal number of subjects in each group the n value is easy to be determined. For groups with different subject size, we can take the smallest sample size n. A more sophisticated way to handle this is by using the following formula:

, with k = number of groups/conditions.

Example: From previous example,

X1 = 15 X2 = 24 X3 = 28

ANOVA Summary
Souce of variation Degrees of Freedom, df 2 27 29 Sums of Squares, SS 886.67 360.00 1246.67 Mean Square 443.33 13.33 Variance Ratio, F 33.26 Probability

Between Groups (bg) Within Groups (wg) Total

P < 0.01

As null hypothesis is rejected, we may use Tukey test to find out whether difference between two particular groups are significant. The q-value requires degree of freedom, df and number of conditions, k. For HSD, we use dfwg = 27 and k = 3 (number of groups/conditions) and n=10 (number of scores in each group). For this, q = 3.51 from table. = 13.33 = 3.51 = 4.04 10

Tukey Tests:

| = 9 4.04 significant, reject null hypothesis of Ho: 1 = 2. |

| = 13 4.04 significant, reject null hypothesis of Ho: 1 = 3. |

| = 4 4.04 not significant, accept null hypothesis of Ho: 2 = 3. (However, it is near to rejection value). | 4