Bernoulli Distribution - Bern(0.

5)
1
2

Flip a coin and record the outcome.

Compute the (population) mean and variance
Mean =
Variance =

Throw a coin 100 times, record the results.

Head = 1
Tail = 0

Some useful equations:

Mean

E[ X ] p
Variance

Var ( X ) p(1 p)
Sample Mean

1
n
X i 1 X i
n
Sample Variance

Sn2

1 n
Xi X
n i 1

Unbiased Variance

Sn21

1
n
Xi X
n 1 i 1

Trial
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67

Outcome
0
0
0
0
0
1
1
1
0
0
0
0
1
0
1
0
1
0
0
1
0
1
0
1
0
1
1
0
1
0
1
0
1
1
0
0
1
0
0
1
1
0
1
1
0
1
1
0
1
1
1
1
1
0
1
1
0
0
1
1
0
0
0
1
1
0
0

Sample Mean

Sample Variance

0.3

0.21

Sample Mean

Sample Variance

0.35

0.2275

Sample Mean

Sample Variance

0.4

0.24

Sample Mean

Sample Variance

0.425

0.244375

Sample Mean

Sample Variance

0.48

0.2496

Sample Mean

Sample Variance

0.516666667

0.249722222

Unbiased Sample
Variance
0.233333333

Unbiased Sample
Variance
0.239473684

Unbiased Sample
Variance
0.248275862

Unbiased Sample
Variance
0.250641026

Unbiased Sample
Variance
0.254693878

Unbiased Sample
Variance
0.253954802

The following data comes from another group

68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138

0
0
1
1
1
0
0
1
1
0
0
1
0
1
0
0
0
1
0
1
1
1
1
0
1
1
1
1
1
0
1
0
0
1
1
1
0
1
0
1
0
0
1
0
1
1
0
0
1
0
1
0
0
0
0
1
0
0
1
0
1
1
1
1
0
1
0
0
1
0
1

Sample Mean

Sample Variance

0.485714286

0.249795918

Sample Mean

Sample Variance

0.4875

0.24984375

Sample Mean

Sample Variance

0.5

0.25

Sample Mean

Sample Variance

0.51

0.2499

Sample Mean

Sample Variance

0.518181818

0.249669421

Sample Mean

Sample Variance

0.508333333

0.249930556

Sample Mean

Sample Variance

0.507692308

0.249940828

Sample Mean

Sample Variance

Unbiased Sample
Variance
0.253416149

Unbiased Sample
Variance
0.253006329

Unbiased Sample
Variance
0.252808989

Unbiased Sample
Variance
0.252424242

Unbiased Sample
Variance
0.251959967

Unbiased Sample
Variance
0.252030812

Unbiased Sample
Variance
0.251878354

Unbiased Sample
Variance

139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200

0
1
1
0
0
0
0
0
0
0
1
1
1
1
0
1
1
1
1
1
0
1
0
1
1
0
1
0
0
0
1
0
1
1
0
1
0
1
0
0
1
0
1
0
1
1
0
0
1
0
1
0
1
0
0
1
1
0
1
1
1
1

Sample Mean

Sample Variance

0.507142857

0.24994898

Sample Mean

Sample Variance

0.493333333

0.249955556

Sample Mean

Sample Variance

0.5125

0.24984375

Sample Mean

Sample Variance

0.505882353

0.249965398

Sample Mean

Sample Variance

0.505555556

0.249969136

Sample Mean

Sample Variance

0.505263158

0.249972299

Sample Mean

Sample Variance

0.515

0.249775

Unbiased Sample
Variance
0.251747174

Unbiased Sample
Variance
0.25163311

Unbiased Sample
Variance
0.251415094

Unbiased Sample
Variance
0.251444483

Unbiased Sample
Variance
0.251365611

Unbiased Sample
Variance
0.251294904

Unbiased Sample
Variance
0.251030151

Sample Size
Sample Mean
Sample Var
Unbiased Var

10
0.3
0.21
0.233

20
0.35
0.228
0.239

30
0.4
0.24
0.248

40
0.425
0.244
0.251

50
0.48
0.25
0.255

60
0.517
0.25
0.254

70
0.486
0.25
0.253

80
0.488
0.25
0.253

90
0.5
0.25
0.253

100
0.51
0.25
0.252

0.6

0.5

0.4

0.3

0.2

0.1

10

20

30
Sample Mean

40

50
Sample Var

60

70
Unbiased Var

80

90

100

Binomial Distribution - Bin(5, 0.5)

1
2

Flip 5 fair coins at the same time and count

the total number of head.
Compute the (population) mean and variance
Mean =
Variance =
Repeat 100 times, record the results.
Head = 1
Tail = 0

Some useful equations:

Mean

E[ X ] np
Variance

Var ( X ) np (1 p )
Sample Mean

1
n
X i 1 X i
n
Sample Variance

Sn2

1 n
Xi X
n i 1

Unbiased Variance

Sn21

1
n
Xi X

i 1
n 1

Trial
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67

Outcome
1
4
4
2
4
2
1
1
1
3
3
1
3
4
4
1
3
1
3
2
4
4
2
1
2
3
2
2
0
1
3
2
5
3
3
1
2
3
3
2
2
3
1
3
4
2
2
3
3
2
3
2
4
3
3
3
3
3
1
3
2
2
0
2
2
3
3

Sample Mean

Sample Variance

2.3

1.61

Sample Mean

Sample Variance

2.4

1.44

Sample Mean

Sample Variance

2.3

1.476666667

Sample Mean

Sample Variance

2.4

1.39

Sample Mean

Sample Variance

2.42

1.2436

Sample Mean

Sample Variance

2.483333333

1.149722222

Unbiased Sample
Variance
1.788888889

Unbiased Sample
Variance
1.515789474

Unbiased Sample
Variance
1.527586207

Unbiased Sample
Variance
1.425641026

Unbiased Sample
Variance
1.268979592

Unbiased Sample
Variance
1.16920904

The following data comes from another group

68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138

2
3
4
2
2
2
2
3
3
3
3
3
3
0
0
3
3
3
4
4
2
3
2
2
2
2
1
4
4
4
1
0
2

Unbiased Sample
Variance
1.150310559

Sample Mean

Sample Variance

2.457142857

1.133877551

Sample Mean

Sample Variance

2.475

1.024375

Sample Mean

Sample Variance

2.466666667

1.115555556

Sample Mean

Sample Variance

2.44

1.1864

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Unbiased Sample
Variance
1.037341772

Unbiased Sample
Variance
1.128089888

Unbiased Sample
Variance
1.198383838

139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Size
Sample Mean
Sample Var
Unbiased Var

10
2.3
1.61
1.789

20
2.4
1.44
1.516

30
2.3
1.477
1.528

40
2.4
1.39
1.426

50
2.42
1.244
1.269

60
2.483
1.15
1.169

70
2.457
1.134
1.15

80
2.475
1.024
1.037

90
2.467
1.116
1.128

100
2.44
1.186
1.198

2.5

1.5

0.5

10

20

30
Sample Mean

40

50
Sample Var

60

70
Unbiased Var

80

90

100

1 ~ 100
Count

1
14

2
30

3
35

4
15

5
1

40
35

35
30

30
25
20
15

15

14

10
5
1
0
1

1 ~ 200
Count

1
14

2
30

3
35

4
15

5
1

40
35

35
30

30
25
20
15

15

14

10
5
1
0
1

Binomial Distribution - Bin(10, 0.5)

1
2

Flip 10 fair coins at the same time and count

the total number of head.
Compute the (population) mean and variance
Mean =
Variance =
Repeat 100 times, record the results.
Head = 1
Tail = 0

Some useful equations:

Mean

E[ X ] np
Variance

Var ( X ) np (1 p )
Sample Mean

1
n
X i 1 X i
n
Sample Variance

Sn2

1 n
Xi X
n i 1

Unbiased Variance

Sn21

1
n
Xi X

i 1
n 1

Trial
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67

Outcome
1
5
6
5
4
2
4
6
5
7
8
8
6
4
6
6
4
3
3
7
7
4
5
3
2
4
5
3
4
1
4
3
4
4
3
2
3
3
7
5
5
5
3
2
7
7
8
9
4
5
5
6
8
7
4
5
4
2
5
4
5
3
6
5
4
4
3

Sample Mean

Sample Variance

4.5

3.05

Sample Mean

Sample Variance

3.4

Sample Mean

Sample Variance

4.6

3.44

Sample Mean

Sample Variance

4.4

3.14

Sample Mean

Sample Variance

4.62

3.5956

Sample Mean

Sample Variance

4.683333333

3.449722222

Unbiased Sample
Variance
3.388888889

Unbiased Sample
Variance
3.578947368

Unbiased Sample
Variance
3.55862069

Unbiased Sample
Variance
3.220512821

Unbiased Sample
Variance
3.668979592

Unbiased Sample
Variance
3.50819209

The following data comes from another group

68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138

5
5
7
4
5
4
6
4
5
5
4
6
10
7
8
5
6
4
5
4
6
4
8
7
8
5
3
5
6
6
4
3
4
2
5
3
2
7
5
8
2
4
6
7
3
2
6
7
4
8
9
1
2
5
3
6
7
6
5
4
3
6
7
4
3
5
6
4
5
6
3

Sample Mean

Sample Variance

4.685714286

3.158367347

Sample Mean

Sample Variance

4.7625

3.18109375

Sample Mean

Sample Variance

4.866666667

3.16

Sample Mean

Sample Variance

4.89

3.0979

Sample Mean

Sample Variance

4.845454545

3.221570248

Sample Mean

Sample Variance

4.85

3.560833333

Sample Mean

Sample Variance

4.876923077

3.446390533

Sample Mean

Sample Variance

Unbiased Sample
Variance
3.204140787

Unbiased Sample
Variance
3.221360759

Unbiased Sample
Variance
3.195505618

Unbiased Sample
Variance
3.129191919

Unbiased Sample
Variance
3.251125938

Unbiased Sample
Variance
3.590756303

Unbiased Sample
Variance
3.473106738

Unbiased Sample
Variance

139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200

4
7
2
4
7
8
5
3
8
4
7
3
4
7
9
3
6
4
5
7
5
3
4
5
7
6
5
2
3
7
8
5
5
4
3
6
7
6
5
6
4
2
6
8
6
7
4
4
3
5
6
3
6
8
9
4
5
2
5
2
6
7

Sample Mean

Sample Variance

4.864285714

3.317295918

Sample Mean

Sample Variance

4.88

3.398933333

Sample Mean

Sample Variance

4.90625

3.409960938

Sample Mean

Sample Variance

4.923529412

3.400034602

Sample Mean

Sample Variance

4.916666667

3.331944444

Sample Mean

Sample Variance

4.931578947

3.29531856

Sample Mean

Sample Variance

4.955

3.382975

Unbiased Sample
Variance
3.341161357

Unbiased Sample
Variance
3.421744966

Unbiased Sample
Variance
3.431407233

Unbiased Sample
Variance
3.42015315

Unbiased Sample
Variance
3.350558659

Unbiased Sample
Variance
3.312754107

Unbiased Sample
Variance
3.399974874

Sample Size
Sample Mean
Sample Var
Unbiased Var

10
4.5
3.05
3.389

20
5
3.4
3.579

30
4.6
3.44
3.559

40
4.4
3.14
3.221

50
4.62
3.596
3.669

60
4.683
3.45
3.508

70
4.686
3.158
3.204

80
4.763
3.181
3.221

90
4.867
3.16
3.196

100
4.89
3.098
3.129

10

20

30

40

Sample Mean

50
Sample Var

60

70

80

Unbiased Var

90

100

1 ~ 100
Count

1
2

2
5

3
13

4
25

5
23

6
13

7
10

8
7

9
1

10
1

30
25

25

23

20

15

13

13
10

10

7
5

5
2

10

0
1

1 ~ 200
Count

1
3

2
15

3
27

4
41

40
45

5
40

41

40
35

6
30

40

7
25

8
14

9
4

10
1

35

30

35
30

30

30
25
25
20
20
15
15

27

14

25

15

15

14

10
10
5
5

10

0
1

Geometric Distribution - Geom(0.25)

1
2

Flip 3 coins at the same time. Record the total

number of trials until you get all heads or tails.
Compute the (population) mean and variance
Mean =
Variance =
Repeat 100 times, record the results.
Head = 1
Tail = 0
(Record 15 if the number > 15.)
Some useful equations:
Mean

E[ X ] 1/ p
Variance

Var ( X ) (1 p) / p 2
Sample Mean

1
n
X i 1 X i
n
Sample Variance

Sn2

1 n
Xi X
n i 1

Unbiased Variance

Sn21

1
n
Xi X

i 1
n 1

Trial
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67

Outcome
3
6
4
7
2
4
3
8
3
1
1
9
10
4
2
11
7
1
1
5
6
9
3
2
1
8
3
1
2
5
2
5
5
3
4
1
1
4
7
4
2
10
1
2
4
8
3
2
7
1
7
3
2
1
2
1
3
2
9
13
12
7
4
4
5
2
5

Sample Mean

Sample Variance

4.1

4.49

Sample Mean

Sample Variance

4.6

9.44

Sample Mean

Sample Variance

4.4

8.84

Sample Mean

Sample Variance

4.2

7.56

Sample Mean

Sample Variance

4.16

7.8944

Sample Mean

Sample Variance

4.183333333

9.016388889

Unbiased Sample
Variance
4.988888889

Unbiased Sample
Variance
9.936842105

Unbiased Sample
Variance
9.144827586

Unbiased Sample
Variance
7.753846154

Unbiased Sample
Variance
8.055510204

Unbiased Sample
Variance
9.16920904

The following data comes from another group

68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138

2
3
2
1
5
2
6
12
1
1
1
6
4
1
3
3
10
3
4
3
1
4
1
9
2
3
4
1
3
2
4
2
4

Unbiased Sample
Variance
9.085093168

Sample Mean

Sample Variance

4.242857143

8.955306122

Sample Mean

Sample Variance

4.2

9.26

Sample Mean

Sample Variance

4.1

9.001111111

Sample Mean

Sample Variance

4.03

8.5891

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Unbiased Sample
Variance
9.37721519

Unbiased Sample
Variance
9.102247191

Unbiased Sample
Variance
8.675858586

139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Mean

Sample Variance

Unbiased Sample
Variance

Sample Size
Sample Mean
Sample Var
Unbiased Var

10
4.1
4.49
4.989

20
4.6
9.44
9.937

30
4.4
8.84
9.145

40
4.2
7.56
7.754

50
4.16
7.894
8.056

60
4.183
9.016
9.169

70
4.243
8.955
9.085

80
4.2
9.26
9.377

90
4.1
9.001
9.102

100
4.03
8.589
8.676

12

10

10

20

30

40

Sample Mean

50
Sample Var

60

70
Unbiased Var

80

90

100

1 ~ 100
Count

1
20

2
18

3
16

4
15

5
7

6
4

7
6

8
3

9
4

10
3

11
1

12
2

13
1

14
0

15
0

25

20

20
18
16

15

15

10
7

6
4

0
1

1 ~ 200
Count

1
20

2
18

3
16

4
15

5
7

6
4

7
6

8
3

10

9
4

11

10
3

12

11
1

13

12
2

14

15

13
1

14
0

15
0

40
25
35
20
30

35
20
30

18
16

25
15

15

20
10
15

15

14
7

10
5

6
4

3
1

2
1

12 5

13

0
1

12

4 2

73

4 10

11

14

15

Questions
1
2
3
4

Describe the shapes of the graphs in each experiment. Explain for each graph, why the graphs have these shapes? (10 marks
Compare the biased and the unbiased versions of the sample variance. Which is closer to the true distribution variance? (10
Compare the two Binomial distributions, which result that you learned in the lectures explains the differences between them
In the Geometric distribution trials, on average we need to throw 4 times to get the result. If now I want you to guess how m
in order to optimize your chance to win, which number will you guess? Why? (10 marks)
Combine your experiment outcomes with another group's (i.e., assume another group's outcome is your 101~200).
Compare the sample mean, sample variance (biased and unbiased) with the mean and variances of the distributions. What d
In the turning pen experiment, do you see the law of large numbers and/or central limit theorem? How and why? (10 marks)

1
2
3

Remark:
The completion of each experiment is 10 marks. So, a total of 40 marks is given for those experiments.
The turning pen experiment will be done later in the class.
Each student should submit an individual report on 10-Sep.

he graphs have these shapes? (10 marks)

ser to the true distribution variance? (10 marks)
s explains the differences between them? How? (10 marks)
result. If now I want you to guess how many times it take to get all heads or all tails,

p's outcome is your 101~200).

nd variances of the distributions. What do you observe? Why? (10 marks)
mit theorem? How and why? (10 marks)