Subject Index

American Association for Applied

Linguistics, 1, 156
American Psychological
Association, 21, 107, 108,
see also professional associations
ANOVA. See statistical tests
(ANOVA)
APA, 21, 107, 108, 174, 185
Applied Linguistics, 53, 58, 145, 270
attention (L2), 28, 30, 199, 230, 248,
259, 260
audience (of a paper), 145, 147, 184,
186, 193, 194, 195
awareness (in L2 learning), 29, 30, 229
bias (in publishing), 99, 100, 122
bootstrap, 110, 111, see also
replication (internal),
cross-validation, jackknife
chance (findings), 3, 9, 94, 96, 97
chi-square. See statistical tests
coding (of data), 26, 30, 31, 122,
123, 126, 144, 177, 181, 188,
189, 193, 204, 208, 232, 269
Cohens d, 107, see also effect size,
confidence interval, statistical
tests (power)
collegiality, 184, 185, 193, 194, 195
communicative tasks, 32, 33
comparability, 4, 8, 11, 183, 189,
206, 208
computer-assisted language learning
(CALL), 31
confidence (in a study), 4, 9, 10, 11,
109, 111, 136, 143
confidence interval, 94, 107,
108, 109, 112, 178, 191,
see also effect size, Cohens d
confirmability, 181, 182, 193, 194
confound (in a research design), 21,
138, 141, 144

construct, 27, 28, 29, 30, 47, 69, 81,

218, 232, 234, 235, 244, 259,
261, see also operationalization
contextual, 52
contribution (of a replication study),
5, 6, 12, 16, 25, 40, 100, 128,
139, 269, 272, 274
control group. See groups
correlation. See statistical tests
credibility, 128, 181, 182, 189, 190,
193, 194, 200, 219
critical reading, 15, 137, 138, 156,
1613, 271
cross-validation, 7, 110, 111, see also
replication (internal), bootstrap,
jackknife
data
data collection procedures, 8, 15,
32, 122, 141, 160, 164, 165,
188, 189, 190, 198, 203, 204,
205, 207, 208, 216, 228
interviews, 31, 33, 160, 177, 181,
205, 209, 270
measurement, 9, 10, 16, 50, 51,
53, 80, 111, 141, 178, 191, 201,
208, 215, 216
questionnaire, 139, 177, 181,
237, 270
self-report, 8, 138, 142
sets, 5, 128, 180, 270
sharing, 146
survey, 35, 100, 105
thick description, 182
think-aloud (protocols), 30,
119, 270
databases, 26, 126, 128, 144, 146,
269, 272
dependability, 181, 182, 189, 190,
193, 194
descriptive statistics, 109, 252, 254,
see also inferential statistics

284

971107671522_Sub_Index_p284-288.indd 284

10/24/2011 7:26:24 PM

Subject Index
effect size, 94, 107, 108, 109, 112,
119, 121, 122, 144, 178,
191, 253, 255, 256, see also
confidence interval, Cohens d,
statistical tests (power)
experimental group. See groups
(experimental)
explicit learning, 29, see also implicit
learning
extension (studies), 4, 11, 179,
see also follow-up studies, oneshot studies, single studies
external validity. See validity
(external)
faculty, 12, 27, 28, 147, 268, 269,
274
flaw (in research design), 12, 66, 80,
83, 84, 138, 178, 191
follow-up studies, 235, 244, 246,
274, see also extension studies
one-shot studies, single studies
generalizability (of findings), 414,
21, 24, 31, 36, 37, 39, 40, 52,
92112, 11629, 136, 143, 177,
178, 180, 181, 188, 246, 247,
253, 258, 268
generalization (of findings), 27, 48,
83, 109
genre (in writing), 145
graduate
programs, 13, 14, 15, 27, 13547,
15168, 268, 270, 271
students, 27, 28, 40, 135, 136,
137, 156, 161, 163, 164, 166,
167, 269, 274
groups
control group, 81, 84, 98, 107,
138, 139, 140, 141, 144, 245
experimental/treatment, 81, 82, 84,
98, 107, 139, 140, 141
intact, 200, 248
random assignment, 10, 35, 84, 96,
101, 110, 111, 141, 200, 248
hypothesis
null, 13, 21, 92109
testing, 93, 94, 96, 97, 102, 103,
119, 180
hypothesis testing
null hypothesis, 99

971107671522_Sub_Index_p284-288.indd 285

285

implicit learning, 29, 123,

see also explicit learning
independence of observation, 105,
106
inferencing, 101, 103
inferential statistics, 92,
see also descriptive statistics
intact groups. See also groups
interaction, 15, 309, 65, 68, 84,
121, 123, 139, 152, 181, 186,
189, 191, 192, 198219, 220,
221, 231, 232, 245, 246, 260
internal validity. See validity
(internal)
inter-rater reliability, 69, 141, 251, 252
jackknife, 110, 111, see also replication
(internal), bootstrap, cross
validation
Journal Article Reporting Standards
Group, 128
journal editors, 9, 12, 13, 27, 66,
126, 273
Journal of Second Language
Writing, 25
L2 processing, 30, 32
L2 writing, 25, 26, 28, 39, 40, 47, 69
Language Learning, 38, 48, 53,
107, 140
Language Teaching, 1, 5, 10, 22, 23,
25, 27, 28, 29, 41, 49, 50, 51, 52,
63, 66, 67, 85, 136, 138, 143,
144, 145, 157, 179, 184, 198,
238, 269, 270, 272, 273, 274
Language Teaching Review Panel,
22, 23, 26, 27, 28, 29, 52, 66,
67, 136, 138, 143, 144, 157,
179, 184, 238, 269, 274
LanguageTeaching Review Panel, 10,
49, 50, 51, 272
mean (statistical), 96, 99, 101, 107,
108, 118, 119, 121, 123, 140,
142, 255, 256
meaningfulness, 180, 182, 194
meta-analysis, 14, 38, 50, 68, 108,
109, 11629, 274
Nature, 1, 2
non-significant findings, 67, 68, 69,
83, 84, 98, 99, 104, see also
significance level

10/24/2011 7:26:24 PM

286

Subject Index

noticing, 30, 31, 34, 35, 36, 37, 230,

231, 232
null hypothesis. See hypothesis
testing
one-shot studies, 4, 274, see also
extension studies, follow-up
studies, single studies
operational definition, 9, see also
construct
operationalization, 10, 25, 26, 27,
29, 34, 47, 51, 52, 65, 69, 80,
123, 208, 220, 232, 234, 237,
269, see also construct
original study, 3, 5, 7, 8, 15, 22, 24,
25, 26, 28, 29, 37, 39, 112, 142,
144, 145, 146, 159, 163, 17395,
198219, 22863, 268, 271, 272
p value, 93, 108, 117, 178, 181,
see also t-test, significance level,
significance testing
parameter (population), 108, 119
PhD program. See graduate
(programs)
physical sciences (as a discipline), 2,
3, 4, 13, 21, 23, 116, 137,
269, 275
physical sciences (as a discipline), 136
post-hoc test. See statistical tests
post-test, 25, 33, 69, 106, 139, 141,
234, 235, 250, 252, 253, 254,
255, 256, see also pre-test
pre-test, 25, 33, 69, 98, 106, 123,
141, 250, see also post-test
professional associations, 272,
274, 275
pvalue, 93104
quasi-experimental (research
design), 2, 16
random assignment. See groups
rating (of data), 141, 177, 181
recasts, 307, 66, 121, 123, 201,
216, 220
reliability
inter-rater, 70
replication
approximate, 8, 9, 10, 11, 15, 23,
24, 25, 35, 50, 52, 53, 65, 66,
67, 84, 122, 142, 143, 157,

971107671522_Sub_Index_p284-288.indd 286

173, 183, 184, 186, 188, 195,

198219, 22863, 270, 271, 273
conceptual, 5, 8, 9, 10, 11, 15, 24,
26, 29, 31, 33, 35, 50, 52, 65,
66, 67, 80, 122, 123, 142, 143,
173, 183, 184, 195, 26873
definition, 2, 79, 502, 53, 67,
109, 157, 238
dissemination, 1, 2, 272, 273, 274
exact, 3, 6, 8, 9, 12, 13, 15, 22,
23, 40, 4785, 142, 157, 173,
174, 176, 179, 183, 184, 186,
187, 195
internal, 7, 23, 10912, 271
replicability, 5, 14, 47, 92111,
117, 164, 180, 181
representative (sample), 10, 21, 33,
35, 97, 101, 109, 118, 138,
144, 208
re-sampling, 110, 111, 271,
see also replication (internal)
research
agenda, 16, 272, 274
between groups, 139, 142
classroom-based, 32, 121, 193,
218, 232
ethics, 47, 146, 185, 193, 194,
195, 270
ethnographic, 35
impact, 12, 13, 201, 235
laboratory-based, 29, 121
mixed-methods, 15, 33, 173, 179,
180, 183, 195
primary, 11628
qualitative (replication research),
45, 8, 14, 15, 35, 3740,
17395, 270
quantitative (replication research),
1, 2, 5, 6, 8, 14, 37, 38, 48, 173,
17495, 22863, 270
repeated-measures, 201
secondary, 126
sample size, 65, 98, 107, 108,
109, 110, 111, 138, 177, 178,
189, 191
sampling
errors, 93, 111, 112, 121
procedures, 177, 181, 189
scientific inquiry, 17
Second Language Research, 53, 59

10/24/2011 7:26:24 PM

Subject Index
sections (of a research paper), 175
analysis, 10, 15, 93, 159,
186, 198
discussion and conclusions, 127,
126, 174, 178, 179, 185, 190,
191, 192, 195
implications, 39, 178, 192
introduction, 174, 187
introduction to the problem, 127
limitations, 6, 28, 31, 144, 178,
191, 271
literature review, 127, 126, 138,
141, 177, 187
materials, 144, 177, 188, 193
method, 127, 174, 177, 188, 190,
195, 269
procedures. See data collection
procedures
research question, 26, 54, 141,
143, 174, 177, 187, 188
results, 126, 127, 174, 178, 190,
191, 195
statement of the purpose, 174,
177, 187
suggestions for further research,
178, 179, 193
significance level, 99
significance level (alpha), 93, 94,
104, 178, 191, see also p value,
non-significant findings
significance testing, 14, 67,
92106, see also statistical tests
single studies, 109, see also oneshot studies, follow-up studies,
extension studies
standard deviation, 107, 255
statistical power. See also Cohens d,
effect size
statistical tests
ANOVA, 94, 104, 105, 201, 216
assumptions (of statistical tests),
93107
chi-square, 94, 105, 106, 109
correlation, 94, 97, 98, 256
post-hoc, 28, 36, 203, 217, 253,
254, 255
power, 9, 16, 110, 117, 121, 128,
177, 178, 189, 191, 274
regression, 94, 181
t-test, 94, 104, 140, 142

971107671522_Sub_Index_p284-288.indd 287

287

stimulated recall, 15, 33, 35, 188,

189, 192, 193, 198, 203, 204,
209, 215, 218, 219
Studies in Second Language
Acquisition, 38, 47, 48, 54, 55,
56, 85
Studies in Second Language
Acquisition, 49
study abroad, 31, 139, 142,
248, 249
subgroup analyses, 119, 121
submission (of a paper to a journal),
14, 15, 49, 1739, 273
target study. See original study
TESOL Quarterly, 38, 48, 53, 58
The Modern Language Journal, 38, 53
thesis (writing of), 147, 15168, 270
transferability, 37, 38, 39, 181, 182,
193, 194, 198, 200, 202, 206,
215
triangulation, 182, 190, 193, 203
t-test. See statistical tests
type I error, 21, 97, 99, 104
type II error, 21, 97, 104
validity. See also generalizability
external, 10, 11, 66, 68, 84, 107,
117, 118, 144, 157, 181, 200
internal, 10, 11, 66, 80, 84, 126,
144, 181, 216
threats to, 10, 144
variable
contextual, 50, 52
dependent, 49, 50, 51, 52, 53, 54,
63, 67, 69, 7099, 119, 201
extraneous, 21, 50, 66
independent, 36, 49, 50, 51, 52,
53, 63, 67, 69, 70, 80
intervening, 28, 29, 180
variance, 49, 94, 104, 105, 201,
215, 220
vocabulary acquisition, 152, 154,
22863
washback effect, 268
writing up replication studies, 2, 15,
145, 163, 17395, see also
submission (of a paper to a
journal)
written error correction, 14, 4785

10/24/2011 7:26:24 PM

971107671522_Sub_Index_p284-288.indd 288

10/24/2011 7:26:24 PM