Escolar Documentos
Profissional Documentos
Cultura Documentos
2006:6
First published: 16 March, 2006
Last updated:
16 March, 2006
Colophon
Title
Institution
Authors
DOI
No. of pages
Last updated
Citation
Copyright
Keywords
Contributions
Support/Funding
Potential Conflicts
of Interest
Corresponding
author
None stated.
The National Institute of Mental Health, USA
The National Institute of Justice, USA
William T. Grant Foundation, USA
Laboratory for Student Success, Center for Research in Human Development
and Education, Temple University USA
None.
Sandra Jo Wilson
Center for Evaluation Research and Methodology
Vanderbilt Institute for Public Policy Studies
Vanderbilt University
1207 18th Ave. South
Nashville, TN 37212
USA
Telephone: +1 615 343 7215
E-mail: sandra.j.wilson@vanderbilt.edu
Editors
Crime and Justice
Education
Social Welfare
Managing Editor
Editorial Board
Crime and Justice
Education
Social Welfare
Methods
David Weisburd, Hebrew University, Israel & George Mason University, USA
Peter Grabosky, Australian National University, Australia
Carole Torgerson, University of York, UK
Aron Shlonsky, University of Toronto, Canada
Therese Pigott, Loyola University, USA
Peter Tugwell, University of Ottawa, Canada
The Campbell Collaboration (C2) was founded on the principle that
systematic reviews on the effects of interventions will inform and help
improve policy and services. C2 offers editorial and methodological support to
review authors throughout the process of producing a systematic review. A
number of C2's editors, librarians, methodologists and external peerreviewers contribute.
The Campbell Collaboration
P.O. Box 7004 St. Olavs plass
0130 Oslo, Norway
www.campbellcollaboration.org
This work is a Campbell Collaboration systematic review and was supported by grants from the
National Institute of Mental Health, the National Institute of Justice, the William T. Grant
Foundation, and the Laboratory for Student Success at the Temple University Center for
Research in Human Development and Education.
Contents
Background for the Review .................................................................. 5
Social Information Processing................................................................ 5
Social Information Processing Programs ............................................... 6
What Social Information Processing Program are Not ........................... 7
Selected and Indicated Prevention ......................................................... 7
Prior Research on Social Skills Interventions......................................... 8
Findings .....................................................................................13
Description of Eligible Studies...............................................................13
Mean Effects of Universal Social Information Processing Programs..... 16
Analysis of Moderator Effects............................................................... 18
The Relationship of Method to Effect Size...................................... 18
The Relationship of Other Study Characteristics to Effect Size....... 19
Moderators of Observed Effects..................................................... 22
Conclusions .............................................................................. 23
Plans for Updating .................................................................... 24
Conflict of Interest .................................................................... 24
References ................................................................................ 25
Studies Included in the Systematic Review ............................... 27
Appendix....................................................................................31
List of Tables
Table 1: Characteristics of Studies............................................................. 14
Table 2: Zero-order Correlations between Study Method Characteristics
and Aggressive Behavior Effect Sizes ........................................................ 19
Table 3: Relationships between Study Characteristics and Aggressive
Behavior Effect Sizes with Method Variables Controlled ........................... 21
Table 4: Regression Model for Effect Size Moderators for Selected and
Indicated Social Information Processing Programs .................................. 22
Table A1: Method Variables by Study......................................................... 32
Table A2: General Characteristics and Subject Variables by Study ............ 34
Table A3: Treatment Characteristics by Study ........................................... 36
List of Figures
Post-treatment Effect Sizes and Confidence Intervals for Aggressive and
Disruptive Behavior Outcomes ..................................................................17
We recognize that social information processing deficits are one of many likely correlates of aggressive interpersonal
behavior and that the perpetration of aggression by individual students is determined by an array of interrelated
individual, family, social, and environmental processes. The discussion of social information processing deficits here
is not meant to provide an exhaustive discussion of the causes of aggressive behavior. Rather it is intended to provide
the reader with a brief background on the rationale behind the interventions that are examined in this review.
social information processing (Dodge, Pettit, McClaskey, & Brown, 1986; Kendall, 1995).
To illustrate, deficits at the encoding or interpretation stage of processing may involve
misinterpreting as hostile the intent of others in neutral or ambiguous social situations.
Hostile misattributions have been linked to aggressive responses (Crick & Dodge, 1994).
And, aggressive children are more likely to make hostile attributions than their nonaggressive peers (Slaby & Guerra, 1988). Deficits at the goal selection or clarification
stage can result in the selection of antisocial rather than prosocial goals (Asher &
Renshaw, 1981; Crick & Dodge, 1989). Children who have difficulty accessing or
evaluating responses to social situations (Steps 4 and 5) tend to have fewer responses
from which to choose in social situations and may fail to evaluate the consequences of
particular behaviors (e.g., Mize & Cox, 1990; Spivack & Shure, 1974).
Social Information Processing Programs
Some of the earliest programs designed to address social information processing deficits
were the social problem solving programs developed in the 1970s (e.g., DZurilla &
Goldfried, 1971; Shure & Spivack, 1972; 1979). These programs were designed to
improve social behavior by teaching cognitively-based problem solving skills. For
example, the I Can Problem Solve program (Shure, 1992) involves teaching participants
a series of problem solving skills that includes perspective taking, alternative response
generation, consequential or means-ends thinking, and causal thinking.
In more recent years, many variations on this theme have been developed (Coleman,
Wheeler, & Webber, 1993). Attribution retraining programs, such as Hudleys
BrainPower (Hudley, 1991) program, focus on the early stages of the social information
processing model and teach children to accurately detect intentionality, to make
nonhostile attributions when social encounters are ambiguous, and to generate
appropriate behavioral responses to ambiguous negative situations. Lochmans Anger
Coping program (Lochman, Lampron, Burch, & Curry, 1985) includes a module that
helps children learn cognitive goal-setting skills, a social problem solving component,
and a module on anger control (which focuses on the emotional aspects of social
information processing).
While these are examples of some typical social information processing programs, a
conceptual definition of the programs in general is necessary for conducting the
proposed systematic review. This definition aids in identifying candidate programs for
the review and in coding the particular treatment components of each program. For
purposes of this review, therefore, a social information processing program is one with
the following distinct characteristics:
1. The program involves training in one or more of the social information
processing steps: (1) encoding situational and internal cues, (2) interpretation of
cues, (3) selecting or clarifying a goal, (4) generating or accessing possible
responses, (5) choosing a response, (6) and behavioral enactment.
2. The program emphasizes cognitive skills or thinking processes rather than
specific behavioral skills. By teaching generic thinking skills, such programs aim
to improve information processing in myriad social situations.
3. The program involves the use of structured tasks and activities through which the
cognitive skills are learned and applied to actual social situations.
might be associated with study outcomes, we elected to conduct two separate systematic
reviews. The review presented here focuses solely on selected and indicated social
information processing programs delivered in school settings. A second review focuses
on school-based universal social information processing programs (Wilson & Lipsey,
forthcoming).
Prior Research on Social Skills Interventions
Several recent narrative reviews of social skills interventions are available (Clayton,
Ballif-Spanvill, & Hunsaker, 2001; Howard, Flora, & Griffin, 1999; Moote, Smyth, &
Wodarski, 1999; Nangle, Erdley, Carpenter, & Newman, 2002) but these cover social
skills interventions quite broadly by including training in social skills, friendship making
skills, communication skills, and other such social behaviors without an explicit focus on
altering cognitive and social information processing deficits. A few narrative reviews of
programs specific to social information processing have also been conducted (e.g.,
Coleman, Wheeler, & Webber, 1993; Pellegrini & Urbain, 1985), but these are somewhat
dated and also include programs delivered to clinical populations in non-school settings.
Several meta-analysis of related interventions are available (e.g., Beelmann, Pfingsten, &
Lsel, 1994; Denham & Almeida, 1987; Lsel & Beelmann, 2003; Mytton, DiGuiseppi,
Gough, Taylor, & Logan, 2002; Quinn, Kavale, Mathur, Rutherford, & Forness, 1999;
Schneider & Byrne, 1985). Like the narrative reviews, but with the exception of Denham
and Almeida (1987), these syntheses focus on social competence programs in general
and thus include both social information processing and behavioral social skills
programs. The Denham and Almeida meta-analysis focuses exclusively on interpersonal
cognitive problem solving interventions, but is 15 years old and does not include
international studies.
10
The search strategy utilized three categories of search terms2 derived from the
controlled vocabulary used to index articles for each specific database. Wildcard
characters were used to identify variants of words (e.g., delinquen* to locate delinquent,
delinquents, and delinquency). Within each category described below, search terms are
connected by the OR operator; the results for each of the three categories were
combined with the AND operator:
1. The population of interest: child, adolescent, childhood (MEDLINE); children,
adolescents, preadolescents, students (ERIC); children, adolescents, students
(PsychInfo), and children, adolescents, students (Sociological Abstracts);
2. Risks or outcomes: social adjustment, interpersonal relations, social interaction,
social isolation, aggression, juvenile delinquency, peer group, attention deficit
and disruptive behavior disorders, hyperkinesis, cultural deprivation,
interpersonal relations, social environment, social behavior, child behavior
disorders, social problems, antisocial personality disorder, conduct disorder,
dangerous behavior, social alienation, conflict, hostility, violence, reactive
attachment disorders, impulsive behavior, problem solving (MEDLINE); social
environment, social integration, social adjustment, social attitudes, social
experience, social characteristics, attachment behavior, antisocial behavior,
adjustment, aggression, delinquency, attention deficit disorders, hyperactivity, at
risk persons, high risk students, educationally disadvantaged, problem children,
dropouts, social influences, behavior disorders, behavior problems, youth
problems, conflict, hostility, truancy, violence, peer relations, peer influences
(ERIC); interpersonal influences, interpersonal interaction, social skills, social
development, social networks, acting out, adjustment disorders, aggressive
behavior, juvenile delinquency, predelinquent youth, attention deficit disorder,
hyperkinesis, at risk populations, runaway behavior, school dropouts,
disadvantaged, social deprivation, cultural deprivation, peer relations, reference
groups, behavior disorders, behavior problems, antisocial behavior, conduct
disorder, conflict, hostility, truancy, oppositional defiant disorder, impulsiveness,
arguments (PsychInfo); adjustment, social dynamics, social participation, social
behavior, social attitudes, social competence, social development, social learning,
social isolation, juvenile delinquency, social background, disadvantaged, peer
relations, peer influence, behavior problems, interpersonal conflict, conflict,
violence, deviant behavior (Sociological Abstracts);
3. Treatment/evaluations: social problem solving, social information processing,
counseling, intervention, prevention and control, preventive, therapy,
psychotherapy, social control, behavior therapy, cognitive therapy, treatment
outcome, program evaluation, behavioral assessment, randomized controlled
trials, pilot projects, clinical trial, meta-analysis (MEDLINE); behavior change,
counseling, prevention, therapy, intervention, social services, social support
groups, youth programs, enrichment activities, guidance programs, improvement
programs, school community programs, outcomes of treatment, program
evaluation, program effectives, program validation, summative evaluation, metaanalysis (ERIC); social problem solving, social information processing, cognitivebehavioral, social cognition, behavior modification, counseling, intervention,
2
Use of a fourth class is widely discouraged by librarians specializing in research techniques because of the
significantly increased likelihood that desired items are excluded when conformity across four categories is required.
11
12
Note that the sample sizes used in the inverse variance weights were not Winsorized for this review (though they
were Winsorized in the companion review of universal programs) because there were no extreme sample size outliers
among the included studies.
13
The intervention outcome of principal interest was aggressive and disruptive behavior,
which involves a variety of negative interpersonal behaviors including fighting, hitting,
bullying, verbal conflict, disruptiveness, acting out and the like.4 The most common type
of measure was a teacher-report questionnaire, though many studies provided results
for more than one aggressive behavior outcome. To create sets of independent effect size
estimates for analysis, only one effect size from each subject sample was used in any
analysis. The procedures for selecting an independent set of effect sizes are described
below.
Finally, many studies provided data sufficient for calculating mean difference effect
sizes on the outcome variables measured at the pretest. In cases where pretest effect
sizes were available, we adjusted the posttest effect sizes for pretest differences by
subtracting the pretest value from the posttest value. In the analyses presented below,
we tested whether there were systematic differences between effect sizes that were
adjusted and those that were not by including dummy codes for adjustment in the
analyses.
Findings
Description of Eligible Studies
The search strategy identified 68 eligible reports, which reported the results of 47
unique research studies. Some eligible studies were reported in multiple reports, while
some reports presented results for multiple independent studies. In addition, when the
results of a study were reported for subgroups (e.g., male and female results were
reported separately), we coded the two subgroups rather than the aggregate and treated
them as two studies. Table 1 summarizes the characteristics of the 47 selected and
indicated social information processing programs included in this review. Coding details
for each of the 47 studies can be found in the Appendix.
Nearly 90 percent of the studies were conducted in the United States, and slightly over
half were published in peer reviewed journals. Studies were published from the 1970s to
the present, with most programs in the 1980s and 1990s. As would be expected with
populations at risk for aggressive behavior, the samples were predominantly male. Age
ranged from six to 16, with 45% of the samples in the nine to eleven year range. In the
United States, nine to eleven year olds are typically in upper elementary school, between
the 4th and 6th grades. Among the studies that reported the ethnicity for their subject
samples, over half were comprised primarily of minority youth. Forty percent of the
studies were conducted with predominantly low income populations. In terms of the
risk status of student participants, 32% of the studies focused on selected groups and
64% focused on indicated groups. There were two studies with very low risk children.
They are included here because the children were specially selected and pulled out of
their regular classrooms for treatment.
4
Ideally, we would have examined program effects only on aggressive behavior. However, almost none of the
measures called aggressive behavior focus solely on physically aggressive interpersonal behavior. Many include
disruptiveness, acting out, and other forms of behavior problems that are negative, but not necessarily aggressive.
Therefore, our outcome variable includes a broader range of negative behaviors than just aggression and includes
both aggressive and disruptive behaviors.
14
Characteristic
Publication Year
1970s
1980s
1990s
2000s
3
19
12
13
6
40
26
28
Gender Mix
No males (<5%)
50-60% male
Mostly males (>60%)
All males (>95%)
1
12
20
14
2
26
43
30
Form of Publication
Unpublished
Published (peer review)
21
26
45
55
Age
6-8 years
9-11 years
12-16 years
10
21
16
21
45
34
Country of Study
USA
Canada
Finland
Australia
Israel
India
41
2
1
1
1
1
87
4
2
2
2
2
Race/Ethnicity (Predominant)
White
13
Black
15
Hispanic
2
Asian
1
Mixed
2
Cannot tell
14
28
32
4
2
4
30
Group Assignment
Random (individual)
Random (group, class)
Non-random (individual)
Non-random (group, class)
35
5
4
3
74
11
9
6
Socioeconomic Status
Predominantly low
Mixed, full range
Predominantly middle
Cannot tell
19
6
10
12
40
13
21
26
Pretest Adjustment
Yes
No
41
6
87
13
4
32
64
Role of evaluator
Delivered treatment
Supervised delivery
Influential, but no delivery
21
25
1
45
53
2
87
11
2
Implementation Problems
Yes
9
None indicated
38
11
81
Attrition
None
3-10%
11%
21
11
15
38
9
34
5
4
3
1
45
23
32
40
40
19
81
19
72
11
9
6
2
42
5
89
11
Delivery Personnel
Researcher
Researcher + school pers.
Non-research personnel
Graduate students
14
12
11
10
30
26
23
21
13
25
28
12
13
28
53
60
26
28
20
16
8
3
43
34
17
6
Treatment Elements*
General cognitive-behavioral
Anger management
Social problem solving
Perspective taking
Behavior modification
*not mutually exclusive
Duration of Treatment
Up to 8 weeks
9-16 weeks
17-34 weeks
1 school year or more
15
42
7
%
4
47
4
32
2
4
2
4
89
10
The majority (74%) of studies used random assignment of individual students to create
treatment and comparison groups. Eighty-seven percent of the studies presented pretest
results on the outcome variable, which allowed us to adjust for any pretest differences
between groups at the effect size level.5 Overall, the average pretest effect size was not
significantly different from zero, indicating the treatment and comparison groups had
equivalent levels of aggressive behavior before treatment began. In addition, the
random and nonrandom assignment studies were not significantly different at the
pretest.
Only one program was coded as a routine practice program (administered by school
personnel as an ongoing school program). The remaining programs were conducted
primarily for research or demonstration purposes. Correspondingly, the program
evaluators/researchers tended to be involved in treatment delivery or supervision of
delivery personnel. In 55% of the studies, the primary researcher developed the program
under study, while there were only 5 studies in which the program developer was not
involved in the research project. For just over a third of the studies, program developers
were not involved, but the primary researchers modified the program. We believe this
may engender some ownership in the program; in a sense, the researcher becomes a
program developer as a result of modifying an existing program. In addition, because
most of the programs had heavy researcher involvement in treatment delivery and
We could not adjust five studies for pretest differences because pretest results on the outcome variable were not
provided. Four of these studies used random assignment at the individual student level. For the one quasiexperimental study lacking pretest results, the researcher stated that there were no significant differences on pretest
measures prior to treatment.
16
program administration, there were few studies (9) in which implementation problems
were reported.
Programs were mainly conducted using group formats in regular schools, though seven
programs were either solely one-on-one or included individual as well as group sessions.
Five programs were conducted with special education students. Treatment duration
ranged from short programs of less than 8 weeks to those lasting one school year or
more. The majority of programs had sessions once or twice a week. Since students were
typically pulled out of their regular classrooms to meet for treatment, it is not surprising
that most programs could only arrange sessions once or twice a week. A range of
delivery personnel was utilized, with most having some affiliation with the researchers.
Finally, Table 1 shows the frequency of the different types of social information
processing interventions utilized. Most programs involved more than one aspect of
social information processing, and 13 also included a behavior modification component.
Mean Effects of Selected and Indicated Social Information Processing
Programs
The 47 eligible studies generated a total of 120 standardized mean difference effect sizes
on aggressive or disruptive behavior; these effect sizes index the posttreatment
differences between the treatment and comparison groups. Most studies (32) generated
more than one effect size (ranging from two to nine), while 15 studies provided only a
single effect size. The multiple measures of aggressive and disruptive behavior within
studies were either different aspects of aggressive behavior (e.g., physical and nonphysical aggression) or were the same type of aggressive behavior reported by different
informants.
To create a set of independent effect sizes for analysis, a combination of procedures was
used. When studies reported results on different types of aggressive behavior, we
selected the effect size(s) that most closely represented interpersonal physical
aggression and discarded the others. Next, we wanted to retain informant as a variable
for analysis, so did not elect to average across effect sizes from different informants
when more than one was reported. If there was more than one effect size from the same
informant or source, however, their mean value was used. Then, from the studies with
multiple effect sizes reported by different informants, one effect size was selected from
the informant that was most frequently represented in the data. In this case, teachers
were the most common informants, followed by self-reports from the participants
themselves. These procedures resulted in the 47 effect sizes that are the subject of the
following analyses.
The overall random effects mean was .26 (p<.001), indicating that subjects in the
treatment groups had significantly lower aggressive and disruptive behavior than
comparison subjects after participating in selected or indicated social information
processing programs. Figure 1 shows the forest plot for the effect size distribution, using
random effects methods. The effect sizes range from -.71 to 1.29. This figure shows that
the majority of effects (over 60%) are positive, though not large.
17
18
19
There was only one significant relationship between any of the method characteristics
examined and effect size. The relationship between attrition and study outcome was
large, significant, and negative indicating that studies with greater attrition produced
smaller effect sizes. Most striking in this method analysis was the finding that there
were no differences between studies that used individual random assignment and those
that assigned subjects to groups using a non-random method. Because of its significant
influence, attrition was carried forward as a method control in all later analyses. In
addition, the non-random assignment dummy code was carried forward to ensure that
any influence was made explicit; the teacher-report dummy code was also retained
because its relationship with effect size, though insignificant, was not trivial.6
The Relationship of Other Study Characteristics to Effect Size
With the influential method variables identified, we can turn to an analysis of the
important substantive study characteristics. This analysis follows the same procedure
described above for the method variables, but with adjustments for the three carriedover method variables. A series of inverse-variance weighted random effects multiple
regressions were conducted, with each including a single study characteristic and the
four method controls (Raudenbush, 1994). We elected to run each of these analyses
separately at first in order to identify the relationships between each study characteristic
and effect size, without the confounding influence of the other study characteristics.
Table 3 presents the results of these regression analyses.
Only one variable shown in Table 3 had a significant relationship with study outcome,
the type of school in which the program was conducted. However, there were several
other variables with non-trivial relationships with effect size. We will discuss each
grouping of variables shown in Table 3 in turn.
Among the general study characteristics, none had significant relationships with effect
size. However, the beta for year of publication was greater than .10. More recently
published studies generally produced larger effect sizes.
6
The self-report dummy code was not carried forward because there were only 4 studies with self-reported dependent
variables; this variable was only included in the initial method analysis to maintain consistency with the companion
review of universal social information processing programs.
20
In terms of student characteristics, only the risk status of the students showed a
relationship with effect size greater than .10. As shown in Table 1, there are three
categories of student risk: low risk, selected, and indicated. Students in the selected
category were selected for programs because of some risk for later antisocial behavior,
such as poor social skills, attention problems, and the like. Indicated students were
already exhibiting aggressive or disruptive behavior. Although the beta was not
significant, students in the indicated group tended to show greater reductions in
aggressive and disruptive behavior after treatment than did the lower risk students.
There were no significant relationships between gender mix, age, or socioeconomic
status and effect size.
Several characteristics of the treatment and its delivery circumstances had non-trivial
relationships with effect size in addition to the significant relationship between type of
school and study outcome. Programs delivered in special education schools or those in
which the subjects were pulled out of special education classrooms were not as effective
as those in which subjects were pulled out of regular classrooms for treatment. The
students in the special education settings tended to have multiple problems, including
both academic and behavioral difficulties. Although the higher risk children tended to
achieve greater benefits from treatment overall, the children in the special education
settings did not. These children may be a particularly difficult group to work with.
The programs in which graduate students delivered treatment tended to be less effective
than programs delivered by the researchers themselves or other non-research affiliated
delivery personnel (e.g., counselors, social workers, etc.), although the relationship was
not statistically significant.
In terms of the amount and quality of treatment, longer programs and better
implemented programs tended to be more effective than programs which were shorter
or had implementation problems. In addition, the few programs with one-on-one
sessions tended to be less effective than those that were delivered exclusively to groups
of students.
The final set of study characteristics we examined was a series of dummy codes
representing the most common modes of treatment used in social information
processing programs, anger control, social problem solving, perspective taking, and
general cognitive-behavioral and one dummy code representing the use of behavioral
modification in addition to the cognitively-oriented portion of the program. As is
evident from Table 3, the different treatment modes did not tend to be associated with
better or worse outcomes. All the different modes of treatment tended to produce
similar reductions in aggressive and disruptive behavior.
21
.12
.09
-.09
.07
-.06
.07
.03
.07
-.24*
.04
-.12
.10
.19
-.01
.15
Format of Treatment
Tx has individual one-on-one component (yes=1; no=0)
-.15
Treatment Elements
General cognitive-behavioral component (1) vs. other (0)
Anger management component (1) vs. other (0)
Social problem solving component (1) vs. other (0)
Perspective taking component (1) vs. other (0)
Behavior modification component (1) vs. other (0)
.03
.04
.01
-.05
-.05
22
Method Characteristics
Teacher reported DV (1) vs. other (0)
-.01
Attrition (%)
-.57**
Random assignment (1) vs. other (0)
-.22
General Study Characteristics
Publication year
Published (1) vs. unpublished (0)
.26
.11
Student Characteristics
Student risk (indicated=1; all other lower risk=0)
.21
Special placement
Special placement program (1) vs. regular school (0)
-.30*
.05
.05
-.17
.09
.14
23
Although the relationships in this analysis generally follow what we found in earlier
analyses, allowing the individual study characteristics to co-vary produced a few
changes. Though not significant, the random assignment dummy code is more
influential in the full model. Studies which used individual random assignment tended
to produce smaller effects than those which used a non-random design. But, the dummy
code for teacher reported outcome variables was less influential in this final model.
Conclusions
The objective of this systematic review was to examine the effects of school-based social
information processing interventions on the aggressive and disruptive behavior of
selected and indicated school-age children. We were able to locate 47 studies of social
information processing programs delivered to specially selected children in school
settings. Overall, we found a positive program effect. At-risk and behavior problem
students who participated in social information processing programs showed less
aggressive and disruptive behavior after treatment than students who did not receive a
program. The overall weighted mean effect size was .26, which was statistically
significant. Over 60% of the effect size values were positive.
There was significant heterogeneity in outcomes across the 47 studies we reviewed and
our analyses of moderators produced some interesting findings. Only one method
variable had an impact on study outcomesstudies with greater amounts of attrition
between pretest and posttest tended to show smaller program impact than those with
little attrition. There were no significant differences between experimental and quasiexperimental studies, although studies which used random assignment methods tended
to produce smaller effects than the non-random studies.
Social information processing programs for special education students were
significantly less effective than those for regular education students, though overall
greater reductions in aggressive behavior were found for higher risk students. Students
who have behavior problems likely have more potential for change than those who are at
risk but not yet exhibiting serious problems. However, children who have been placed in
special schools or classrooms and then selected for special violence prevention
programming on top of that may have such serious problems that short-term social
information processing programs are not likely to have a strong impact.
The different foci of social information processing programs did not appear to make a
difference. Programs emphasizing anger control were no more effective than those
emphasizing social problem solving or perspective taking.
Selected and indicated programs to prevent antisocial behavior are part of the violence
prevention strategies of many schools. School administrators and teachers have a wide
variety of choices of prevention programs and are interested in choosing programs that
are likely to be effective. The overall mean effect size of .26 indicates that selected and
indicated social information processing programs are effective for reducing aggressive
and disruptive behavior. We can translate this into terms that are more concrete by
converting it into typical levels of aggressive behavior in schools. According to the 1999
Youth Risk Behavior Survey, 14.2% of students reported being in a physical fight on
24
school grounds in the year prior to the survey. For 1995 and 1997, 15.5% and 14.8% of
students reported being in physical fights (Centers for Disease Control and Prevention,
2002). If we use these figures to estimate that about 15% of untreated school children
will get into a fight during a school year, the overall effect size of .26 for selected and
indicated social information processing programs translates into an eight percentage
point reduction in fighting. That is, if 15% of selected or indicated students who received
no social information processing training were getting into fights before intervention,
only 7% of children in social information processing programs were getting into fights.
The most effective programs produced larger effects than this and, thus, would reduce
rates of aggressive behavior even more. In addition, since many of the children in
selected or indicated programs were already exhibiting some problem behavior, it is
likely that their baseline level of fighting behavior was higher than the general estimate
of 15%. Thus, the reduction in aggressive behavior could possibly be greater.
Conflict of Interest
None.
25
References
Alpert-Gillis, L. J., Pedro-Carroll, J. L., & Cowen, E. L. (1987). The Children of Divorce
Intervention Program: Development, implementation, and evaluation of a program for young
urban children. Journal of Consulting & Clinical Psychology, 57, 583-589.
Asher, S. R., & Renshaw, P. D. (1981). Children without friends: Social knowledge and social
skills training. In S. R. Asher & J. M. Gottman (Eds.), The development of childrens
friendships (pp. 273-296). New York: Cambridge University Press.
Beelmann, A., Pfingsten, U., & Lsel, F. (1994). Effects of training social competence in children:
A meta-analysis of recent evaluation studies. Journal of Clinical Child Psychology, 23, 260271.
Clayton, C. J., Ballif-Spanvill, B., & Hunsaker, M. D. (2001). Preventing violence and teaching
peace: A review of promising and effective antiviolence, conflict-resolution, and peace
programs for elementary school children. Applied and Preventive Psychology, 10, 1-35.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ:
Lawrence Erlbaum.
Coleman, M., Wheeler, L., & Webber, J. (1993). Research on interpersonal problem-solving
training: A review. Remedial and Special Education, 14, 25-37.
Crick, N. R., & Dodge, K. A. (1989). Childrens perceptions of peer entry and conflict situations:
Social strategies, goals, and outcome expectations. In B. Schneider, J. Nadel, G. Attili, & R.
Weissberg (Eds.), Social competence in developmental perspective (pp. 396-399). New York:
Kluwer.
Crick, N. R., & Dodge, K. A. (1994). A review and reformulation of social information-processing
mechanisms in childrens social adjustment. Psychological Bulletin, 115, 74-101.
Denham, S. A., & Almeida, M. C. (1987). Childrens social problem-solving skills, behavioral
adjustment, and interventions: A meta-analysis evaluating theory and practice. Journal of
Applied Developmental Psychology, 8, 391-409.
DeVoe, J. F., Peter, K., Kaufman, P., Ruddy, S. A., Miller, A. K., Planty, M., Snyder, T. D., &
Rand, M. R. (2003). Indicators of school crime and safety: 2003 (NCES 2004-004/NCJ
201257). Washington, DC: US Departments of Education and Justice.
Dodge, K. A. (1986). A social information processing model of social competence in children. In
M. Perlmutter (Ed.), The Minnesota Symposium on Child Psychology (Vol. 18, pp. 77-125).
Hillsdale, NJ: Erlbaum.
Dodge, K. A., Pettit, G., McClaskey, C., & Brown, M. (1986). Social competence in children.
Monograph of the Society for Research in Child Development, 51 (Serial No. 213).
Durlak, J. A. (1997). Primary prevention programs in schools. Advances in Clinical Child
Psychology, 19, 283-318.
D'Zurilla, T. J., & Goldfried, M. R. (1971). Problem solving and behavior modification. Journal
of Abnormal Psychology, 78, 107-126.
Edwards, P., Clarke, M., DiGuiseppi, C., Pratap, S., Roberts, I., & Wentz, R. (2002).
Identification of randomized controlled trials in systematic reviews: Accuracy and reliability
of screening records. Statistics in Medicine, 21, 1635-1640.
Garofalo, J., Siegel, L., & Laub, J. (1987). School-related victimizations among adolescents: An
analysis of National Crime Survey (NCS) narratives. Journal of Quantitative
Criminology, 3, 321-338.
Goldstein, A. P., Harootunian, B., & Conoley, J. C. (1994). Student aggression: Prevention,
management, and replacement training. New York: The Guilford Press.
Gottfredson, G. D., Gottfredson, D. C., Czeh, E. R., Cantor, D., Crosse, S., & Hantman, I. (2000).
National study of delinquency prevention in schools. Final Report, Grant No. 96-MU-MU0008. Ellicott City, MD: Gottfredson Associates, Inc. Available online: www.gottfredson.com.
Howard, K. A., Flora, J., & Griffin, M. (1999). Violence-prevention programs in schools: State of
the science and implications for future research. Applied and Preventive Psychology, 8, 197-
26
215.
Hudley, C. (1991). An attribution retraining program to reduce peer directed aggression among
African-American male elementary school students (Doctoral dissertation, University of
California, Los Angeles). Dissertation Abstracts International, 52/4-A, 1263-1264.
(University Microfilms No. AAT91-28799)
Kanchur, S. P., et al. (1996). School associated violent deaths in the U. S., 1992 to 1994. Journal
of the American Medical Association, 275, 1729-1733.
Kendall, P. C. (1995). Cognitive-behavioral therapies with youth: Guiding theory, current status,
and emerging developments. Journal of Consulting and Clinical Psychology, 61, 235-247.
Lewinsohn, P. M., Clarke, G. N., Hops, H., & Andrews, J. (1990). Cognitive-behavioral treatment
for depressed adolescents. Behavior Therapy, 21, 385-401.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis, Thousand Oaks, CA: Sage.
Lochman, J. E., Lampron, L. B., Burch, P. R., & Curry, J. F. (1985). Client characteristics
associated with behavior change for treated and untreated aggressive boys. Journal of
Abnormal Child Psychology, 13, 527-538.
Lsel, F., & Beelmann, A. (2003). Effects of child skills training in preventing antisocial
behavior: A systematic review of randomized evaluations. Annals of the American Academy
of Political and Social Science, 587, 84-109.
Mize, J., & Cox, R. A. (1990). Social knowledge and social competence: Number and quality of
strategies as predictors of peer behavior. Journal of Genetic Psychology, 151, 117-127.
Moote, G. T., Smyth, N. J., & Wodarski, J. S. (1999). Social skills training with youth in school
settings: A review. Research on Social Work Practice, 9, 427-465.
Mytton, J. A., DiGuiseppi, C., Gough, D. A., Taylor, R. S., & Logan, S. (2002). School-based
violence prevention programs: Systematic review of secondary prevention trials. Archives of
Pediatric and Adolescent Medicine, 156, 752-762.
Nangle, D. W., Erdley, C. A., Carpenter, E. M., & Newman, J. E. (2002). Social skills training as
a treatment for aggressive children and adolescents: A developmental-clinical integration.
Aggression and Violent Behavior, 7, 169-199.
Pellegrini, D. S. & Urbain, E. S. (1985). An evaluation of interpersonal cognitive problem solving
training with children. Journal of Child Psychology & Psychiatry & Allied Disciplines, 26, 1741.
Quinn, M. M., Kavale, K. A., Mathur, S. R., Rutherford, R. B., Jr., & Forness, S. R. A metaanalysis of social skill interventions for students with emotional or behavioral disorders.
Journal of Emotional and Behavioral Disorders, 7, 54-64.
Schneider, B. H., & Byrne, B. M. (1985). Childrens social skills training: A meta-analysis. In B.
H. Schneider, K. H. Rubin, & J. E. Ledingham (Eds.), Childrens peer relations: Issues in
assessment and intervention (pp. 175-192). New York: Springer.
Shure, M. B. (1992). I Can Problem Solve: An interpersonal cognitive problem-solving
program: Kindergarten and primary grades. Champaign, IL: Research Press.
Shure, M. B., & Spivack, G. (1972). Means-ends thinking, adjustment, and social class among
elementary-school-aged children. Journal of Consulting and Clinical Psychology, 38, 348353.
Shure, M. B., & Spivack, G. (1979). Interpersonal cognitive problem solving and primary
prevention: Programming for preschool and kindergarten children. Journal of Clinical Child
Psychology, 8, 89-94.
Slaby, R. G., & Guerra, N. G. (1988). Cognitive mediators of aggression in adolescent offenders:
I. Assessment. Developmental Psychology, 24, 580-588.
Spivack, G., & Shure, M. B. (1974). Social adjustment in young children. San Francisco: JosseyBass.
Wilson, S. J., Lipsey, M. W., & Derzon, J. H. (2003). The effects of school violence prevention
programs on aggressive and disruptive behavior. Journal of Consulting and Clinical
Psychology, 71, 136-149.
27
28
Dodge, K. A., & Coie, J. D. (1987). Social-information-processing factors in reactive and proactive
aggression in children's peer groups. Journal of Personality and Social Psychology, 53, 1146-1158.
[401; 460]
Edleson, J. L., & Rose, S. D. (1981). Investigations into the efficacy of short-term group social skills
training for socially isolated children. Child Behavior Therapy, 3, 1-16. [755; 756]
Flores de Apodaca, R. (1979). Interpersonal problem-solving training for maladjusted primary graders
(Doctoral dissertation, University of Rochester). Dissertation Abstracts International, 40/4-B, 1889.
(University Microfilms No. AAT79-22930) [2065]
Graham, S., & Hudley, C. (1992). An attributional approach to aggression in African-American children.
In D. Schunk & J. Meece (Eds.), Student perceptions in the classroom (pp. 75-94). Hillsdale, NJ:
Erlbaum. [473]
Hudley, C. (1991). An attribution retraining program to reduce peer directed aggression among
African-American male elementary school students (Doctoral dissertation, University of California,
Los Angeles). Dissertation Abstracts International, 52/4-A, 1263-1264. (University Microfilms No.
AAT91-28799) [473]
Hudley, C. A. (1992, April). The reduction of peer directed aggression among highly aggressive AfricanAmerican boys. Paper presented at the meeting of the American Educational Research Association,
San Francisco, CA. (ERIC Document Reproduction Service No. ED346204) [473]
Hudley, C. A. (1994). The reduction of childhood aggression using the BrainPower program. In M. J.
Furlong & D. C. Smith (Eds.), Anger, hostility, and aggression: Assessment, prevention, and
intervention strategies for youth (pp. 313-344). Brandon, VT: Clinical Psychology Publishing. [473]
Hudley, C., & Graham, S. (1993). An attributional intervention to reduce peer-directed aggression among
African-American boys. Child Development, 64, 124-138. [473]
Hughes, J., & Cavell, T. A. (1995). Cognitive-affective approaches: Enhancing competence in aggressive
children. In G. Cartledge, & J. F. Milburn (Eds.), Teaching social skills to children and youth (pp.
199-236). Boston, MA: Allyn & Bacon. [456]
Hughes, J. N., Grossman, P. B., & Hart, M. T. (1993, August). Effectiveness of problem solving training
and teacher consultation with aggressive children. Paper presented at the meeting of the American
Psychological Association, Toronto, ON. (ERIC Document Reproduction Service No. 370056) [456]
Kahl, B. (1984). A school-based cognitive-behavior modification program for hyperaggressive children
(Doctoral dissertation, ). Dissertation Abstracts International, -A), 126. [1192]
Larkin, R. (1999). The effect of behavioral group counseling on improving self-esteem, perceived selfcontrol, and classroom behavior of elementary students (Doctoral dissertation, University of
Georgia, 1998). Dissertation Abstracts International, 59/10-A, 3969. (University Microfilms No.
AAT99-08615) [1922]
Larson, J. D. (1992). Anger and aggression management techniques through the Think First curriculum.
Journal of Offender Rehabilitation, 18, 101-117. [1180]
Larson, J. D. (1991). The effects of a cognitive-behavioral anger-control intervention on the behavior of
at-risk middle school students (Doctoral dissertation, Marquette University). Dissertation Abstracts
International, 52/1-A, 117. (University Microfilms No. AAT91-07785) [1180]
Larson, K. A. (1989). Task-related and interpersonal problem-solving training for increasing school
success in high-risk young adolescents. RASE: Remedial & Special Education, 10, 32-42. [387]
Lochman, J. E. (1984). Cognitive-behavioral intervention with aggressive boys: Three year follow-up and
preventive effects. Journal of Consulting and Clinical Psychology, 60, 426-432. [458]
Lochman, J. E. (1985). Effects of different treatment lengths in cognitive behavioral interventions with
aggressive boys. Child Psychiatry and Human Development, 16, 45-56. [458]
Lochman, J. E., Burch, P. R., Curry, J. F., & Lampron, L. B. (1984). Treatment and generalization effects
of cognitive-behavioral and goal-setting interventions with aggressive boys. Journal of Consulting
and Clinical Psychology, 52, 915-916. [458]
Lochman, J. E., Coie, J. D., Underwood, M. K., & Terry, R. (1993). Effectiveness of a social relations
intervention program for aggressive and nonaggressive, rejected children. Journal of Consulting
and Clinical Psychology, 61, 1053-1058. [401; 460]
Lochman, J. E., Lampron, L. B. (1988). Cognitive-behavioral interventions for aggressive boys: 7-month
follow-up effects. Journal of Child & Adolescent Psychotherapy, 5, 15-23. [458]
Lochman, J. E., Lampron, L. B., Burch, P. R., & Curry, J. F. (1985). Client characteristics associated with
behavior change for treated and untreated aggressive boys. Journal of Abnormal Child Psychology,
13, 527-538. [458]
29
Lochman, J. E., Lampron, L. B., Gemmer, T. C., & Harris, S. R. (1987). Anger coping intervention with
aggressive children: A guide to implementation in school settings. In P. A. Keller, & S. R. Heyman
(Eds.), Innovations in clinical practice: A source book (Vol. 6) (pp. 339-356). Sarasota, FL:
Professional Resource Exchange. [458]
Lochman, J. E., Lampron, L. B., Gemmer, T. C., Harris, S. R., & Wyckoff, G. M. (1987). Teacher
consultation and cognitive behavioral interventions with aggressive boys. Paper presented at the
meeting of the American Psychological Association Annual Convention. (ERIC Document
Reproduction Service No. 291044) [459]
Lochman, J. E., Lampron, L. B., Gemmer, T. C., Harris, S. R., & Wyckoff, G. M. (1989). Teacher
consultation and cognitive-behavioral interventions with aggressive boys. Psychology in the
Schools, 26, 179-188. [459]
Lochman, J. E., & Wells, K. C. (2004). The Coping Power Program for preadolescent aggressive boys and
their parents: Outcome effects at the 1-year follow-up. Journal of Consulting and Clinical
Psychology, 72, 571-578. [5039]
Lochman, J. E., & Wells, K. C. (2003). Effectiveness of the Coping Power Program and of classroom
intervention with aggressive children: Outcomes at a 1-year follow-up. Behavior Therapy, 34, 493515. [5023]
Lochman, J. E., & Wells, K. C. (2002). Contextual social-cognitive mediators and child outcomes: A test of
the theoretical model in the Coping Power program. Development and Psychopathology, 14, 945967. [5039]
Lochman, J. E., & Wells, K. C. (2002). The Coping Power program at the middle-school transition:
Universal and indicated prevention effects. Psychology of Addictive Behaviors, 16 (Suppl. 4), S40S54. [5023]
Mannarino, A. P., Christy, M., Durlak, J. A., & Magnussen, M. G. (1982). Evaluation of social competence
training in the schools. Journal of School Psychology, 20, 11-19. [224]
Milne, J., & Spence, S. H. (1987). Training social perception skills with primary school children: A
cautionary note. Behavioural Psychotherapy, 15, 144-157. [2121]
Nelson, J. R., Dykeman, C., Powell, S., & Petty, D. (1996). The effects of a group counseling intervention
on students with behavioral adjustment problems. Elementary School Guidance & Counseling, 31,
21-33. [384]
Nickerson, K. F. (2004). Anger in adolescents: The effectiveness of a brief cognitive-behavioral anger
management training program for reducing attitudinal and behavioral expressions of anger
(Doctoral dissertation, ). Dissertation Abstracts International, 65(1-B), 425. [5092]
Omizo, M. M., Hershberger, J. M., & Omizo, S. A. (1988). Teaching children to cope with anger.
Elementary School Guidance & Counseling, 22, 241-245. [379]
Pascucci, N. J. (1991). The efficacy of anger control training in reducing chronic aggressive behavior
among emotionally disturbed/learning-disabled African-American male preadolescents and
adolescents (Doctoral dissertation, St. John's University, 1990). Dissertation Abstracts
International, 51(11), 3678. (University Microfilms No. AAT 9109870) [5066]
Pepler, D., King, G., Craig, W., Byrd, B., & Bream, L. (1995). The development and evaluation of a
multisystem social skills group training program for aggressive children. Child and Youth Care
Forum, 24, 297-313. [241]
Pitkanen, L. (1974). The effect of simulation exercises on the control of aggressive behaviour in children.
Scandinavian Journal of Psychology, 15, 169-177. [5043]
Rahill, S. A. (2002). A comparison of the effectiveness of story-based and skill-based social competence
programs on the development of social problem solving and peer relationship skills of children
with emotional disabilities (Doctoral dissertation, University of Maryland, College Park).
Dissertation Abstracts International, 63(6-A), 2135. (University Microfilms No. 3055612) [5000]
Rahill, S. A., & Teglasi, H. (2003). Processes and outcomes of story-based and skill-based social
competency programs for children with emotional disabilities. Journal of School Psychology, 41,
413-429. [5000]
Rosengren, D. B. (1987). The Program for Anger Control Training (PACT): An intervention for angry
adolescents (Doctoral dissertation, University of Montana, 1987). Dissertation Abstracts
International, 48(06), 1819. (University Microfilms No. AAT87-19354) [1217]
Scheckner, S. B. (2004). The evaluation of an anger management program for pre-adolescents in an
elementary school setting (Doctoral dissertation, Florida State University, 2003). Dissertation
Abstracts International, 64(7-B), 3541. [5098]
30
Scheckner, S. B., & Rollin, S. A. (2003). An elementary school violence prevention program. Journal of
School Violence, 2(4), 3-42. [5098]
Sharp, S. R. (2004). Effectiveness of an anger management training program based on rational emotive
behavior theory (REBT) for middle school students with behavior problems (Doctoral dissertation,
University of Tennessee, 2003). Dissertation Abstracts International, 64(10-A), 3595. [5083]
Shechtman, Z. (2000). An innovative intervention for treatment of child and adolescent aggression: An
outcome study. Psychology in the Schools, 37, 157-167. [5053]
Stainback, G. J. (1986). Effects of cognitive self-instruction in the increase of anger control for verbally
aggressive children (Doctoral dissertation, North Carolina State University, 1986). Dissertation
Abstracts International, 47/5-B, 2187-2188. (University Microfilms No. AAT86-13117) [2052]
Sukhodolsky, D. G., Solomon, R. M., & Perine, J. (2000). Cognitive-behavioral, anger-control intervention
for elementary school children: A treatment outcome study. Journal of Child and Adolescent Group
Therapy, 10, 159-170. [1998]
Teglasi, H., & Rothman, L. (2001). STORIES: A classroom-based program to reduce aggressive behavior.
Journal of School Psychology, 39, 71-94. [5064]
Vickery, S. A. (1982). Stress inoculation for anger control in children (Doctoral dissertation, University of
South Carolina, 1981). Dissertation Abstracts International, 42(12), 4945. (University Microfilms
No. AAT 8212268 ) [5026]
Voelm, C. E. (1984). The efficacy of teaching rational emotive education to acting-out and socially
withdrawn adolescents (Doctoral dissertation, California School of Professional Psychology,
Fresno, 1983). Dissertation Abstracts International, 44(12), 3947. (University Microfilms No. AAT
8402501 ) [5049]
Zashin, M. (1981). Prosocial behavior training programs: Modeling, role-playing, and training in verbal selfinstruction as techniques for teaching prosocial behaviors to groups of behaviorally disturbed preadolescent children (Doctoral dissertation, University of Texas at Austin, 1981). Dissertation Abstracts
International, 42/3-B, 1199. (University Microfilms No. AAT81-19403) [3352]
Appendix
Tables of Coded Variables by Study
31
32
Random Informant/Source
Assignment
of DV
Yes
Yes
Yes
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
No
Yes
Yes
No
No
Yes
Yes
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
No
Yes
Yes
Yes
No
No
archive
teacher report
teacher report
teacher report
teacher report
self-report
archive
parent report
teacher report
teacher report
teacher report
self-report
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
archive
teacher report
teacher report
self-report
observation
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
teacher report
observation
teacher report
Pretest
% Attrition
Adjustment
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
None
3-10%
None
> 10%
None
None
> 10%
> 10%
> 10%
None
> 10%
3-10%
None
None
> 10%
3-10%
> 10%
None
None
None
3-10%
None
> 10%
> 10%
None
None
> 10%
> 10%
None
3-10%
None
3-10%
None
3-10%
None
> 10%
# items
in DV
ES
Estimated
1 item
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
1 item
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
1 item
1 item
> 5 items
> 5 items
> 5 items
2-5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
2-5 items
Yes
No
No
No
No
Yes
No
No
No
Yes
No
No
No
No
No
Yes
No
No
No
No
No
No
No
No
No
No
Yes
Yes
No
No
No
No
No
No
No
No
# ES
Aggregated
2
3
1
1
2
2
3
1
1
1
1
2
1
1
1
1
1
1
1
2
6
1
3
1
1
1
1
1
2
1
1
1
1
1
1
4
continued
33
Rascucci, 1991
Rosengren, 1987
Schechtman, 2000
Scheckner & Rollin, 2003
Sharp, 2004
Stainback, 1986
Sukhodolsky, et al., 2000
Teglasi & Rothman
Vickery, 1982
Voelm, 1984
Zashin, 1981
Random Informant/Source
Assignment
of DV
No
No
Yes
Yes
No
Yes
Yes
Yes
Yes
Yes
No
archive
self-report
teacher report
teacher report
archive
teacher report
teacher report
teacher report
observation
teacher report
teacher report
Pretest
% Attrition
Adjustment
Yes
Yes
Yes
No
No
Yes
No
No
Yes
Yes
Yes
None
> 10%
3-10%
3-10%
> 10%
None
None
3-10%
None
> 10%
3-10%
# items
in DV
ES
Estimated
> 5 items
> 5 items
> 5 items
> 5 items
2-5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
> 5 items
No
No
No
No
No
No
No
No
No
Yes
No
# ES
Aggregated
1
1
2
1
1
1
1
1
1
2
2
34
Country
USA
USA
Canada
USA
USA
India
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
USA
Australia
USA
USA
USA
Canada
Finland
USA
USA
USA
Israel
USA
USA
Published?
Yes
No
No
Yes
No
Yes
No
No
Yes
Yes
No
Yes
Yes
Yes
No
No
No
No
No
No
No
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
No
Yes
Yes
Yes
Yes
No
No
Yes
Yes
No
Subject Risk
indicated
indicated
general
at-risk
indicated
indicated
indicated
indicated
indicated
indicated
indicated
at-risk
at-risk
at-risk
at-risk
indicated
indicated
indicated
indicated
at-risk
indicated
at-risk
indicated
indicated
indicated
indicated
indicated
at-risk
at-risk
at-risk
at-risk
general
indicated
indicated
indicated
indicated
indicated
indicated
indicated
indicated
indicated
% male
60-90% male
60-90%
50-50
60-90% male
60-90% male
all male
50-50
all male
all male
all male
all male
50-50
50-50
50-50
60-90% male
all male
60-90% male
all male
all female
60-90% male
50-50
60-90% male
60-90% male
all male
all male
all male
50-50
50-50
60-90% male
50-50
all male
50-50
50-50
60-90% male
all male
60-90% male
all male
60-90% male
60-90% male
50-50
60-90% male
Age
14.5
13
11.6
8.41
13.5
16
12.5
7
6.8
12
10.5
12
10.4
10.23
7.3
10.5
8.5
6
6
7.68
13.9
12.1
10
9.5
11
11
9
9
7.65
10
9.9
14.5
10.5
9.2
8.3
9.37
12.5
15.3
12.5
10
12
Low SES?
No
No
No
No
No
No
No
Yes
No
No
Yes
No
No
No
No
Yes
No
Yes
Yes
No
Yes
Yes
Yes
Yes
Yes
No
Yes
Yes
No
Yes
Yes
Yes
No
No
No
No
Yes
No
Yes
Yes
No
continued
35
Country
USA
USA
USA
USA
USA
USA
Published?
No
Yes
Yes
No
No
No
Subject Risk
at-risk
at-risk
at-risk
indicated
indicated
at-risk
% male
60-90% male
all male
60-90% male
60-90% male
60-90% male
60-90% male
Age
13.5
10
9.5
9
14
9.19
Low SES?
No
No
Yes
No
No
No
36
Type of school/class
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Special
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Special
Delivery personnel
Researcher
Researcher
Researcher
Mixed (research affiliated)
Mixed (research affiliated)
Researcher
Mixed (research affiliated)
Researcher
Svc. Professional
Svc. Professional
Researcher
Mixed (research affiliated)
Grad student
Grad student
Svc. Professional
Researcher
Grad student
Svc. Professional
Svc. Professional
Researcher
Researcher
Grad student
Mixed (research affiliated)
Mixed (research affiliated)
Svc. Professional
Svc. Professional
Grad student
Grad student
Grad student
Researcher
Svc. Professional
Svc. Professional
Researcher
Svc. Professional
Grad student
Mixed (research affiliated)
Individual
Component
No
No
No
No
No
No
No
Yes
No
Yes
No
No
No
No
No
No
No
No
No
No
No
No
Yes
No
No
No
Yes
Yes
No
No
No
No
No
No
No
No
Duration
(weeks)
18
9
10
10
12
8
30
16
8
6
8
9
6
8
14
6
10
23
23
8
5
50
68
60
12
18
17
17
14
5
8
4
10
15
4
25
Implementation
Problems?
No
No
No
No
Yes
No
No
Yes
No
No
No
No
No
Yes
Yes
No
No
No
No
No
Yes
No
Yes
No
No
No
No
No
No
No
No
No
No
Yes
No
No
continued
37
Type of school/class
Special
Regular
Special
Regular
Regular
Regular
Regular
Regular
Regular
Regular
Special
Delivery personnel
Researcher
Mixed (research affiliated)
Grad student
Svc. Professional
Researcher
Mixed (research affiliated)
Researcher
Researcher
Researcher
Researcher
Grad student
Individual
Component
No
No
Yes
Yes
No
No
No
No
No
No
No
Duration
(weeks)
5
5
10
8
6
4
10
15
3
10
5
Implementation
Problems?
Yes
No
No
No
No
No
No
No
No
Yes
No