Escolar Documentos
Profissional Documentos
Cultura Documentos
LOIS A. BENISHEK*
Temple University
CATHERINE M. HAYES
*Direct all correspondence to: Lois A. Benishek; Counseling Psychology Program; 270-B Weiss Hall (265-63);
1701 N. 13th Street; Temple University; Philadelphia, PA 19122-6085 < lbenishek@aol.com>.
JOURNAL OF SUBSTANCE ABUSE, Volume 10, pages 103-114.
Copyright 1998 by Ablex Publishing Corporation
All rights of reproduction in any form reserved.
ISSN: 0899-3289
104
105
reflect best the nine primary symptom dimensions" (Derogatis and Melisaratos, 1983; p.
596). Furthermore, the identical scales between the two questionnaires correlate .92 or
greater (Derogatis and Melisaratos, 1983).
To date, only three principal components factor analyses and one confirmatory factor
analysis have been completed on the BSI. The seminal investigation was completed by
Derogatis with the data for these analyses obtained from a general outpatient clinical
sample (N =1,002; Derogatis and Melisaratos, 1983; Derogatis and Spencer, 1982). Overall, this analysis produced results that clearly replicated seven of the nine expected factors.
The last two factors were not reproduced as consistently as the first seven. The eighth
factor (i.e., anxiety) split into panic anxiety and nervous tension components. Overall, the
ninth factor showed poor psychometric properties and was in need of further revision. The
nine factors accounted for 44% of the explained variance.
These results were not replicated in the two subsequent principal components analysis
and the confirmatory factor analysis completed on the BSI. Only two factors emerged from
the analysis completed by Boulet and Boss (1991), accounting for 71% and 5.9% of the
explained variance, respectively. Only 29 of the 49 items correlated as expected with their
hypothesized scales. Furthermore, the dimensions were highly correlated with each other
(range = .55 to .80). More recently, a single factor was identified by Piersma (1994b).
Results from the confirmatory factor analysis conducted by Hayes (1997) on a sample of
treatment-seeking college and university students resulted in the identification of a
six-factor solution.
How does one make sense of the great variation in the number of factors identified from
the SCL-90-R and the BSI, and what are the implications for the BSI? One possible explanation is that these instruments are simply deficient in their ability to assess the nine
hypothesized factors. An alternative explanation is that the discrepancies of the factor
structure may be a result of sample differences. The SCL-90 was developed on a psychiatric outpatient sample, and its nine-factor structure has not been identified consistently
across a variety of clinical populations. For example, four-, six-, nine-, and twelve-factor
solutions were identified among a variety of inpatient and outpatient populations (Brophy
et al., 1988; Evenson et al., 1986; Hafkensheid, 1993). These findings lend credence to the
idea that different clusters of symptoms may be expressed in different treatment populations (Hafkensheid, 1993; Schwarzwald et al., 1991). They also support the importance of
examining further the factor structure among more homogeneous inpatient and outpatient
populations (Holcomb et al., 1983; Shutty et al., 1986).
In conclusion, serious questions are being raised about the proposed nine dimensions of
the BSI and the SCL-90-R by a number of independent researchers. As stated previously,
the BSI represents a short form of the SCL-90-R, an instrument which has not demonstrated factor invariance (e.g., Cyr et al., 1985). Further, a different measurement model for
the SCL-90-R was demonstrated for substance abusers (Carpenter and Hittner, 1995).
Little evidence exists for the BSI's factor structure in general and no study has specifically
focused on the BSI's factor structure for substance abusers. The purpose of this study was
to examine the psychometric properties of the BSI and to attempt to confirm its factor
structure on data derived from a large sample of substance abusers.
The factor structure of the BSI was examined in the following fashion. First, the coefficient alpha estimates and interscale correlations were examined to evaluate the internal
consistency reliability of each scale and identify problematic items. Second, principal axis
106
factor analyses (PAF) were completed to explore the underlying factor structure and to
generate alternative models. Third, these alternative models along with two nine-factor
models (one with uncorrelated factors and one with correlated factors) were then submitted
to confirmatory factor analyses. The confirmatory factor analyses were completed on data
derived from a second, independent sample of substance abusers.
METHOD
Participants
Participants consisted of 909 adult clients (73% men; 27% women) receiving substance
abuse treatment. The average age of the participants was 31 years. Fifty-three percent of
the sample were white, 44% were black, and 3% represented other ethnic backgrounds.
Thirty percent had less than a high school education (M = 11.8 years). Approximately half
of the sample (53%) were employed full-time, 17% part-time, and 22% were unemployed;
other participants identified themselves as retired (2%) or as students (3%). With regard to
treatment relevant characteristics, 50% of the participants entered outpatient treatment
programs, whereas 7% received 30-day residential treatment and 43% received treatment
at residential programs lasting longer than 30 days. The substance identified as the major
problem for participants was a combination of alcohol and drugs (41%), alcohol (30%),
cocaine (17%), a combination of drugs (7%), cannabis (3%), and other drugs (2%). This
was the first substance abuse treatment experience for 57% and 60% of the participants
requesting treatment for alcohol use and drug use, respectively. Treatment was prompted
by the criminal justice system for 38% of the sample; 36% were on probation or parole at
the time of the assessment. Participants reported significant periods of time in the 30 days
prior to treatment in which they experienced serious depression, anxiety/tension, and
violent behavior (46%, 49%, and 14% of the participants, respectively).
Procedures
Participants were contacted at the time they requested services at a substance abuse
treatment program and asked to participate in the study. Efforts were made to ensure that
data were collected after the initial request for services and prior to completing the initial
counseling session. The study was explained to participants and informed consent was
obtained during this meeting. Individuals who were less than 18 years of age were
excluded from the study.
A battery of questionnaires and interviews designed to provide a broad-based picture of
life and psychological functioning was completed by each participant. Only information
obtained from the Brief Symptom Inventory (BSI) and demographic information is
presented here. Participants were paid $10.00 for completing the assessment battery.
Measures
BRIEF SYMPTOM INVENTORY
The Brief Symptom Inventory (BSI) is a multi-dimensional self-report measure of
psychological distress (Derogatis and Melisaratos, 1983). The 53-item questionnaire is
107
answered using a five-point Likert scale (0 = Not at all; 4 = Extremely) with regard to the
individual's psychological functioning in the past seven days. Higher scores indicate
greater psychological distress.
The BSI is designed to assess nine types of psychopathology. Forty-nine of the items are
hypothesized to measure one of the following dimensions: somatization, obsessive-compulsive behavior, interpersonal sensitivity, depression, anxiety, hostility, phobic
anxiety, paranoid ideation, and psychoticism. Four additional items correlate highly on
more than one factor and, thus, are included in the measure (Derogatis and Spencer, 1982).
The correlations of the BSI dimensions with like dimensions contained in its parent instrument, the SCL-90-R, range from .92 to .99 (Derogatis and Spencer, 1982).
The BSI also yields three global indices of overall psychological functioning. Only the
most sensitive (i.e., accurate) of the three indices, the General Severity Index (GSI; Derogaffs and Spencer, 1982), was used in this study so that the relationship among the 9 BSI
scales could be compared with a global indicator of psychopathology. GSI scores range
from 0 to 4 with higher scores indicating greater severity. The GSI represents a combination of the number of symptoms and their intensity level.
The internal consistency reliability estimates for the subscales range from .70 (phobic
anxiety) to .89 (depression: Boulet and Boss, 1991; Broday and Mason, 1991; Derogatis
and Spencer, 1982). Test-retest reliability estimates range from .68 (somatization) to .91
(phobic anxiety) over a two-week time frame for the nine dimensions and .90 for~the GSI
(Derogatis and Spencer, 1982).
Results
A random split procedure was used to generate the two samples necessary to conduct the
principal axis factor analyses (n I = 440) and the confirmatory factor analyses (n 2 = 456).
The samples did not differ significantly from each other in gender, age, race, religious preference, educational level or with regard to the scores obtained on the nine BSI dimensions
and the GSI.
108
3.5% of the explained variance, respectively. As a result of these preliminary findings, the
analyses were completed again, this time forcing both a one- and a two-factor solution.
The loadings associated with the one-factor solution ranged from .37 to .75 (M = .58).
This factor accounted for 32% of the explained variance and appeared to be a measure of
global psychological distress.
For the two-factor model, the loadings ranged from .21 to .89 (M = .58) for the first
factor and from .36 to .71 (M - .49) for the second factor. The model accounted for 43% of
the explained variance. Again, the first factor appeared to be assessing global emotional
distress. The second factor, however, consisted mainly of items from the Somatization,
Anxiety, and Phobic Anxiety scales. This factor appeared to be a measure of somatic
distress. The two factors correlated .66 with each other and, thus, accounted for 44% of the
shared variance.
A total of five models were selected to be submitted to confirmatory factor analyses.
Two of these models were explicitly generated from the PAFs. The one-factor model
(Model 1) was retained given the amount of variance explained by this model. The
two-factor model (Model 2) was also selected because of: (a) the presence of only seven
co-loadings between the factors and (b) the conceptual clarity of this model. Given that the
nine sub-scales were so highly correlated with each other, a second-order model (Model 3)
was selected in order to determine if a single higher-order factor was accounting for a
significant amount of the covariances among the first-order factors. Finally, Derogatis's
original nine-dimensional model (i.e., Model 4: assuming uncorrelated factors as the developers initially proposed) and Derogatis's nine-dimensional model (i.e., Model 5: assuming
correlated factors as this data set suggests) were also submitted to a confirmatory factor
analysis.
109
TABLE 1
Zz
df
CFI
AGFI
PGFI
AIC
RMR
Null Model
! 4590
1176
--
--
--
13302
--
Model 1
(1 -Factor)
4157
1126
0.77
0,66
0.61
1905
0.06
Model 2
(2-Factor)
3961
1118
0.79
0,68
0.33
1725
0.06
Model 3
(2nd-Order)
3472
1109
0.82
0.72
0.37
1254
0.06
Model 4
(D-orthog)
6915
1118
0.57
0.46
0.33
4679
0.37
Model 5
(D-nonorthog)
3289
1082
0.84
0.73
0.19
1125
0.05
n2 = 456. CFI = Comparative Fit Index; AGFI = Adjusted Goodness-of-Fit Index; PGFI = Parsimonious Goodness-of-Fit Index;
AIC = Akaike Information Criterion; RMR = Root Mean Square Residual. D-orthog = Derogatis's original model assuming
orthogonal dimensions; D- non-orthog = Derogatis's model assuming non-orthogonal dimensions.
TABLE 2
Original Factor
Factor I Standardized
Factor Loadings
Par
Dep
Psy
Obs
Obs
Obs
Hos
Psy
Int
Hos
Dep
Dep
Anx
Int
Som
Hos
Psy
Som
Pho
Som
Dep
Hos
Par
Anx
Pho
.79
.77
.76
.74
.74
.73
.73
.72
.72
.71
.71
.70
.70
.70
.70
.70
.70
.69
.69
.69
.69
.68
.67
.64
.64
(continued)
110
TABLE 2
Continued
BSl Items
Self-conscious
Nervousness/shakiness
Feeling restless
Trouble remembering
Uneasy in crowds
Not feeling close to others
People can't be trusted
Feeling watched or talked about
Spells of terror or panic
Afraid in open spaces
Hot or cold spells
Trouble getting your breath
Uncontrollable temper outbursts
Thoughts of ending your life
Faintness/dizziness
People are unfriendly or dislike you
Afraid to travel on buses, etc.
Mind goes blank
Feeling worthless
Heart/chest pains
Difficulty making decisions
Others to blame for your troubles
Feeling tense
Others control your thoughts
Original Factor
Factor I Standardized
Factor Loadings
Int
Anx
Anx
Obs
Pho
Psy
Par
Par
Anx
Pho
Sore
Som
Hos
Dep
Sore
Int
Pho
Obs
Dep
Som
Obs
Par
Anx
Psy
.63
.62
.62
.61
.60
.60
.59
.59
.58
.57
.57
.56
.54
.53
.53
.53
.51
.51
.51
.49
.49
.46
.44
.39
Som = Somatization; Obs = Obsessivecompulsive; Int = Interpersonalsensitivity; Dep = Depression;Anx = Anxiety; Hos = Hostility; Pho ffi Phobic anxiety; Para = Paranoid ideation; Psy = Psychoticism.
DISCUSSION
The purpose of this study was to critically evaluate the factor structure underlying the Brief
Symptom Inventory (BSI), a commonly used questionnaire designed to assess psychological distress. The hypothesized nine dimensions of the BSI were not supported via either
exploratory or confirmatory factor analyses. Although the one-factor model was the best
among all those tested in this study, this model (as well as the other models) was clearly
lacking in explanatory power. The goodness-of-fit indices all pointed to serious measurement deficiencies in the BSI.
The one factor structure identified in the present study is quite different from the vast
majority of earlier results which identified no fewer than three and typically as many as
nine factors. One possible explanation for this discrepancy is that, although the number of
factors found in this study is strikingly different from those identified in other studies, the
large amount of variance accounted for by the first factor in comparison to the second and
subsequent factors is similar throughout much of this body of research (e.g., Bonynge,
1993; Boulet and Boss, 1991; Brophy et al., 1988; Carpenter and Hittner, 1995; Cyr et al.,
1985; Hafkensheid, 1993). Furthermore, attempts to find support for the convergent valid-
Brief SymptonInventory
111
ity of the BSI subscales have been disappointing (e.g., Boulet and Boss, 1991). Taken as a
whole, these findings provide consistent support for the one-factor solution (i.e., global
distress) found in this study and highlights the BSI's inability to differentiate among nine
different types of psychological symptomatology. This finding is particularly important
given that researchers continue to use the BSI scales to evaluate the validity of other
psychological measures (e.g., Osman, 1995; Pincus, 1995). The goodness-of-fit indices,
however, clearly support the one-factor model for this sample over the two-factor model.
Although the results of this study certainly do not identify a nine-dimensional model, it
is important to note that there is a certain degree of conceptual support for a two-factor
solution. The two-factor model examined in this study was somewhat similar to a model
identified by Shutty and his colleagues (1986). They conducted a second-order CFA on the
SCL-90 after noting the high intercorrelations among the scales. In addition to identifying
a large factor associated with global distress, they identified three additional factors, one of
which was described as somatic anxiety. The two factors underlying Model 2 in this study
also appear to be measures of global distress and somatic anxiety.
A second possible explanation for the differences found in this study in comparison to
others' results centers around the fact that it was conducted on a sample of substance abusers and not on a more general clinical population such as was used by Derogatis. This
explanation, however, is unlikely given that the large amount of variance accounted for by
this first factor remains high across a variety of homogeneous (e.g., Boulet and Boss, 1991)
and heterogeneous (e.g., Hafkensheid, 1993) clinical populations.
A third possible explanation for the one factor solution identified in this study is the
degree of distress reported by the participants upon entering a substance abuse treatment
program. Although none of the participants were involved in the detoxification process at
the time they were assessed, the circumstances under which they entered treatment may
have affected their responses to the content of the BSI. About a third of the sample was
seeking treatment as a result of their interactions with the criminal justice system. As a
result, these participants may have denied high levels of distress. Such a response bias
would explain why the average scale scores were not inordinately high. Given that this
sample's average scores for the nine dimensions and the GSI were similar to the average
scores reported for the normative BSI clinical groups, this explanation does not seem
plausible.
Finally, further support of the one-factor solution is indicated by the fact that the results
were consistent across two different types of factor analyses conducted on two independent
samples of substance abusers.
Having highlighted a number of assessment-related issues and concerns, the practical
implications of using the BSI to better understand and treat substance abusers must also be
addressed. A key question that emerges as a result of these findings is: Should researchers
and clinicians continue to use the nine BSI dimensions? The results of this study provide
strong empirical evidence that caution should be exercised when using the individual BSI
scales. The specific subscales appear to be of highly limited utility in their present form.
This being the case, one should not assume that the BSI results provide unique information
about the client's degree of distress on each of the nine sub-scales.
This is not to say that the BSI cannot provide clinically useful information. Derogatis and
Spencer (1982) suggest that the BSI be interpreted on three different levels--at a global
level, a dimensional level, and a discrete symptom level. The results of this study suggests
112
that the discrete symptom level and the global level of interpretation are useful. Clinicians
can examine the individual BSI items (i.e., discrete symptom level) and directly discuss
those highly rated items with their clients during the counseling session. By attending to
clients' responses to specific BSI items, clinicians will be exhibiting more ethical behavior
and may obtain information that could be crucial for identifying the need for immediate
intervention or long-term treatment planning.
In addition, research on the BSI and its predecessors suggests that the GSI score (i.e.,
global level) is a good overall indicator of emotional distress. Royse and Drude (1984)
found the GSI to be a useful tool for distinguishing between more and less severe substance
abusers. Enhancing clinicians' ability to identify different subgroups of substance abusers
has important implications for improving the client-treatment matching process which is
increasingly important given managed care's focus on accountability issues. The GSI can
also be re-assessed throughout the counseling process in order to evaluate change or treatment outcome.
Researchers and clinicians alike may obtain more accurate information by completing a
more comprehensive assessment procedure. This process might include other questionnaires (e.g., MMPI-2) and semi-structured interviews (e.g., Addiction Severity Index).
When using the BSI alone for clinical or research purposes one must question whether the
savings in time and labor is worth the loss of information regarding the nine proposed
symptom dimensions.
ACKNOWLEDGMENTS:
REFERENCES
Alterman A, McLellan A. Shifman R: Do substance abuse patients with more psychopathology
receive more treatment? J Ner M Dis 181: 576-582,1993.
Bech P, Allerup P, Maier W, Albus M, Lavori P, Ayuso J: The Hamilton Scales and the Hopkins
Symptom Checklist (SCL-90): a cross-national validity study in patients with panic disorders.
Brit J Psychi 160:206-211, 1992.
Bentler P, Wu E: EQS/Windows Users Guide: Version 4. Los Angeles, CA, BMDP Statistical Software, 1993.
Bonynge E: Unidimensionality of SCL-90-R scales in adult and adolescent crisis samples. J Clin
Psych 49(2): 212-215, 1993.
Boulet J, Boss M: Reliability and validity of the Brief Symptom Inventory. Psych Assess 3(3): 433437, 1991.
Broday S, Mason J: Internal consistency of the Brief Symptom Inventory for counseling-center clients. Psych Rep 68: 94, 1991.
Brophy C, Norvell N, Kiluk D: An examination of the factor structure and convergent and discriminant validity of the SCL-90R in an outpatient clinic population. J Pers Assess 52(2): 334--340,
1988.
Carpenter K, Hittner J: Dimensional characteristics of the SCL-90-R: evaluation of gender differences in dually diagnosed inpatients. J Clin Psych 51 (3): 383-390, 1995.
113
Carscaddon D: Predicting psychiatric symptoms in rural community mental health clients. Psych
Rep 66(2): 561-562, 1990.
Clark A, Friedman M: Factor structure and discriminant validity of the SCL-90 in a Veteran psychiatric population. J Pers Assess 47(4): 396--404, 1983.
Cyr J, McKenna-Foley M, Peacock E: Factor structure of the SCL-90R: is there one? J Pers Assess
49: 571-578, 1985.
Derogatis L, Melisaratos N: The Brief Symptom Inventory: an introductory report. Psych Med 13:
595--605, 1983.
Derogatis L, Spencer P: Administration and Procedures: BSI Manual - 1. Baltimore, MD, Clinical
Psychometric Research, 1982.
Donat D: Millon Clinical Multiaxial Inventory (MCMI) clusters for alcohol abusers: further evidence of validity and implications for medical psychotherapy. Med Psychother, 1: 41-50, 1988.
Evenson R, Holland R, Mehta S, Yasin F: Factor analysis of the symptom checklist-90. Psych Rep
46: 695-699, 1980.
Hafkensheid A: Psychometric evaluation of the Symptom Checklist (SCL-90) in psychiatric inpatients. Pers lndiv Diff 14(6): 751-756, 1993.
Harvey E: History of sexual assault and the treatment of substance abuse disorders. J Psychoact
Drugs 36(4): 361-367, 1994.
Hayes J: What does the Brief Symptom Inventory measure in college and university counseling centers? J Couns Psych 44: 360-367, 1997.
Holcomb W, Adams N, Ponder H: Factor structure of the Symptom Checklist-90 with acute psychiatric inpatients. J Con Clin Psych 51(4): 535-538, 1985.
James W, Moore D, Hastings J: Treatment of chemically dependent adolescents in an alternative
high school setting. Alc Tx Quart, 12(3): 111-120, 1995.
Loza W: Different substance abusing offenders require a unique program, lnt J Off Ther Compar
Crim 37(4): 351-358, 1993.
Marija J. Norusis/SPSS, Inc: SPSS Base System User's Guide. Chicago, IL, PSS, Inc, 1990.
MoMoffett L, Radenhausen R: Assessing depression in substance abusers: Beck Depression Inventory and SCL-90R. Addict Beh 15:179-181, 1990.
O'Connor L: The drug-of-choice phenomenon: psychological differences among drug users who
preferred different drugs. Int JAddict 30(5): 541-555, 1995.
Osman A: Systematic evaluation of psychometric properties of the Cognitive Checklist with college
students. Psych Rep 76(2): 523-528, 1995.
Pedhazur E, Schmelkin L: Measurement, Design, and Analysis: An Integrated Approach. Hillsdale,
N J, Erlbaum, 1991.
Pfost K, Newton R, Kunce J, Greenwood G, Cope C: A model for individualizing interventions for
alcohol abuse/dependence using basic personality dimensions. Special issue: Psychotherapy for
the addictions. Psychother 30(2): 334-343, 1993.
Piersma H: The Brief Symptom Inventory as an outcome measure for adolescent psychiatric inpatients. Assess 1(2): 151-157, 1993a.
Piersma H: Unidimensionality of the Brief Symptom Inventory (BSI) in adult and adolescent populations. J Pers Assess 63(2): 338-344, 1994b.
Pincus A: Social-emotional adjustment and interpersonal problems: A circumplex analysis of the
Weinberger adjustment typology. Assess 2(1): 65-80, 1995.
Ranter U, Leonard C, Swett C: SCL-90-R factor structure in an acute involuntary, adult psychiatric
inpatient sample. J Clin Psych 52: 625-629, 1996.
Royse D, Drude K: Screening drug abuse clients with the Brief Symptom Inventory. Int J Addict
19(8): 849-857, 1984.
Schwarzwald J Weisenberg M, Solomon Z: Factor invariance of SCL-90-R: the case of combat
stress reaction. Psych Assess 3(3): 385-390, 1991.
114