Escolar Documentos
Profissional Documentos
Cultura Documentos
PII S0022-4405(02)00093-6
Emilia C. Lopez
Queens College of The City University of New York, Flushing, NY, USA
The purpose of this study was to identify critical cross-cultural competencies for
school psychologists. This study used a Delphi procedure to bring together the
expertise of a national sample of cross-cultural experts, including school psychology
practitioners, faculty, and supervisors/administrators of whom 62% represented a
racial/ethnic minority group member. To identify the competencies, we conducted
an extensive literature search about cross-cultural school psychology competencies
then used a questionnaire to ask expert panelists to rate the importance of the
literature based competencies and to delineate additional competencies not re-
presented in the integrated literature but based on expert opinion. The literature
yielded 185 competencies and the panelists generated 75 additional competencies.
Following the second questionnaire round, 102 competencies were identified as
critical cross-cultural competencies. The 102 competencies cover 14 major domains
of professional activities and practices for school psychologists (e.g., Academic
Interventions, Assessment, Consultation, Counseling, Culture, Language, Laws and
Regulations, Organizational Skills, Professional Characteristics, Report Writing,
Research Methods, Theoretical Paradigms, Working with Interpreters, and Working
with Parents). Implications for research and training are discussed. D 2002 Society
for the Study of School Psychology. Published by Elsevier Science Ltd
115
116 Journal of School Psychology
expert opinion, the aim was to obtain a comprehensive picture of the cross-
cultural competencies most important to the successful delivery of a wide
spectrum of school psychological services.
METHOD
Participants
The national pool of potential Delphi panelists consisted of school psy-
chologists identified for participation because of their active contributions
to and expertise within the field of cross-cultural school psychology (see
Procedure). Of the 65 Delphi panelists invited to participate, 34 (52%)
responded to the first round of questionnaires and 24 (71%) of the first
round respondents completed the second round of the questionnaire. The
final pool of panelists included 12 (50%) males and 12 (50%) females.
There were 9 (38%) Caucasian, 9 (38%) Hispanic/Latino, 2 (8%) African-
American, 2 (8%) Asian American, and 2 (8%) Native American Indian
panelists. The majority (N=20, 83%) of panelists held a doctoral degree,
1 (4%) panelist had completed post doctoral work, and 3 (13%) panelists
held a specialist degree in school psychology. Most panelists (N=13, 54%)
were faculty members, 9 (38%) were practicing school psychologists, 1 (4%)
was a supervisor and administrator of psychological services, and another
1 (4%) was an administrator of school psychological services. The panelists
came from 14 different states in the U.S. and were geographically dispersed:
9 (38%) were from the northeast, 6 (25%) were located in the midwest,
4 (17%) from the west, 4 (17%) from the southwest, and 1 (4%) located in
the southeast. Further information regarding the participating panelists’
expertise is discussed in the Results section.
Instrumentation
In the present study, the format of the questionnaires and the statistical
analysis employed were patterned after Delphi studies conducted by
Cannon, Idol, and West (1992) and West and Cannon (1988). A Delphi
questionnaire was designed and administered in two rounds. The question-
naire used in Round 1 was comprised of two parts: a background section
and the cross-cultural school psychology competency questionnaire. The
background section contained 12 questions about demographic character-
istics (e.g., gender, race/ethnicity), primary professional position, relevant
professional contributions and products (e.g., publications, presentations,
committee work), total years of experience working with culturally and
linguistically diverse clients, professional activities involving cross-cultural
populations, and self-perceived areas of cross-cultural expertise.
120 Journal of School Psychology
Gutkin & Reynolds, 1990; Assessment of Children, Sattler, 1988; Best Practices in
School Psychology, Thomas & Grimes, 1985; Best Practices in School Psychology II,
Thomas & Grimes, 1990; Best Practices in School Psychology III, Thomas &
Grimes, 1995; Best Practices in Assessment for School and Clinical Settings, Vance,
1993) were located and chapters that contained relevant content were
identified and reviewed. Finally, published regulatory standards and pro-
fessional guidelines were also consulted (e.g., Standards for Educational and
Psychological Testing, AERA, APA, & NCME, 1985; Guidelines for Providers of
Psychological Services to Ethnic, Linguistic, and Culturally Diverse Populations,
APA, 1991; Ethical Principles of Psychologists and Code of Conduct, APA, 1992;
Principles for Professional Ethics, NASP, 1992).
The first phase of the literature review served as the basis for the second
phase of the literature review. Our examination of the school psychology
literature led us to seek out and find original sources from clinical psy-
chology, counseling psychology, interpreters, multicultural education,
measurement, and second language development. The search for original
sources from these related disciplines was conducted to clarify and verify
information and concepts found in the school psychology literature. For
every source examined in both phases of the literature review, there was
100% agreement between the study’s co-authors that the source addressed
competencies relevant to racially, ethnically, culturally, and linguistically
diverse populations.
in the literature. Redundant items were eliminated from the final pool
of items.
Fourteen major categories of cross-cultural competencies emerged from
the text from each article, chapter, and book. In defining the categories,
the goal was to provide maximal coverage of the competencies delineated
in the literature. These major categories of competencies reflected not
only the major functions of school psychologists (i.e., assessment, consul-
tation, interventions, research methods; Fagan & Sachs Wise, 1994) but
also addressed competencies suggested in the literature as being needed
when working with specific groups (e.g., interpreters, parents, organiza-
tions) or competencies regarding specific areas of professional expertise
(e.g., culture, language, laws and regulations, professional characteristics,
report writing, theoretical paradigms). The 14 categories representing the
major domains of cross-cultural school psychology competencies included
Academic Interventions, Assessment, Consultation, Counseling, Culture,
Language, Laws and Regulations, Organizational Skills, Professional Char-
acteristics, Report Writing, Research Methods, Theoretical Paradigms,
Working with Interpreters, and Working with Parents. In defining the
categories it was not possible to create a classification scheme that was
entirely mutually exclusive as knowledge and skills relevant to one area of
expertise and one category were sometimes also related to another area
(e.g., competencies about the need to be aware of the impact of language
differences may pertain to the Professional Characteristic domain as well as
to the Language category). Therefore, in some instances, the content of
the categories were similar. The individual items were assigned to one of
the 14 competency categories. To determine the best fit between each item
and its corresponding category, two raters who were blind to the purpose
of the study independently classified the competencies into the categories.
Interrater agreement was calculated as number of agreements that an item
qualified as one of the categories divided by agreements plus disagree-
ments. Interrater agreement was 0.81. Using these procedures, 185 liter-
ature-derived items representing the 14 major categories of competencies
were developed.
In responding to the cross-cultural school psychology competency
questionnaire developed for Round 1, the panelists were instructed to
consider the critical knowledge and skills that a cross-culturally competent
school psychologist should have and rate the importance of each of the 185
competency items constructed from the literature. The 185 items were
scaled using a 5-point Likert scale ranging from very important (1) to very
unimportant (5). In addition to the 185 items, the questionnaire provided
additional space within each major category so that panelists could add
competencies that they considered to be critical that were not already
included in the existing items. That is, the questionnaire also included two
open-ended items per category (one for knowledge and one for skills) that
Rogers and Lopez 123
Procedure
Identification and selection of panelists. Participants in the study were
school psychologists who had expertise in the provision of psychological
services to racially, ethnically, culturally, and/or linguistically diverse pop-
ulations. The expertise of the panelists was defined in terms of professional
accomplishments in multiple domains of professional functioning relevant
to psychological service delivery with diverse clients. To qualify as a panelist
using this definition of expertise, each panelist met at least two of the
following five criteria: (a) was primary or secondary author of two or more
school psychology publications concerning racially, ethnically, culturally,
and linguistically diverse clients; (b) presented three or more presentations
on relevant cross-cultural topics at national school psychology conferences
(e.g., National Association of School Psychologists (NASP) and APA con-
ventions); (c) was a member or chair of an APA Division 16 (School
Psychology) or NASP committee about delivering services to racially,
ethnically, culturally, and linguistically diverse clients; (d) was employed
as a practicing or supervising school psychologist with at least 5 years
experience working primarily with racially, ethnically, culturally and/or
linguistically diverse populations; and (e) was employed as a school
psychology faculty member at a school psychology program that empha-
sized multicultural or bilingual training. Participants meeting at least two of
these criteria were considered to have expertise in providing school
psychology services to diverse populations and cross-cultural competencies
because of their combined professional accomplishments (i.e., publica-
tions, presentations, extended work experience, relevant committee work,
relevant faculty experience) and therefore eligible as an expert panelist.
To qualify as a panelist using the ‘author’ criteria, the author was a
primary or secondary author of two or more school psychology publications
124 Journal of School Psychology
(i.e., journal articles, books, book chapters) concerned with racially, ethni-
cally, culturally, and linguistically diverse clients during the 1990 – 1995
period. The publication outlets included major school psychology journals
(i.e., Journal of School Psychology, Psychology in the Schools, School Psychology
Quarterly, School Psychology Review), relevant book chapters in a major school
psychology text (e.g., Best Practices in School Psychology III, Thomas & Grimes,
1995; Handbook of School Psychology, Gutkin & Reynolds, 1990), or relevant
books. Authors were identified by two members of the research team who
independently reviewed the contents of these publications for work in which
cross-cultural themes were the major focus or persons from diverse racial/
ethnic, cultural, or linguistic groups within the U.S. were the major focus.
Interrater agreement for identifying relevant publications/authors was
calculated as number of agreements divided by agreements plus disagree-
ments. Interrater agreement for this analysis was 0.96.
To qualify as a panelist using the ‘presenter’ criteria, panelists made
three or more relevant presentations at NASP or APA conferences
during the period 1990 – 1995. Two members of the research team
independently examined all APA and NASP convention programs pub-
lished 1990 – 1995 for relevant presentations sponsored by Division 16
(APA) and NASP. Interrater agreement for identifying relevant presenta-
tions/presenters was calculated as number of agreements divided by
agreements plus disagreements. Using this procedure, interrater agree-
ment was 0.98.
Potential panelists who were considered for participation in the study
because they were either practicing or supervising school psychologists
were identified through a nomination procedure. To identify the nomi-
nators, individuals who met two criteria for panel selection (e.g., author of
two or more relevant articles, book chapters or books, member of relevant
APA Division 16 or NASP committee) were contacted in writing. The
nominators were asked to identify school psychology practitioners or
supervisors with at least 5 years of experience providing services to racially,
ethnically, culturally, or linguistically diverse populations. Once the practi-
tioners and supervisors were nominated, they were contacted and asked to
provide background information that they met at least two of the ‘exper-
tise’ criteria in order to qualify as a panelist. Those who met at least two
criteria were included in the pool of panelists.
The final criteria for membership as a panelist was faculty membership at
school psychology training programs that emphasized multicultural or
bilingual training. To identify these faculty, we used the findings from
previous research about school psychology programs that represented
exemplary models of multicultural training (Rogers, Martin, & Druckman,
1994). The faculty members were nominated as ‘experts’ in multicultural
research by the participants in the Rogers et al. (1994) study and were
employed at the 17 doctoral and nondoctoral school psychology programs
Rogers and Lopez 125
examined in the Rogers et al. (1994) study. Using all of these procedures
for identifying panelists, we identified 128 school psychologists who met at
least two of the pre-established criteria. Out of that pool, a national sample
of 65 school psychologists were randomly selected as panelists for the
present study.
panelists. Using this procedure, 24 (71%) panelists from the first round
completed the second and final round of the questionnaire.
RESULTS
Panelists Expertise
The final pool of 24 panelists reported that the average number of years
they worked with diverse children, youth, and their families was 15.8.
Panelists indicated that they had cross-cultural expertise in a number of
different areas including cross-cultural interventions and counseling, bilin-
gual special education, cross-cultural assessment, and assessment of ELL
students. Table 1 contains a breakdown of the professional activities that
panelists reported being involved in about cross-cultural issues. The
activities that panelists engaged in most frequently were providing psycho-
logical services to diverse families or children/youth (100%), assessing
diverse children and youth (96%), delivering consultation services to a
diverse clientele (88%), and attending relevant conference presentations
(88%). The 24 panelists reported a range of involvement in cross-culturally
relevant professional activities from 2 activities to all 14 activities. The mean
number of activities per panelist was 10. This suggests that in addition to
Table 1
Panelists Professional Activities Involving Cross-Cultural School Psychology and Providing
Services to Racially, Ethnically, Culturally, and Linguistically Diverse Children
Activity N %
Panelists who indicated ‘Other’ included N = 1 led parent training classes in Spanish, N = 1
belonged to Asian Psychological Association, N = 1 developed a bilingual school psychology
training program.
Rogers and Lopez 127
DISCUSSION
Previous examinations of cross-cultural school psychology competencies
have not provided a comprehensive understanding of the knowledge
and skills school psychologists need when working with racially, ethni-
cally, culturally, and linguistically diverse individuals (Figueroa et al.,
1984; Gopaul-McNicol, 1997; Rosenfield & Esquivel, 1985). This study is
unique as the first to combine a qualitative methodology with empirical
procedures to identify literature-derived and expert-derived critical cross-
Rogers and Lopez 129
Table 2
The Most Important to Least Important Categories of Critical Cross-Cultural School
Psychology Competencies, Item Means and Standard Deviations
Round 2
Table 2
Continued
Round 2
Counseling (ranked 7)
Cross-culturally skilled school psychologists should have knowledge about:
22. differences that exist between counselor and client that can impact the 1.33 0.48
counseling relationship.
Cross-culturally skilled school psychologists should have skills about:
23. recognizing that helping styles and methods may be culture-bound 1.30 0.47
24. assessing acculturation of the client and responding to the client’s self- 1.29 0.46
presentation rather than the counselor’s inferred identity of the client.
Consultation (ranked 9)
Cross-culturally skilled school psychologists should have knowledge about:
28. cultural and linguistic factors that can influence the input, process, 1.37 0.49
and outcome of consultation.
Cross-culturally skilled school psychologists should have skills about:
29. working with LCD parents, children, and school staff 1.29 0.46
30. using a variety of data collection techniques for problem identification 1.33 0.48
and clarification, and planning and implementing interventions that are
culturally and linguistically sensitive
31. recognizing prejudice and prevalent obstacles that may effect 1.30 0.47
consultation (e.g., racism, sexism).
Table 2
Continued
Round 2
ACKNOWLEDGMENTS
REFERENCES
LaFromboise, T. D., Coleman, H. L. K., & Hernandez, A. (1991). Development and factor
structure of the Cross-Cultural Competency Inventory—Revised. Professional Psychology: Re-
search and Practice, 22, 380 – 388.
Light, R. J., & Pillemer, D. B. (1984). Summing up: The science of reviewing research. Cambridge,
MA: Harvard University.
Linstone, H. A., & Turoff, M. (1975). The Delphi method: Techniques and applications. Reading,
MA: Addison-Wesley.
Lynch, E. W., & Hanson, M. J. (Eds.). (1992). Developing cross-cultural competence: A guide for
working with young children and their families. Baltimore: Paul H. Brookes.
National Association of School Psychologists. (1992). Principles for professional ethics. Washington,
DC: National Association of School Psychologists.
National Association of School Psychologists. (2000). Standards for training and field placement
programs in school psychology. Bethesda, MD: National Association of School Psychologists.
Neville, H. A., Heppner, M. J., Louie, C. E., Thompson, C. E., Brooks, L., & Baker, C. E. (1996).
The impact of multicultural training on White racial identity attitudes and therapy com-
petencies. Professional Psychology: Research and Practice, 27, 83 – 89.
Ochoa, S. H., Rivera, B., & Ford, L. (1997). An investigation of school psychology training
pertaining to bilingual psycho-educational assessment of primarily Hispanic students:
Twenty-five years after Diana v. California. Journal of School Psychology, 35, 329 – 349.
Parham, T. (1993). White researchers conducting multicultural counseling research: Can their
efforts be ‘‘Mo better?’’ The Counseling Psychologist, 21, 250 – 256.
Ponterotto, J. G., Alexander, C. M., & Grieger, I. (1995). A multicultural competency checklist for
counseling training programs. Journal of Multicultural Counseling and Development, 23, 11 – 20.
Ponterotto, J. G., & Casas, J. M. (1991). Handbook of racial/ethnic minority counseling research.
Springfield, IL: Charles C Thomas.
Ponterotto, J. G., Rieger, B. T., Barrett, A., & Sparks, R. (1994). Assessing multicultural coun-
seling competence: A review of instrumentation. Journal of Counseling and Development, 72,
316 – 322.
Ponterotto, J. G., Sanchez, C. M., & Magids, D. M. (1991, August). Initial development and
validation of the Multicultural Counseling Awareness Scale (MCAS). Paper presented at the
American Psychological Association conference, San Francisco, CA.
Ridley, C. R., Mendoza, D. W., & Kanitz, B. E. (1994). Multicultural training: Reexamination,
operationalization, and integration. The Counseling Psychologist, 22, 227 – 289.
Rogler, L. H., Malgady, R. G., Costantino, G., & Blumenthal, R. (1987). What do culturally sen-
sitive mental health services mean? The case of Hispanics. American Psychologist, 42, 37 – 45.
Rogers, M. R., Hoffman, M., & Wade, J. (1998). Notable multicultural training in APA--
approved counseling psychology and school psychology programs. Cultural Diversity and
Mental Health, 4, 212 – 226.
Rogers, M. R., Martin, J., & Druckman, L. (1994, March). Model multicultural training in school
psychology programs: An examination of program philosophy and characteristics. Paper presented at
the National Association of School Psychologists conference, Seattle, WA.
Rogers, M. R., & Ponterotto, J. G. (1997). Development of the Multicultural School Psychology
Counseling Competency Scale. Psychology in the Schools, 34, 211 – 217.
Rogers, M. R., Ponterotto, J. G., Conoley, J. C., & Wiese, M. J. (1992). Multicultural training in
school psychology: A national survey. School Psychology Review, 21, 603 – 616.
Rosenfield, S., & Esquivel, G. B. (1985). Educating school psychologists to work with bilingual/
bicultural populations. Professional Psychology: Research and Practice, 16, 199 – 208.
Sattler, J. M. (1988). Assessment of children (3rd ed.). San Diego: Author.
Sodowsky, G. R., Kuo-Jackson, P. Y., Richardson, M. F., & Corey, A. T. (1998). Correlates of self-
reported multicultural competencies: Counselor multicultural social desirability, race, social
inadequacy, locus of control racial ideology, and multicultural training. Journal of Counseling
Psychology, 45, 256 – 264.
Rogers and Lopez 141
Sodowsky, G. R., Taffe, R. C., Gutkin, T. B., & Wise, S. L. (1994). Development of the Multi-
cultural Counseling Inventory: A self-report measure of multicultural competencies. Journal
of Counseling Psychology, 41, 137 – 148.
Sue, D. W., Arredondo, P., & McDavis, R. J. (1992). Multicultural counseling competencies and
standards: A call to the profession. Journal of Multicultural Counseling and Development, 20,
64 – 88.
Sue, D. W., Bernier, J. E., Durran, A., Feinberg, L., Pedersen, P., Smith, E. J., & Vasquez-Nuttall,
E. (1982). Position paper: Cross-cultural counseling competencies. The Counseling Psycholo-
gist, 10, 45 – 52.
Tarver Behring, S., & Ingraham, C. L. (1998). Culture as a central component of consultation:
A call to the field. Journal of Educational and Psychological Consultation, 9, 57 – 72.
Thomas, A., & Grimes, J. (Eds.). (1985). Best practices in school psychology. Kent, OH: National
Association of School Psychologists.
Thomas, A., & Grimes, J. (Eds.). (1990). Best practices in school psychology II. Washington, DC:
National Association of School Psychologists.
Thomas, A., & Grimes, J. (Eds.). (1995). Best practices in school psychology III. Washington, DC:
National Association of School Psychologists.
Vance, B. (Ed.). (1993). Best practices in assessment for school and clinical settings. Brandon, VT:
Clinical Psychology.
Waggoner, D. (1994). Language minority school-age population now totals 9.9 million. National
Association for Bilingual Education, 18, 1.
Weatherman, R., & Swenson, K. (1974). Delphi technique. In S. P. Hencley & J. R. Yates (Eds.),
Futurism in education: Methodologies ( pp. 97 – 114). Berkeley, CA: McCutchan.
West, J. F., & Cannon, G. S. (1988). Essential collaborative consultation competencies for
regular and special educators. Journal of Learning Disabilities, 21, 56 – 63.
Ysseldyke, J., Dawson, P., Lehr, C., Reschly, D., Reynolds, M., & Telzrow, C. (1997). School
psychology: A blueprint for training and practice II. Bethesda, MD: National Association of
School Psychologists.
Yutrzenka, B. A. (1995). Making a case for training in ethnic and cultural diversity in increasing
treatment efficacy. Journal of Consulting and Clinical Psychology, 63, 197 – 206.
Zayas, L. H., Torres, L. R., Malcolm, J., & DesRosiers, F. S. (1996). Clinicians’ definitions of
ethnically sensitive therapy. Professional Psychology: Research and Practice, 27, 78 – 82.