Escolar Documentos
Profissional Documentos
Cultura Documentos
ISSN 8755-4615
All rights of reproduction reserved
Networks were introduced to English as a second language (ESL) classes only recently.
Hence, to date, only a few empirical studies have investigated effects of networked
computers on ESL student writing. This study compared ESL students in first-year English
classes writing in two contexts: in a networked computer class and in a traditional lecturestyle class. The aim was to determine which setting promoted better writing,
more
improvement in writing, and more peer and teacher feedback. First and final drafts of
student papers were scored holistically, and the number of interactions during peer-review
sessions was analyzed. The networked setting was shown to promote better writing and
more peer and teacher feedback. The traditional setting was shown to promote more
improvement in writing. This was attributed to first drafts in the networked classes being
closer to students maximal performance.
computers
first-year
English
English
as a second language
holistic scores
networks
ESL
writina
When computers were first introduced to writing classes, they were stand-alone versions,
and students sat in relative isolation using word-processing programs. Although computers made revision easier, interaction with other students and with the teacher was minimal,
and feedback on student writing came mainly from the teacher.
The degree of student interaction increased dramatically
with the introduction
of
networked computers to writing classes, especially because networks permit real-time
conferencing,
the simultaneous
contributions
to a discussion from all the students
connected by the network. The lack of the usual turn-taking allows all participants to pick
up and comment on any topic mentioned in the discussion. The simultaneity also eliminates interruptions, which means that students who want to think over and revise their
ideas are no longer at a disadvantage. By allowing the teacher to quickly access the writing of all students in a class, networks also allow immediate feedback. The teacher and
students thus interact freely, sharing ideas, receiving feedback, and taking part in small
group discussions.
Hypothetically, network classes should have further advantages over traditional writing
classes, including those in which student interaction is actively encouraged. For instance,
during the usual face-to-face discussions in traditional classes, visual cues such as skin
color, gender, and age tend to privilege some students over others. English as a second
language (ESL) students, who are usually less articulate in speaking than in writing, take
more time to verbalize their thoughts, and are reluctant to interrupt others, are also at a
Directall correspondence
Kong.
E-mail:
to: George Braine, ELT Unit, The Chinese University of Hong Kong, Shatin, NT, Hong
<georgebraine@cuhk.edu.hk>.
45
BRNNE
46
disadvantage. Probably the most common obstacle faced both by teachers and students in
traditional writing classes is the difficulty in understanding
accents (Braine, 1996;
Harklau, 1994). In such classes, students are often asked to repeat themselves, causing
anxiety among students and embarrassment
for both teachers and students. One of the
main advantages of electronic networks is the removal of accents (Bump, 1990). Overall,
networks encourage students to treat each other as peers, thereby minimizing the negative
effects of accent, skin color, gender, or age. In networked classes, what is written becomes
more important than who wrote it.
Although computers have been used in ESL writing classes for more than a decade,
they are mainly stand-alone versions, with the pedagogical focus being on word processing and revision. Networks were introduced to these classes only in the last five years;
consequently.
documented research showing their advantages over traditional writing
classes is rare. Further, the switch from traditional classes to networks is expensive and, at
least at the initial stages, requires a degree of technical sophistication. As a result, despite
the lack of clear evidence that word processing improves student writing (see Pennington,
1993). many ESL programs continue to teach writing in a traditional manner or use standalone computers only to facilitate word processing.
RESEARCH
ON NETWORKED
COMPUTERS
IN ESL WRITING
CLASSES
To date, only a few studies have investigated the effects of networks on ESL writing quality. As mentioned before. this may be because networks were introduced to ESL writing
classes only recently.
Some studies. such as those of Phillip Markley ( 1992) and Nancy Sullivan ( 1993), have
been largely anecdotal. Markley. who taught first-year composition to ESL students on a
network. analyzed interactions in two classes. During a typical SO-minute discussion in a
class of 21 students, Markley observed a total of 109 interactions, with each student writing an average of 18.9 lines (approximately
IS2 words at 7-9 words per line). The teacher
actively intervened in the discussion, contributing
18 interactions. The most interactions
(63) were directed by individual students to the class, and 19 interactions were between
individual students. In another class of 17 students, the teacher intervened less (14 interactions) and became more of a facilitator. The total number of interactions dropped to 87:
however. the average length of student writing increased to 18.87 lines (approximately
I88 words at 8- 12 words per line). Again, most interactions (46) were between individual
students and the class, and 16 interactions were between individual students.
To determine how network discussions could encourage student participation
and
reduce teacher talk, Sullivan (1993) analyzed the interactions of I9 students in a 40minute class. A total of I81 interactions were noted; 14 by the teacher, 46 from individual
students to the class, and a remarkable 107 interactions between individual students. Sullivan notes that, in many instances, students actively pursued information (p. 34), thought
critically, and negotiated meaning during these interactions.
One of the few empirical studies of ESL writers on a network was conducted by Mary
Ghaleb (1993). who compared two first-year ESL writing classes. one writing on a
network and the other in a traditional grammar-based setting. Specifically. she compared
the quantity of writing produced in a networked class and a traditional class. the percentage of grammatical errors (subject-verb agreement, run-on sentences, and sentence frag-
Networked
Computers
in ESL Writing
Classes
47
men&) in the first and final drafts of papers in the two classes, and the quality of student
papers as determined by the holistic scores awarded by three raters. As for the quantity of
writing in a 50-minute period, Ghaleb found that students in the networked class wrote an
average of 90 words, while students in the traditional class wrote an average of only 4
words. As for grammatical errors, the majority of students in the networked class
produced a lower percentage of errors between the first and final drafts, leading to an
average improvement of 2.2% in their papers. Although a majority of students in the
traditional class also produced a lower percentage of errors, their average improvement
was only 1.4%. In quality of writing, the networked class showed a mean improvement of
0.2 points on their first and final drafts, while the traditional class showed a mean
improvement of 0.8 points. Ghaleb speculates that the lower improvement rate of the
networked class may have been due to the students first drafts being closer to their maximal perfomlance.
Nancy Sullivan and Ellen Pratt (I 996) also compared two groups of ESL student writers, one writing on networked computers and the other in a traditional oral setting. The
aim of the study was to compare student attitudes toward writing with computers, their
writing apprehension, and improvement in writing quality. Sullivan and Pratt found that
students in the networked class began the semester with a more positive attitude toward
writing with computers. By the end of the 15-week semester, student attitudes were significantly more positive in both classes, although the networked class had a higher positive
attitude than did the traditional class. Writing apprehension decreased significantly @ <
.Ol) in both classes. At the beginning as well as at the end of the semester, the two classes
had similar levels of writing apprehension. Probably the most significant finding of the
study was in the improveinellt in student writing, as measured by the holistic scores of two
raters. At the end of the semester, the mean score of the traditional class decreased significantly (-.46), while that of the networked class increased significantly (+.07). Sullivan
and Pratt concluded that students in the [networked] classroom showed a significant gain
in writing due to the networked computers (p. 17).
While building on previous research, the present study aims to compare ESL student
writing in two settings: traditional classes and classes using networked computers. The
research questions are as follows:
I.
2.
3.
BACKGROUND
TO THE STUDY
Location
This study was conducted at a medium-size state university in the southeast United States,
which had an enrollment of about 12,000, including 800 ESL students. The required freshmen English courses at the university are sequenced as Composition I and Composition II.
Students must pass a stringent exit exam at the end of the Composition I course in order to
move to Composition II. Three sections of each course are specially designated for ESL
students each quarter.
48
BRNNE
Networked Camputers
in ESL Writing
Ciosses
49
50
BRANE
Data Analysis
Three aspects of classroom discourse were examined during the study. The first two
aspects, writing quality and degree of improvement between first and final drafts, were
examined by holistically scoring first drafts and final versions of student papers. (The first
drafts and final versions were scored about three weeks apart.) This was done after names
of students and other identifiers were removed from all papers. Because the papers were
laser printed with the identical typeface, those written by students in networked and traditional classes were indistinguishable.
Holistic scoring was done by three experienced
readers of the Test of Written
English (TWE) according to the TWE Scoring Guide (see Appendix C). The TWE,
which is a direct measure of writing, is a 30-minute essay test administered along with
the multiple-choice
Test of English as a Foreign Language (TOEFL), which is used by
over 3,000 higher education institutions
to evaluate English proficiency of students
whose native language is not English. The TWE is criterion referenced and scored holistically according to a 6-point scoring guide. In use since 1986, it is probably the best
known, most widely used, and most reliable test of writing skills of nonnative speakers
of English. In the TWE, each paper is scored twice. each time by a different reader.
When the scoring differs by more than one point, the papers are sent to a third reader to
resolve
the discrepancy.
Because all participants in this study were ESL students and the basis of the study was
essay-length
discourse. the TWE Scoring Guide was deemed the most appropriate
measure of student writing quality.
The length of comments made by students and teachers was the third aspect to be
examined. For this, the number of words in peer reviews were counted. In networked
classes, transcripts of the subconferences
were used. In these classes, all feedback by
students was provided during the IOO-minute class meeting; the teacher also participated
actively in the session. Following
the peer-review
session, the teacher visited the
computer lab for a total of 140 minutes to read and comment on student papers in various
subconferences.
In traditional classes, comments written by students on peer-review forms
(Appendix D), the marginal comments made by students on classmates first drafts, and
feedback provided by the teacher were included in the word count. The teachers feedback
was provided after class hours; in order to track the amount of time spent on providing
feedback, the teacher kept a log indicating the time spent on each student paper.
RESULTS
Quality of Writing
The 34 first drafts written in networked classes had a mean score of 5.3, and the final
versions a mean score of 5.6 on the TWE scale. The 35 first drafts written in traditional
classes had a mean score of 4.8 and the final versions, 5.2. No paper scored less than 4 on
the scale. The interrater reliability was 0.80.
TWE Scoring Guide taken from the Test of Written English (1990). Reprinted by permission of the
Educational Testing Service, the copyright owner. The scores assigned are not actual (official) TWE
scores.
Networked
Computers
in ESL Writing
Classes
51
Length of Comments
In networked classes, each student wrote an average of 480 words of comments during
peer-review sessions. In traditional classes, each student wrote an average of 197 words.
All feedback was provided during lOO-minute class meetings.
In networked classes, the teacher wrote an average of 152 words of comments and
suggestions per student during two lOO-minute class meetings and 140 minutes of followup visits to the computer lab. Thus, the total teacher time spent on the first drafts was 340
minutes, averaging 10 minutes per student. In traditional classes, the teacher wrote an
average of 148 words per student. The total time spent on providing feedback to the 3.5
students in traditional classes was 564 minutes, averaging 16 minutes per student.
DISCUSSION
The purpose of this study was to determine which ESL writing classes, computer
networked or traditional, promoted better writing and more improvement in writing and
produced more peer and teacher comments on student papers.
Holistic scores for first drafts and final versions of student papers clearly indicate
that writing quality in networked classes was better than in traditional classes. However,
papers in traditional classes showed a slightly higher mean improvement (0.4) between
the first final drafts, while papers in networked classes improved by 0.3. As Mary
Ghaleb (1993) noted, one can only speculate that papers in the networked classes may
have improved less because first drafts were closer to the students maximal performance.
A number of reasons could be attributed for the better quality of writing in
networked classes. Research has shown that anxiety can have a negative effect on
second language learning (Horwitz & Young, 1991). By providing a less threatening
environment
than traditional classes (Cooper & Selfe, 1990; Selfe & Meyer, 1991;
Wilkins, 1991), computer networks may have generated better student writing. In addition, when students observe their peers taking risks-requesting
clarifications from the
teacher and classmates, challenging classmates to justify opinions, getting away with
occasional spelling and grammatical errors, they are more likely to participate actively
in discussions.
If a less threatening environment leads to more writing, a networked classroom would
be the ideal context in which to develop writing quality. Research indicates that the only
way to learn writing is by writing and that quantity often equals quality in writing development (Briere, 1966; Bums & Culp, 1980; Homing, 1987; Keim, 1989; Shaughnessy,
1977). As mentioned earlier, in networked classes, most discussions, analyses of student
papers, and feedback on in-class writing occurred on the network. Although no attempt
was made to calculate the actual amount of writing done during these class meetings lasting about 10 hours, Ghalebs (1993) study indicated that students in a networked class
wrote considerably more (90 words per 50-minute class meeting) than did students in a
traditional class, who wrote only 4 words per class meeting. Further, in peer-review
BMINE
52
sessions monitored for this study, each student in networked classes wrote an average of
480 words during the sessions, more than twice the number of words written by students
in traditional classes.
In addition to a nonthreatening
environment and the extraordinary amount of writing
generated, the collaborative nature of the networked classes may also have enhanced writing quality. Interaction and group work have been shown to facilitate the acquisition of a
second language (see Long & Porter, 1985, for instance). In fact, methods that encourage
collaborative
activities rather than lectures or teacher-dominated
class discussions are
especially beneficial to writing classes (Gere, 1987).
CONCLUSION
This study supports the results of Ghalebs 1993 study comparing ESL students writing
on networked computers and in traditional writing classes. As Table 1 shows, in both
studies, first drafts written in networked classes scored higher holistic scores than did
first drafts written in the traditional classes. In addition, in both studies, students in
networked classes showed a similar degree of improvement
in their writing quality,
although the degree of improvement was slightly less than that of students in traditional
classes. Different results were observed in the Sullivan and Pratt (1996) study: The first
drafts in networked classes scored less than did the first drafts in traditional classes, and
the holistic scores of final drafts in traditional classes actually declined. However, in all
three studies, papers written in networked classes improved significantly
from first to
final draft.
TABLE 1
Changes
in Writing
Quality
Networked
Draft
Measured
by Holistic
Scores
Classes
Draft
Traditional
2
Draft
Classes
Draft
Ghaleb
(1993)
3.4
3.6
(+.2)
3.1
3.9
Sullivan
3.19
3.26
(+.07)
3.41
2.95
5.3
5.6
(+.3)
4.8
5.2
Braine
(this study)
TABLE 2
Quantity
of Student
Writing
and Degree
in Computer-Networked
of Student
Interaction
Classes
Between
Time,
Words/
min
Student
Total
Students
Markley
(1992)
50
152
109
82 (75%)
Markley
(1992)
50
188
87
62 (71%)
Sullivan
(1993)
40
95
181
153 (84%)
Ghaleb
(1993)
50
90
100
480
Sullivan
Braine
85%
* Peer reviews
in small
groups.
76%
2
(+.8)
(-.46)
(+.4)
Networked
Computers
in ESL Writing
Classes
53
In this study, the quantity of writing generated by students on the network was significantly more than the quantity generated in other studies. This may be because students in
this study were conducting small-group discussions in subconference
windows. The
smaller group size, three students as opposed to the full class in other studies, may have
generated more discussion. Further, the specificity of the task (peer reviews of papers
according to preset guidelines under time pressure) also may have generated more writing,
as opposed to the less focused discussions of the entire class.
The high degree of interaction between students in this study, as Table 2 shows, was
consistent with other studies. In all studies, students dominated class discussions, participating in at least 70% of the interactions. Research shows that authentic and appropriate
classroom interactions with teachers and classmates provide learners with the best opportunities to practice, hypothesize,
and receive advice on their language skills (see
Allwright, 1980; Ellis, 1984; Pica, 1987; Pica & Doughty, 1985). Gisela Ernst (1994),
who ethnographically
observed factors that enhance or constrain learning in an ESL classroom, stated that the quantity and quality of teacher talk can be decisive in language
learning. However, 65-75% of speech in traditional foreign language classes is attributed
to teachers, who initiate most interactions through direct questions and matters relating to
classroom discipline and management, thereby giving students fewer oppo~unities
for
meaningful interaction (see, for example, Chaudron, 1988; Long & Porter, 1985; Nunan,
1989). Thus, use of networked computers may be one of the most effective ways of reducing dominant teacher talk and increasing student interaction to ensure effective language
learning.
Janet Eldred and Gail Hawisher (1993, in a comprehensive
survey of research on
computers and composition, claimed that no empirical studies indicate that computer
networks enhance writing quality. Although not explicitly stated, the research surveyed by
them appears to cover native speakers of English. In contrast, this study as well as others
surveyed in this paper clearly indicate that ESL writers enhance the quality of their writing
when writing on networked computers. This may be explained by theories of and research
into second language acquisition. According to second language acquisition theories
(Bi~ystok,
1978; Burt & Dulay, 1981; Ellis, 1984, 1985, 1992; Krashen, 1982) and
research on second language acquisition (Hatch, 1978; Larsen-Freeman
& Long, 1990;
Pica, 1987; Pica, Young, & Doughty, 1987), conditions that promote successful language
learning are
l
54
BRAINE
REFERENCES
Allwright, Richard. (1980). Turns, topics, and tasks: Patterns of participation
in language learning
and teaching. In Diane Larsen-Freeman (Ed.), Discourse malwis in swond lcrnpqe rmearch
(pp. 165-187). Rowley, MA: Newbury House.
Bialystok, Ellen. (1978). A theoretical model of second language learning. f..rm,quage Learning, 28,
69-83.
Braine, George. (1996). ESL students in first year writing courses: ESL versus mainstream classes.
Journal ofSecond Language Writing, 5, 91-107.
Briere, Eugene. (1966). Quantity before quality in second language composition. Lan~qqq~ Letrrrzirq, 16, 141-151.
Bump, Jerome. (1990). Radical changes in class discussions using networked computers. C~~~z~~ff~~~s
and the Hu~~~?litie.~~24, 49-65.
Burns. Hugh, & Gulp, George. (1980, August). StimuIating invention in English composition through
computer-assisted
instruction. Educationul Technoiqy, 5-10.
Burt. Marina, & Dulay, Heidi. (1981). Optimal language learning environments. In James E. Alatis,
Howard B. Altman, & Penelope M. Alatis (Eds.), The srrmd kmpage claxsrootnt Directions
,for rhe 19HOs (pp. 175-192). New York: Oxford University Press.
Chaudron, Craig. (1988). Second Ianguuge classrooms: Research on teuching and learning.
Cambridge: Cambridge University Press.
Cooper, Marilyn, & Selfe, Cynthia L. (1990). Computer conferences and learning: Authority, resistance, and internally persuasive discourse. College English, 52, 847-869.
Educational Testing Service (ETS). ( 1986, 1990). TWE Scoring Guide. In Test of Written En&h.
Princeton, NJ: Author.
55
Eldred, Janet, & Hawisher, Gail. (1995). Researching electronic networks. Written Communication,
12,330-359.
Ellis, Rod. (1984). Classroom second language development. Elmsford, NY: Pergamon Press.
Ellis, Rod. (1985). Understanding second language acquisition. Oxford: Oxford University Press.
Ellis, Rod. (1992). Second language acquisition and language pedagogy. Clevedon, England: Multilingual Matters.
Ernst, Gisela. (1994). Talking circle: Conversation and negotiation in the ESL classroom. TESOL
Quarterly, 28, 293-322.
Gere, Ann. (1987). Wr~t~ng groups: History, theov, and irnpZicutions. Carbondale, IL: Southern Illinois University Press.
Ghaleb, Mary. (1993). Computer ne~arking in a universes fre.~~zman ESL meriting class: A descriptive study of the quantity and quality of writing in networking and traditional writing classes.
Unpublished doctoral dissertation, University of Texas at Austin.
Harklau, Linda. (1994). ESL versus mainstream classes: Contrasting L2 learning environments.
TESOL Quarterly, 28, 241-272.
Hatch, Evelyn. (1978). Discourse analysis and second language acquisition. In Evelyn M. Hatch
(Ed.), Sexmd language acquisition: A book ofreadings (pp. 401435). Rowley, MA: Newbury
House.
Horning, Alice. (1987). Teaching writing as a second language. Carbondale, IL: Southern Illinois
University Press.
Horwitz, Elaine, & Young, Dolly. (1991). ~nguage anxiety: From theory and research tu classroam
~rnpzicf~tiails.Englewood Cliffs, NJ: Prentice Hall.
Keim, William. (1989). The writing-grammar battle: Adventures of a teacher/administrator.
English
Journal, 78,66-70.
Krashen, Stephen. (1982). Principles and practice in second language acquisition. Oxford: Pergamon Press.
Larsen-Freeman, Diane, & Long, Michael. (1990). An introduction to second language acquisition
research. London: Longman.
Long, Michael, & Porter, Patricia. (1985). Group work, interlanguage talk, and second language
acquisition. TESOL Quarterly, 19, 207-227.
Markley, Phillip. (1992). Creating independent ESL writers and thinkers: Computer networking for
composition. CAELL Journal, 3, G-12.
Nunan. David. (1989). ~?~derstanding language classrooms. London: Prentice Hall.
Pennington. Martha. (1993). A critical examination of word processing effects in relation to L2 writers. J~)urnal of Second Language Writing, 2.227-256.
Pica, Teresa. (1987). Second language acquisition, social interaction, and the classroom. Applied
Linguistics, 8, 3-2 1.
Pica, Teresa, & Doughty, Catherine. (1985). The role of groupwork in classroom second language
acquisition. Studies in Second Language Acquisition, 7, 233-248.
Pica, Teresa, Young, Richard, & Doughty, Catherine. (1987). The impact of interaction on comprehension. TESOL Quarterly, 21, 737-758.
Selfe, Cynthia, & Meyer, Paul. (1991). Testing claims for on-line conferences. Written Communication, 8, 163-192.
Shaughnessy, Mina. (1977). Errors and expectations. New York: Oxford University Press.
Sullivan, Nancy. (1993). Teaching writing on a computer network. TESOL Journal, 3,34-35.
Sullivan, Nancy, & Pratt, Ellen. (1996). A comparative study of two ESL writing environments: A
computer-~sisted
classroom and a ~aditional oral classroom. System, 29(4), 491-501.
Wilkins, Harriet. (1991). Computer talk: Long distance conversation by computer. Written Communication, 8,56-78.
BFAINE
56
APPENDIX
Coming to America. Thousands of international students arrive in the United States every
year. Many of these students are away from home for the first time, in an environment
quite different from theirs. What are the social and psychological problems that students
face? Why do some students experience culture shock? Have you experienced any problems? What can colleges and universities do to help these students?
APPENDIX
Assignment
In Assignment 1, you should describe your knowledge of the topic and express your opinions on it. Since the paper is based on your knowledge and opinions, you should not refer
to any sources in the library or elsewhere. Please make sure that you write a clear thesis
statement and topic sentences for each paragraph. You should also ensure proper organization and cohesion.
Assignment
1 should be word processed. The length should be two double-spaced
pages (about 500 words).
Your readers will be your classmates.
APPENDIX
and syntactic
Demonstrates
competence
in writing
though it will probably have occasional
on both rhetorical
errors.
and syntactic
than others
levels,
Networked
Computers
in ESL Writing
Classes
57
-displays
facility in the use of language
-demonstrates
some syntactic variety and range of vocabulary
4
Demonstrates
levels.
minimal
competence
in writing
on both rhetorical
and syntactic
weaknesses:
-inadequate
organization and development
-inappropriate
or insufficient details to support or illustrate generalizations
-a noticeably inappropriate choice of words or word forms
-an accumulation of errors in sentence structure and/or usage
2
Suggests incompetence
in writing.
weak-
-serious
disorganization or underdevelopment
-little
or no detail, or irrelevant specifics
-serious
and frequent errors in sentence structure or usage
-serious
problems with focus
1
Demonstrates
incompetence
in writing.
be incoherent
be undeveloped
contain severe and persistent writing errors
Papers that reject the assignment or fail to address the question must be given to the Table
Leader. Papers that exhibit absolutely no response at all must also be given to the Table
Leader.
NOTE
Copyright
reserved.
APPENDIX
Assignment
l-Peer
D
Review
Author
Reviewed by
First, read the paper straight through to get a quick, general impression. On the second or
third reading. respond to the paper according to the guidelines given below. Please offer
specific comments.
I.
2.
3.
3.
5.
6.
7.
8.
9.
Did you enjoy the paper? Why, or why not? Please be specific.
Is the thesis statement clear? If not, how can the thesis be clarified?
What is the topic sentence of the second paragraph?
Do all the sentences in the paragraph relate to the topic sentence? Yes/No
If not, how can the author improve the paragraph?
What is the topic sentence of the third paragraph?
Do all the sentences in the paragraph relate to the topic sentence? Yes/No
If not, how can the author improve the paragraph?
Write five transitions (transitional
words or phrases. repetition of key words or
phrases, use of synonyms) you found in the paper.
Does the paper need additional transitions? Yes/No
If yes, where?
Find two places where the author has used specific examples to develop an idea.
Specify another place where you think examples are needed.
Is there any place in the paper where you were confused? Specify the confusing parts,
and explain why you were confused.
What are the strong points of the paper?
How can the paper be improved?