Professional Documents
Culture Documents
NQ27729 PDF
NQ27729 PDF
Sufumi So
The author has granted a non- L'auteur a accordé une licence non
exclusive licence allowing the exclusive permettant à la
National Libraty of Canada to Bibliothèque nationale du Canada de
reproduce, loan, distribute or sell reproduire, prêter, distribuer ou
copies of this thesis in microform, vendre des copies de cette thèse sous
paper or electronic formats. la fome de microfiche/film, de
reproduction sur papier ou sur format
électronique.
Ph-D. Thesis
Department of Cumculurn, Teaching and Learning, University of Toronto, 1997
days ahead would hold in store for me. Upon the completion of the thesis, 1 now see the
entire thesis process to be exhilanting. But the experience was oftentimes daunting and
difficult. Many individuals directly or indirectly helped me to go through this challenge.
This thesis would not have k e n possible without the contn bution of Kei and her
students, who shared with me their classroom, their t h e , and their thoughts. 1 am deeply
indebted to them.
expert input was especially important to the development and completion of this work. In
fact, his ideas and works have influenced me enormously ever since 1 came in contact with
him five years ago. 1 have greatly benefited frorn numerous opportunities to work with him
at the Ontario Institute for Studies in Education of the University of Toronto (OISUUT). 1
also wish to thank Shizuhiko Nishisato and Sharon Lapkin, my thesis cornmittee members,
Christine Guro, Mari Haneda, Mary Landolf, Jiang Li, Angel Lin, Hiromi Masurni-So.
Alfred Sakyi, Ling Shi, Billy So, Junko Tanaka, and Chihiro K. Thomson. Thank you dl.
Gai1 and Gerry Jordan, Hannele and Lloyd Robinson, Mayumi Kondo and her
of encouragement and inspiration for my academic work since 1 came to know her ten
years ago.
1 also acknowledge the financial support of the OISUUT in the forms of Gmduate
Assistantships (1992-96) and "high visa tuition waivers" (1993-95) as well as that of the
Ontario Ministry of Education and Training who awarded the Ontario Graduate
Scholarships (1994%) to me.
Last, but not, of course, least, 1 a m very thankful to my husband, Billy, who
constantly encouraged me to have confidence in my work,and to my son, Duane, who put
up with my hectic schedule and ternperarnental behavior throughout the writing of this
thesis.
TABLE OF CONTENTS
1.1. OVERVIEW 1
1.2. RATIONALE 2
1.2.1. PEDAGOGICAL CONSIDERATIONS 3
1.2.2. THEORETICAL CONSIDERATIONS 5
1.3. BIGGS' S PRESAGE-PROCESS-PRODUm MODEL OF C LASSROOM LEARNLlYG AND
TEACHING 7
1.4.OI&JECI'AND FOC1 OF THE STUDY 10
1.4.1. RECENT CONCEPTUALIZATIONSOF FOREIGN W G U A G E CURRICULA 11
1.5. ORIENTATION AND ORGANIZATION OF TEiE DISSERTATION 15
C H A P T E R 2: TEACHING CONTEXT 17
2.1. SITE
2.2. TEACHER
2.3. CENERATING RESEARCH MATERIALS
2-3.1. CLASSROOM OBSERVATION
2.3.2. INTERVIEWZNG
2.4. ANSWERING THE WSEARCH QUESTIONS
2.4.1. K EI AND CLASSROUMACTIVITIES LEADING TO WRlTZNG TASK I
2.4.2. K El AND CLASSROOMA CTIVITIES LEADING TO WRITING TASK II
2.4.3. SUiMMARY
REFERENCES 136
LIST OF TABLES
Tàbfe2-1. Kei 's Respomes to rhe 6-item Questionnaire on Teacher Beliefs and Practices of Teaching of
Writing 25
Table 3-1. Studenrs ' Charackristics 38
Table 3-2. Students ' Language-Related Characteristics 47
Table 3-3. Summas, of Students ' LI Writing,JFL Oral, and JFL Writing Skilk 47
Table 4- 1. Timeline of Wriring Assignmenrs 57
Table 4-2. Transcription Conventions 59
Table 4-3. Categoriesfor Cuding Think-Alod ProrocoL 61
Table 4-4. Surnrnary oJ Think-Abud Prorocol Data 65
Table 4-5. Aspecrr of Attenrional Foci and Rejlectiveness (Think-Aloud Protocol Data) 67
Table 4-6. Post- Writing Questionnaire Responses. JFL Projîciency. and LI WrifitzgExpertise 69
Table 4-7. Post- Writing Questionnaire Responses and Perceptions ofJFL Writing and Learning 70
Table 5-I. Description of SOLO LeveIs 78
Table 5-2. Summary of Japamse Essq Scores and Cornments 82
Table 5-3. SOLO Lmek of Japanese Written T e m 84
.
Table 6- 1. Major Contriburors and T k i r Bipofar Options (Analysis I Solulion I ) %
Table 6-2. Major Concribufors and Their B e l a r Options {Analysis 1, Solution 2) 97
Table 6-3. major Contributors and Titeir Bipolar Options (Analysa 2, Solution I ) IO1
Table 6-4.Major Contributors and Their Bipolar Options (Analysis 2. Solufiori 2) 102
Table 6-5.Major Contributors and T k i r Bipolar Options ( A n a b i s 3(a),Solution 1) IO5
Table 6-6. Major Contributors and Their Bipolar Options (Analysis 3(a).Solution 2 ) IO5
Table 6-7. kîajor Contributors and Their Bipolar Options (Anaîysis 3(b).Solurion 1) 109
Table 6-8-Major Conrributors and Their Bipolar Options (Analysk 3(6). Soluzion 2 ) Il!
Table P I . Background Questionnaire Data (Iterns 1-10) 179
Table P2. Language Skills Assessrnent Data ( I t e m 11-13) 180
Table P3. Interview Data (ltems 14-16) 180
T d l e P4. Posr-Wrih g Quesrionnaire Data (Items 17-22) 181
Table P5. Think-Aloud Protocol Data (Items 23-30) 182
Table P6. Japanese Essay Assessrnent Data ( I t e m 31-44) 183
Table QI. Major Con&ributorsand Their Bipolar Oprions (Anafysis 4(a).Solution I ) 184
Table Q2. Major Contriburors and Their Bipolar Options (Atzalysis4(a),Solution 2) 185
Table Q3. Major Conzribrtmrs and Their Bipolar Oprions (Analysis 4(b),Solurion 1) 186
Table Q4. Major Concributors alid Their Bipolar Oprioru (AnaZysis4{b),Solurion 2) 187
LIST OF FIGURES
APPENDIX Q: RESULTS OF DUAL SCALING (ANALYSIS 4(A) AND ANALYSIS 4(B)) 184
Chapter 1: Introducing and Framing the Study
1.1. Overview
Why do I ask my students to write compositions? What are they getting from this
task? These plain questions, which I have repeatedly asked myself as a teacher of Japanese
as a foreign laquage1 (JFL), are the impetus for the present research. I t is commonly held,
with the current pedagogical emphasis on processes of writing, that writing provides a n
effective opportunity for learning in al1 subject areas. What does this statement mean in the
context of foreign language pedagogy? What and how well do students learn through
wnting compositions in a foreign language? These questions form the core of my inquis.
They were addressed within the recent tradition of research on situated learning (e-g.,
Minick, Stone, & Forman, 1993; Newman, Griffin, & Cole, 1989). Following this trend,
the analyses in my study involve individuals working in a natuni, goal-directed, activity
setting (cf. Wertsch, 1981,1985) nther than focusing on the decontestualized performance
of an isolated individual in a laboratory-Iike setting.
The study adopts some tenets and practices of grounded theory (B. Glaser &
Strauss, 1%7; Strauss, 1987; Strauss & Corbin, 1990); it focuses initialiy on interpreting
certain elernents of experience then tries to develop theory from an examination of those
elernents and their interrelationships. The ultimate aim of my study is to contribute to the
1 In this thesis different tcms are usai to d e r COa non-native language. The tenu foreign langwge is
defined as a language learned and used outside its spcech community and the rem second language as the
language learned and used wittlln its speech commuaity. The tcrm LZ includes the concepts of both foreion
and second languages. Sec Ashworth (1985. pp. 16-20). Iüein (1986. pp. 19-20).and Stem (L983a. pp. 75-
17) for discussion of these rems.
construction of an integrated theory that enables the researcher to understand the nature
and meaning of an experience for a particular group of people in a particular setting (B.
Glaser & Strauss, 1%7). My orientation to analysis, however, is practical. not entrenching
itself in rigid prescriptions on what oirgltt to be done. It favors a science that emphasizes
the ernergent nature of mind in activity and that acknowledges a central role for
interpretation in its explanatory frarnework (Cole, 1996).
The objects of my study are JFL university students' experiences of learning
through writing JFL compositions in a formal instructional setting. This setting, the
classroom, is viewed as a system that is "an interconnected set of elements in equilibrium"
(von Bertalanffy, cited in Biggs, 1991, p. 36) or a "functional system" (Anokhin, cited in
Newman et al., 1989, p. 69, pp. 71-73). The classroom consists of various elements
pertaining to leamer, teacher, task, and leaming processes, as well as leaming outcornes,
which interact with each other. The integrated system of the classroom is well captured and
represented in Biggs' presage-process-product (or 3P) model (Biggs, 199 1; Biggs &
Moore, 1993; see section 1.3 for a description of the model). which has provided the
present study with a conceptual frarnework upon which to build an organized, disciplined,
and systematic investigation.
2 Jorden and Lambert's ( 199 1) report on Japanese lan,ouge education was iimited to situations in the
United States; no equivdent account is available documenting developments of Japanese ianguage education
of recent years in Canada, mg research site. However. it rnay well be presumed that much of the situation in
Canada mirrors what bas k e n observed in ihe United States.
American students enrolled in Japanese language study. Rather, they are annious to
develop speaking and reading cornpetence. Such students would natural ly request more
instruction that emphasizes speaking and reading. And teachers and curricula have
probably responded to such students' expressed needs. This view of classroom needs could
have set me a research agenda focused on speaking and reading.
Recently, however, sorne foreign language teaching professionds have begun to
value wnting for its having a potentially wide range of pedagogical uses. Koda (1993)
even sees composition writing as "a major component of foreign language (FL) instruction,
whatever the pedagogical orientationn (p. 332). Writing is now considered, at Ieast by
sorne, as an effective means to develop integrative language skills. It is also said to
enhance cognitive and metalinguistic awareness by affording writers opportunities to think
in and refiect on the target language (Cumming, 1990; Swain & Lapkin, 1995; cf. Olson.
199 1). This renewed conceptualization of writing within the foreign language teaching
profession is probably tied to the current emphasis on writing, the teaching of writing, and
the development of writing abili ty in education in general (Valdes. Haro. & Echevaniarta,
1992). For example, the extent of empirical research on the teaching and learning of
English-as-a-second-language (ESL) writing in recent years might have k e n expected to
yield a direct impact on foreign language instruction. Nonetheless. this has scarcely
happened; composition writing deserves more attention from foreign language
professionds.
Presently, many things are unknocvn about foreign language wnting. An obvious
area for investigation to explore promisi ng pedagogical implications is the widel y-held
assumption that writing is a way to leam. The qualities of learning that might occur
through writing in a foreign language need to be better understood so as to allow educators
to make inforrned decisions about what to do with this tool of writing in a foreign language
context. T o draw relevant pedagogical implications, however, such research must also
account for the situated nature of learning, tahng into consideration the instructional and
contextuai variables that corne to play in leaming.
The question I have taken on--how lemming through writing can be identified and
studied in a forma1 instructional context--is a practical problem for foreign language
educational research. This is because wnting activity, though often an integral part of
foreign language instruction, typically lacks a clear definition of pedagogical purpose.
Wri ting instruction is not so well-defined in foreign language programs as in its ESL
counterparts. ESL wnting courses are designed to prepare an ever-increasing number of
international students in English-speaking countries to meet entry levels in academic
programs as well as their continuing writing requirements. Much research effort, for
insiance, has been directed toward anal yzing how well students exiti ng from ESL courses
may be able to write in English and to cornpete with their peers of English as a rnother
tongue. Such pragmatic reasons of academic and social integraiion for writing instruction
and research are seldom present in foreign language situations where contacts with the
target language and people and opportunities for using the language are by definition
limited. Nonetheless, many people believe that writing has a role to play in foreign
language instruction. My research tries to subject this folk belief to close investigation.
wnting that accounts for the phenornena of writing in both second atid foreign languages
(Cumming & Riazi, 1997; Gass & Magnan, 1993; Gnbe & Kaplan, 19%; Hirose &
Sasaki, 1994; Kroll, 1990; Sasaki & Hirose, 19%; Silva, 1990, 1993; VaIdes et al., 1992),
and similarly for those concerned with the construction of an integrated theory of writing
as a social and cognitive process (e-g., Bridwell & Beach, 1984: Fiower. 1990a).
Recently there have been a number of laudable attempts to account systematically
for students' L2 writing behaviors, cognitive processes during composing, and the ways
these behaviors and cognitive processes interact with written products and their
environmental and persona1 contexts (Cumming & Riazi. 1997: Grabe & Kaplan, 1996;
Hirose & Sasaki, 1994: Sasaki & Hirose, 1996). These studies have emerged after an
earlier accumulation of a substantial number of empirical--albeit exploratory, small. and
separate--studies on L2 writing over the past 15 years or so. It should be noted, however,
that virtually al1 of the previous work has conspicuously concentrated on English in
situations where the language is learned as a second language (as noted by Grabe &
Kaplan, 1996: Silva. 1993; Uzawa & Cumming, 1989; Valdes et al., 1992). and mainly
focused on such particular populations as school-age children. international students
preparing to study at English-speaking universities, and immigrant adults (as noted by
Cumming, 1994). These tendencies may be presenting only a partial picture of L2 writing;
Foreign language writing research is still in its infancy. Our immediate task at this
stage of research development is to identify the facets of foreign language writing, doing
so in a systematic and principled fashion toward the construction of a modular theory (cf.
Ellis, 1994. chap. 15). Furthemore, to provide a "rounded picture" (Flower, 1WOb, p. v) of
L2 writing, the facets to be discovered should be seen as dynamics of cognitive and social
phenomena. In particular, the blended socio-cognitive perspective currently popular among
English-as-a-mother-tongue writing researchers, and gaining some attention from ESL
writing scholars (Prior, 199 1; Riazi, 1993, has not been taken up by foreign language
professionals in writing research. In short, the current scope of L2 writing research needs
to be expanded by looking at not only ESL writing but also the writing of other ianguages
being leamed as a foreign language under various conditions, and by taking an inclusive
and unified view of human cognition and its environments.
2.3.Biggs's Presage-Process-ProductMo&l of Classroorn Learning and Teaching
3 Stem (19Sa. chap. 22) used Dunkin and Biddle's mode1 to discuss L2 teaching in educational
tenns. See also Chaudron (lm)for an adoption of Dunkin and Bidde's model to L2 classroorn research.
indicating the systemic, rather than additive, nature of the whole?
Two main features of this mode1 fit neatly with the perspectives taken in my
research. First, learners are the focus. The instructional context provides a superstmcture
set by the teacher and the institution, affecting learners' states at the presage, process, and
product phases. However, leaming does not occur without leamers' actual engagement in a
learning task. And how they approach the task determines the quality of learning
outcornes. This logic gives good reason for my research to focus on learners' activities,
rather than teaching activities, as the study is concemed with individual students' leaming.
Second, the model takes the entire context of classroom learning and teaching into account
and represents its complexity in a succinct fashion. My study investigated the mechanisrns
of learning through composition writing within the system of a university JFL classroom, a
situation which is uniquely organized arnong as well as within individual mernbers of the
class and one that differs in certain ways (descnbed above) from the situations for ESL
learning addressed in most other research on L2 writing. The 3P mode1 of the classroom
gives an appropriate structure to f m e my inquiry.
Figure 1- 1 displays the model schematically and shows how 1 have modified some
of its original terminology, adapted slightly to suit the object of my study. I t should be
noted that systemic pnnciples represented in the model opente at not only the classroom
level but also higher levels Iike school, school board, and community (Biggs & Moore,
1993, chap. 16). I t is important to know how each level of the educational structures forms
a larger coherent system at the nest level in order to increase Our understandings of
teaching and learning. My present inquiry, however, limits its scope to the classroom
context focusing on writing tasks.
4 Biggs and ~Moore(1993. p. 449) provided a concise explanation on the systemic versus additive
view of phenornena: "A system is a working whole made up of a set of component parts, which interact with
each other to forrn an equilibrium."Thus, whatcvcr happens to one part will affect the rernaining parts. An
additive model. on the other hand, is "a multistructurd deficit modei" where addition. subtraction, or
modification of a part does not change the rest of the whole. A relevant discussion can dso be found in
Salomon ( 199 1 ) which contrasts the epistemologies of analytic and systemic approaches.
Presage Process
Ethnicity
Orallwritten L I
L I writing skill
LOF!
TL proficiency
Perception of TL writing
Area of difficulty in TL writing
Area of learning through writing
etc
Teacher
Classroom
F i p w I - I . Tlie 31' iiiodel as a classrooiii systeni related [O wriiiiig. Adnpted froiii f i e Pr-ocess o/ Lecimittg (p.
45 1 ), by J. B. Biggs and P. J. Moore, 1993, Sydney: Preritice Hall.
1.4. Object ami Foci of tl2e Shdy
At the heart of the proposition "Foreign language wnting is more than just wnting a
foreign language" is a broader curricular issue. I t concerns the question of what role
foreign language instruction plays in education aiming at the development of students'
minds or intellects. Considering the historical impact that literacy has had on the
development of people's thought and cognition (e.g., Olson, 1994). focusing on the writing
component of language instruction brings this issue to the fore. To make this perspective
clear, 1 review in the following section the emerging voices of foreign language
professionals who have been concemed about articulating a mtionale for foreign language
instruction in cumcula at schools, colleges, and universities.
As foreign language educaiion has become "a secure part" of school and university
cumcula due to recent institutionalized enforcements of foreign language requirements in
the United States (Lange, 1992, p. 528; see also Davis, 1997) and elsecvhere (Dickson &
Cumming, 1996), an urgent need has appeared to carefully consider the relationship
between foreign language curricula and the goals of educational programs overall.
Historically, language teaching has been influenced primarily by theones and pnnciples of
linguistics, psycholi nguistics, sociolinguistics, and second language acquisition research
(Nunan, 1988; Richards & Nunan, 1991). Only recently have foreign language
professionals begun to see themselves as educators as well as applied linguists. This
renewed conception of foreign language teaching as an educational matter invites us to
consider what needs to be learned beyond the linguistic aspects of a target language.
Littlejohn and Windeatt ( 1989) called such leaming "additional, non-language, leaming"
(p. 158) as emphasized by, for instance, Lange (1992). To Lange, however, such leaming
is a priority rather than "additional" component. He has strongly advocated that foreign
language cumcula move toward a view that prizes "its contribution to human development
rather than the developinent of language features" (p. 538).
To understand Lange's proposal, one needs to consider esisting foreign language
cumcular orientations, particularly their sense of what the cumculum is for. Lange (1990)
insightfully anal yzed foreign language curricular orientations using Schubert's ( 1986)
threefold classification of curriculum inquiry: the scientific-technical, also known as
empirical-analytical; the practicai or hermeneutic; and the cntical o r emancipatory. Recent
trends in foreign language curriculum have linked the empirical-analytical orientation and
the interpretive o r hermeneutic orientation. The former is represented by audiolingual and
grammar-translation teachi ng while the latter emphasizes the developmen t of language
proficiency a s a means of expressing individual meaning and discovenng meaning in the
world of the individual. Lange suggests that one such example is Stem's multidirnensional
curriculum. consisting of linguistic, cultural, communicative, and general language
education syllabi (Stem, 1983a. 1983b, 1992). Although curricula of this combined
orientation (or what Lange calls the cotiriec~ive)focus on uses of language for
communication. the understanding of the self and of the siirroiciiding other as well as any
use of l a n g u a p to act upon the human condition are fundamentally byproducts of leaming
the linguistic components (phonology, morphology, syntas, iesicon) and basic
communicative functions of language (Lange, 1990).For ihis reason Lange suggested that
cumcular efforts should go beyond the analytic and scientific to help leamers find personal
meaning in their learning processes (through a hermeneutic orientation) or to allocv them to
contemplate and act upon the society in which they live (through a n emancipatory
orientation). This suggestion aims toward the development of the enlightened self o r the
betterrnent of the human condition.
Such orientations and purposes are difficult to find in the cumcular wntings on
foreign language education (lange, 1990). There are, however, some exceptions, such as
Moskowitz (1978) and Stevick ( 1990) who have presented instructional techniques for the
cause of hurnanism based on a hermeneutic philosophy of language learning and teaching,
or Crawford-Lange and Lange (1987) and Kubota (19%) who have applied the work of
Freire (1973) to reorient language learning from the scientific-analytic acquisition of facts
and information toward emancipatory reflection and action on such facts and information.
These voiccs speak for language leaming as a total "educative experience" (Dewey,
193811 x 3 ) . They overlap wi th those advocating content-centered ianguage instruction5 as
5 See Crandall (1993) and Crandail and Tuckcr (L99û)for a comprehensive overview of content-
centered language instruction. The former includes an annotated bibliography on the subject. Pmctical
suggestions and guideIines for the implcmentation of content-centered instruction cm be found in blohan
(1986) especiaily for ESL professionais, Brinton, Snow. and Weschc (1989) for L2 specidists at
postsecondary acadernic institutions, and Cantoni-Harvey (1987) for elemcotary and secoodary educators
deaiiag with minonty students. Sec also Adair-Hauk's (1996) strategies for the practical application of a
whole Iringuage approach in second and foreign language classrooms at the secondq and universi ty levels.
has appeared, for esarnple. in the long-standing debate over the value of phonics or whole
language in reading instniction or more recen tly the product-process debate in wri ting
instruction. When two seemingly oppositional views are put forth. there appear voices to
admonish extremism, calling for a more balanced, integnted stance as seen in the
interactive model of reading instruction (Carrell, Devine, & Eskey, 1988). the " balanced
and flexible literacy diet" (Willows, 19%), and the "middle ground" approach to writing
instruction advocated by, for esarnple, Arndt (1981), Connor (1987). or Raimes (1985).
For the development of balanced foreign language curricula that place importance on form
and meaning and language learning atid non-Ianguage leaming objectives, 1 (So, 1994a)
have suggested that integntion of language and non-language goals might be realized
successfully through Miller's (Miller, 1988, 1993; Miller, Cassie, & Drake, 1990) holistic
curriculum model consisting of three overlapping cornponents of transmission
(corresponding to the scientific-technical orientation to curriculum), transaction (the
hermeneutic) and transformation (the emancipatory).
Ideologies in foreign language education are changing progressively and
enpanding. The purpose, content, and rationale of the foreign language curriculum are in
transition accordingiy--from loci on the mechanical learning of [inguistic forms isolated
from contest, to emphases on the rneaningful, communicative use of language, and to aims
of broadening leamers' visions and perspectives. In view of these recent trends in foreign
language curricular orientations, 1 wanted my research to ask, how is the writing
component treated in relation to the overail curriculum of JFL? What would be the
experience of leamers writing in JFL? My simple and situated inqui.--what is really going
on with JEX wnting in the classroom?--has never, to my knowledge, been taken up as a
research subject in thc field of JFL education.6 Taking up this hnd of "reflective inquiry"
6 As rnentioned =lier in this chapter, JFL writing has received Little research treatment in the pzist.
Somc exceptions include writing process reswch such as Kato (1995). Ootrike (19%). Pennington and So
( 1993).Sbibata ( 19%). and Uzawa and Cumining (1989). However, thesc investigators' primary conccrn wris
not eduwtionai or leaming processes through writing but rarher the process of writing itself in specific tasks.
has involved drawing upon al1 sorts of howledge and hunches, without which "empirical
so that I would not be unduly influenced by others' ideas and foci regarding the problem
under ~ t u d y Thus,
.~ as I present the research, 1 will also show how 1 consulted and
reviewed published literature to relate rny esperiential understandings to them and their
relevant ideas.
After this brief introductory chapter, I will in chapters 3, 3, 4, and 5 display
different sets of data collected wiihin the frame of Biggs's 3P mode1 and address the four
7 This does not mean that 1 did not read before collecting data. 1 did read wideiy, as B. G . Glaser
(1978) suggested, in substantive areas including L2 acquisition and eduwtion. writing, and research methods
and perspectives. This activity tumed out higbIy beneficial as it enabled me to "skip and dip, thereby gaining
greater coverage"(B. G . Glaser, 1978. p. 32).
sets of guiding questions formulated within the sarne fnme (see section 1.4). Various sets
of research materials were genented through classroom observations, interviews,
questionnaires, tape recordings of think-aloud sessions, and wrï tten documents in order to
capture the complesity or educational phenomena as they actually occurred in relation to
JFL wri ting tasks. These materials are orgaanized according to the four cornponents of the
3P model and described in separate chapters: the reachirzg content data in chapter 2, the
strrderits' clznrczcteris~icsdata in chapter 3, the ivrifing processes data in chapter 4, and the
writteri prodircts data i n chapter 5. In each chapter 1 surnmarize the steps that 1 have
followed and the pnctical concems that 1 dealt with in the process of converting the
materials into an analyzable and interpretable form and denving scientific evidence in the
present study. I use a narrative fom to report my research when 1 wish to highlight "the
storied quali ty of esperience" (Clandinin & Connell y, 199 1. p. 259). Furthermore, I
address each corresponding set of research questions by describing, analyzing, and
interpreting the data through the combined use of quantitative and qualitative rneth~ds.~
In chapter 6 1 present the results of statistical analysis of the combîned data
generated Srom the students--the stiuients' cluvncteris~ics, writi~igprocesses, and writteti
prod~ccfsdata--to describe how these components are interrelated. 1 used a unique
statistical technique called &al scnlirig to go beyond a descriptive, interpretive account
based on my impressions and intuitions. This chapter is followed by chapter 7, which
concludes the dissertation by providing a coherent and valid account of the phenomena
represented in the data as a whole. In this final chapter I also retum to the original question
of what "writing as a mode of learning" means in the contest of foreign language
instruction and in relation to the proposition that foreign language writing is more than just
writing a foreign language.
- - -- -
2.1. Site
It was a small seminar room of approximately 300 square feet with no windows,
sandwiched between another small seminar room and a large room wi th a seating capaci ty
of 100. There was only one door to get in and out of this room. The r m m was located in a
large modem building of a major anglophone university in Canada. Students mshing to
their respective classes o r hanging around the hallivay were a diverse m i s of ethnici ties,
though Asian students were conspicuous, 1 thought. It was the day of my first visit to Kei's
Japanese class. Kei (a pseudonym, pronounced K a y ) introduced me btiefly as a Ph.D.
student collecting data for her dissertation to 15 students sitting around a large old wooden
table in the room. The table took up s o much space of this small room that the students had
to be squeezed into the remaining narrow open space around the table. AI1 in the room
were Asian escept for two Caucasian students.
The class was a Japanese reading and writing course meeting once a week for two
hours in the moming throughout the academic year, from September to April. The course
is offered each year to students who have completed a third-year general Japanese
language course o r who possess an equivalent level of Japanese proficiency. There is,
however, no upper iimit of proficiency set for admission into the course. It is one of the
two highest levels of courses in the Japanese language offered a t this university. Most of
the students were in the fourth and final year of their undergraduate studies; most had
taken an elementary Japanese language course with Kei. Although it was only the second
meeting of the class, there was not the stiffness typically found in the initial meetings of
any course. 1 wrote i n my field notes that day, "There was a sense of warmness and at-
homeness in the class" (Field notes, September 29, 1994).
This class was selected for my research site for the following reasons: (a) The
course focused on literacy skills in J E , including a component of composition wnting; (b)
Kei, the course instructor, was willing to collaborate with me in canying out this research;
(c) the course participants were educated adult students, a fact which would avoid
confusing foreign language writing with such issues as maturation and basic litency; and
(d) the location was convenient for me to make frequent visits.
2.2. Teacher
1 first met Kei in the summer of 1993, a year prior to my data collection. We were
in the sarne class for a course in cumculurn studies at a graduate school of education. At
that time Kei was cornpleting her M.Ed. degree in L2 education as a part-time student
while teaching full-tirne at the above-rnentioned university. In the cumculurn studies class
we were the only native Japanese. There were a nurnber of other factors that might have
put us close together. We were both female, around the same age, with several years of
overseas experience as adults; we both aspired to be specialists of JFL education at p s t -
secondary academic institutions outside Japan. Our friendship continued and developed
after the summer course. We would talk for hours discussing goals, objectives, content.
and methodology of JFL programs at institutions of higher education and shanng one
another's teachi ng experiences.
One episode highlights our common concems about JFL education. In May 1994
Kei related to me some feedback she had received about her teaching [rom one of her
students at the end of a Japanese language course she had been teaching. Her teaching was
highly evaluated by this student saying, "Your course was most interesting. 1 was always
looking fonvard to corning to your class." This student then added, "But the course which
made me tliitzk the most was Mr. X's." Mr. X was Kei's colleague teaching a history course
in the same department. Both Kei and Mr. X were apparently very conscientious educators
and deeply concemed about their students' development for future responsibilities and for
success in li fe. They were particularl y reflective about their teaching practices. Having
recounted the story to me, Kei continued, "1 wonder if it is possible to go deep into the
rninds of students in a foreign language classroom" (from my notes and recollection; my
translation of what was spoken originally in Japanese). In a series of subsequent
conversations ivith her, 1 discovered what she had meant by this. That is, can we, as
y to memorize grammar rules and
foreign language instructors, encourage students not 01-11
vocabulary or practice using the language for daily communication, but also to ihitik--the
kind of thinhng to make sense of one's experience and the world around oneselî?
When 1 approached Kei for her collaboration in my research work in May 1994.
she agreed immediately. She was in fact quite excited about having me in her class every
week. There was. by then, mutual trust between Kei and me at both professional and
personal levels. She appreciated my weekly visits to her classes in the coming academic
year, especially because she felt she needed someone who could listen to and understand
her pedagogical concems in situ. Such professional support was, according to Kei, scarce
in her department. During the past three years of her teaching JFL at the universi ty, she
worked in isolation; she wished for meaningful discussion of pedagogical matters with
special reference to university-level JFL. My 9-year experiences of teaching in similar
contexts could benefit her as much as her participation in my study would benefit me. I
gave her a copy of the proposal for the present research (So, L994c) in June 1994, she
discussed i t with me for clarification i n August, then signed a consent letter prepared
according to the OISE gi<ideliriesfor theses atzd orals (Ontario lnstitute for Studies in
1 visited every class throughout the year with a few esceptions; 8 out of 10
meetings were obsewed in the fîrst semester and 10 out of 12 in the second semester. 1 sat
through each class from the beginning to the end. My persistence in full and frequent
observations was necessary in order to experience and understand "the syllabus in action"
(Breen, 1984, p. 50).which is the enactrnent of a predesigned syllabusg through continual
interaction between teacher and learners during the actual processes of teaching and
learning. As Breen stated, "Although. as teachers, we may follow a predesigned syllabus,
every teacher inevitably interprets and reconstructs that syilabus so that i t becomes
possible io implement it in his or her classroorn" (p. 50) to meet the needs and abilities o l
individual learners and of the socio-cultural context. The fluid and dynamic nature of
syllabus construction and reconstruction processes was evident in Kei's classroom. The
original written schedule of teaching for the first semester was revised twice and the
schedule for the second semester received minor changes frorn time to time i n
considention of student and time factors. For the purpose of my research i wanted to know
exactly in what cumcular çontext wri ting activi ties took place. To do so. i t was important
for me to be on site at ail times to observe the tlow of classroorn activities.
9 In this thesis the term syiiabus is used in a more restricted sense than the t e m curricuiurn. Syllabus
refers essentialiy to the specifrcation and sequencing of course content. Curriculum, on the orher hand. refers
to the whole of teaching, including those elements of syllabus dong with considentions of goals,
rnethodology, and evduation of a course. There has k e n a great deal of debate over the definition of the tenn
curriculum among educationai researchers in general (see Jackson. 1992, for a detailed summary of
definitional issues of curriculum). For definitions of the terms curriculum and syllabus used in the field of L2
teaching, see Johnson ( 1989).Nunan ( 1988, chap. 2). Rodgcrs (1989).and Stem (1983a. chap. 19. 1992).
One corner near the door was the spot 1 chose to sit during my observations. There
was no more than one and a half feet between me and the students sitting nearby. My
primary role was that of a non-participant observer, though there were a few occasions in
which 1 was asked to participate as a resource person supplying Japanese words and
expressions to students working in srna11 groups. The class was conducted entirely in
Japanese. 1 carried a clipboard to hold sheets of an observation scheme to record in real
time what happened and what the teacher and students said in class. The scheme
(Appendis B) was used no&for the purpose of quantitative analysis but to systematize my
observational records. 1 developed then revised it during my first few visits to the classes.
It employed 3-minute intervals and for each 3-minute interval it recorded the substance of
activity (e.g., test reading, discussion. grarnmar exercise), format of activity (e.g.. whole
class, pair work, small group), area(s) of instructional focus (e.g., read-aloud of a text,
content comprehension, lexis, grarnmar rules), utterances made by teacher and students,
and students' behaviorsY Ample space was provided for each item to be written down in
detail. I used both English and Japanese to record classroom events and discourse on
observation sheets. With the permission of Kei and the students, parts of some sessions
particularly relevant to wnting were audiotaped, lest some details should be missed in my
notes. 1 gathered al1 handouts, teaching materials, quizzes, and mid-term examinations to
supplement the information [rom my observations.
Based on the on-site notes, 1 converted the observations into 18 field notes in d l ,
each produced in English either on the day of observation or shonly aftenvards. Each note
was 500 to 1ûûû words in length, consisting of two parts; one described what happened in
the class, and the other recorded my reflections and comments. These notes necessady
reflected what 1 wanted to see in the classes. 1 concur wi th Fanselow's proposition ( 1990):
Io This approach rcsembles ihat taken in many other. more routinized scbemes for classroom
observation (e.g., Allen. FrohIich, & Spa&. 19% Riazi, Lessard-Clouston, & Cumming, 19%). See dso
Allwngbt (1988) for an account of the historical devclopment of systçmatic observation in lmguage
classrooms.
"What we see is not what takes place but what we value as important to see: observing is
selecting" (p. 186). Going through the 18 field notes at the time of writing this thesis, I
realize that what 1 selected to observe were the content and sequence of teac her-directed
learning activities. That is to Say, 1 tended not to focus on individual students or their
actions irrelevant to the teacher-directed activities. Writing my reflections and comments
facilitated my thinking about the research; it helped me to know what needed to be
clarified about Kei's teaching. Thus, this part of the field-note construction served the
function of generating questions to be asked during the subsequent interviews wi th Kei.
But at the same tirne 1 was aware that in this process I was reconstructing what happened
in the classes from my own perspective.
taken. Circumstances did not permit the use of such tools. Besides, the- could have spoiled
the rapport and trust between us that contnbuted to the generative process of our candid
conversations on these topics. Nonetheless, 1 did scribble quick notes about our talks
immediately after we parted, and later on the same days I produced retrospective notes of
Our conversations in English on my cornputer. These notes were 300 to 1OOO words in
length and recorded when, where, how long, and how the conversation took place.
sumrnarized what we talked about, and included Kei's words transcribed from memory
when they were deemed important. 1 genented a total of 32 of these notes betiveen
October 19, 1994 and March 19, 1995. The- were written from the perspective of me as a
researcher wishing to uncover the teacher's points of view by accounting for what was
observed in the classes.
In addition ro the materials collected during my observations of the course. 1 also
wished to be informed of Kei's retrospective thinking about the writing component of the
course a year later. 1 used a survey questionnaire as a guide for probing this. It comprised 6
items (Appendix C) taken from a 22-i tem questionnaire developed by Pennington
(Pennington. Costa. So. Shing, Hirose, & Niedzielski, 1997) to survey ESL teachers'
practices in writing instruction. I was aware that the survey instrument designed
11 Pennington et d ' s ( 1997) instrument highlights contrasts between process and product approaches
expressly for writing classroorns per se wouid not be exactly suitable to the situation where
Kei had to incorporate both reading and writing components into one course. As 1 had
espectcd, Kei found it difficult to answer the questions. Nonetheless, her responses were
useful to veri fy what I thought were her conceptions of writing. language, and education
more generally.
How are the ivrititrg ~nskssituated in the JFL course? Hoiv does tfw
Nrstrrictor perceive the role o/writittg, the reachirzg of ivriling, and the
teachitzg 01JFL?
1 address these questions by telling a story about Kei and her classroom. The story
tells how Kei's patterns of interaction with this particular teaching context evolved over
the period of my research, shaped by her students and her moment-to-moment thinking. 1
summanze what happened in her classroom in relation to writing activities. focus on key
episodes. and delineate central elements, so as to construct an illuminating nanative.
As mentioned earlier, there are two highest-level courses in the Japanese language
at the university where Kei taches. One focuses on speahng and listening and the other
on reading and writing. The latter is the course Kei was assigned to teach in the year of my
research data collection. Kei was given freedom in the development of a syllabus for this
course. There were no institutional guidelines that she had to follow as to what, how, or for
what ends to teach. Nor was she constrained by any particular cumcular ideologies. A
pensa1 of m y classroom observation and teacher interview notes presents the following
pp - - - - - - -
to the teaching of writing, solicitiag the respondent's general view on the teaching of writing as well as his or
her specific ciassmm practiccs. .Most of the 22 items on the questionnaire are to be answered on two 5-point
scales: ideal and actud. AIso space is provided in each item for open-ended comments.
synopsis of Kei and her teaching.
Progressivism may be the best word to c h a n c t e n z e Kei's orientation to this
cumculum. This cumcular ideology was tacit, if not explicit, in what 1 heard from Kei and
what 1 saw in her classes. I t provided a direction to the role and purpose of her cumculum
constnicted around a series of themes, focusing on the expressive and creative functions of
written language. The cumculum developed in the context; it received modifications and
changes as Kei felt the need for pedagogical adaptability or encountered unplanned
teachable moments in the course of her teaching. Moreover, students were consulted about
the specifics of the syllabus such as the thernes to be studied and the g n d i n g scheme. In
short, her curriculum was, o r at least intended to be, leamer-centered, process-onented, and
meaning-focused. Kei's cumcular orientations were manifest in her responses to the 6-item
questionnaire (Table 2-1, Appendis C ) asking her to rate retrospectively on the ideal and
acti~al5-point scales certain aspects of her teaching of J E writing in the year that 1
observed.
Table 2-1
Kei 's Respomes 10 the 6-hem Qrrestiomiaire on Teacher Beliefs alzd Practices oJ Teacking
of Writirig
' Item# IDEAL ACTUAL
1 4 2.5
Note. The higher the rating, the more proccss- and leamer-centered the teacbing orientation.
In this curricular context, how did Kei perceive and approach the writing
component of the course? AIthough it was the third time for her to teach this Japanese
reading-and-writing course, Kei was particularly unsure of and uneasy about the teaching
of the wri ting component. The what, how, and why of JFL w riting instruction were Kei's
long-standing. unresolved pedagogical questions. Partly because of these unresolved
questions and also because of time constraints, class tirne was spent alrnost exclusively on
reading activities. Initially Kei was not cornfortable about the skewed weight placed on
reading in the enactment of her cumculum as she felt she was not teaching to the ritle of
the course. Toward the end of the course, however, she came to terms with the reality in
her own rvay. She said, "In the fïrst term 1 was overly concerned about not spending
enough time on the wnting component. But 1 have redizcd that i t is almost impossible to
teach both s h l k satisfactonly in a 7-hour-per-weekcourse. If airning at two is unrealistic, 1
should instead locus on one of the two and work torvard the students' substantial gain in i t"
(Interview notes, March 1, 1995).
Writing esercises rarely took place in class; they were instead given as homework
assignmenis. Nonetheless, connections were made between the reading activities in class
and the wnting assignments to be done at home. 1 now tum to cumcular events that put
these two components together. 1 describe a series of classroorn activities leading to each
of the two major wnting tasks (Task 1 and Task II), in which the students participating in
my study produced think-aloud protocols, as well as the espenences and images12 Kei
brought to her teaching practice.
Both Task 1 and Task II were given to conclude two respective cycles of theme
study through reading matenals. The first theme was Japanese popular culture. Students
and teacher together decided to read about rnnrrgn-bzrimrr (a phenomenal boom in comic-
book stories) in Japan. By teaching to the interests of her students, Kei was hoping to
12 Clandiriin (1986) provided a unique account of the link betwcen experience and image as is relevant
to teachers' "personal practical howledge" (Connelly & Clandinin, 1988).
create intellectually stimulating and engaging events that wouid enable the expansion of
the students' minds. Kei selected reading passages from authentic materials such as
newspaper articles as well as contrived JFL texts. Her approach to the instruction of
reading and her rationde for i t may be best understood by reading the following excerpt
from rny interview notes in which 1 constmcted my interpretation of Kei's current vision
and action,
Kei wants her students to thitzk. Rather than just asking them factual
questions about reading texts or transmitting information on particular
topics. Kei wishes to go one step further. She wants her students to
reconstmct the text they are reading and make personally relevant meanings
of the text--Le., one step beyond the level of understanding what the text
says. Most common questions that foreign language teachers ask to students
in class tend to be very simple and purposeless. Kei would not be satisfied
with such instruction; she would rather seek for spnce during the class time
for students to reflect upon themselves, Iearning materials, and relations
between themselves and the matenals. To get this point across to me, Kei
referred to the current lessons undenvay on the topic of rrratiga-biciinu. In
these lessons she would ask display and referential questions about the
content of reading passages to make sure that the students have understood
the content. Furthermore, she would try to exploit the students' cognitive
capacities to discuss relevant issues such as influences of reading comic
stories upon the human mind. Kei's purpose for this latter activity is to help
her students espand their mental lives. (Interview notes. October 10. 1994.)
Kei found her students overly concemed with word- and sentence-level problerns,
far from the stage of treating JFL reading as "real reading" (Le., reading for meaning) or of
engaging in an active process of constructing testual and personal meaning of written test.
Based on her belief that no student should ever be encouraged to limit him- or herself to
mere decoding skills, Kei decided to devote a substantial amount of time and attention to
such top-down concems as reading for global meaning until her students would develop
skills to read Japanese tests for meaning and make educated guesses at meaning without
definitively knowing each and every word. I n response to some students' persistent
concerns about the accurate identification of lexical and grammatical forms, she would
Say, "Now you are reading in quanti ty and for meaning, so do not try to read word by
word. Do not stop at each and every gramrnar point that you are not sure about. Instead,
use context to guess the gist of the text" (Filed notes, October 27, 1994). Through this
meaning-focused instruction students were encouraged to regard the JET written text as
something that has content--nther than something that merely consists of linguistic mies--
as they would normally do with their native language reading.
Did Kei succeed in realizing her instructional goals? Yes. to some extent. During
the four class sessions on the topic the students were willing to go bepnd what they were
reading in class. Some students voluntarily brought a comic magazine, audiotape. or
videotape that contnbuted to animated discussions in the classes. They were also happy to
share their personal esperiences with comic books. 1 rvrote my reflection on the day of rny
observation of the second session on the topic as follows:
I found the entire class were enjoying the topic. Especially during the
discussion of Japanese comics, they were so animated and engaged. And
they did this so naturally that I did not realize that they were using a foreign
language to espress themselves. Kei seemed to have felt the same way as I
did. She said later that she was arnazcd at the students' receptiveness to her
teaching style and their involvement in reading and talking about their
collectively chosen topic. (Field notes. Oclober 20, 1994.)
The active student discussions observed that day were not a one-time incident. On my visi t
to the fourth session on the topic 1 made a similar observation:
When the discussion started, the classroom climate changed suddenly. That
was most striking to me. That was far from a common image of a "bland
and contentless" foreign language classroom. The use of the Japanese
language did not secm to be hindenng the students from speakng up. (Field
notes, November 3, 1994.)
During the fourth and final session on the topic of Japan's nranga-burtmii. the students were
given a list of questions in writing about the merits and drawbacks of reading comics. They
were asked to discuss the questions in a small group of ihree or four and formulate their
collective responses to share with the rest of the class. My fie d notes on this session
record:
During the 30-minu te discussion the students and teacher were drawn into
ivlint was k i n g said. Even the norrnally quiet students like Jane and Charles
s p o h up to offer their opinions. The whole class was, it seemed to me,
competing to say their say irz Jupurzese . (Field notes, Novem ber 3, 1994.)
To wrap up this discussion, Kei wrote down in point form (and in Japanese) o n a
blackboard ail the positive and negative points of reading comics raised by the students.
Most of the students diligent1y copied what Kei wrote on the board in their notebooks. A
few months later Kei retrospectively descnbed this discussion as a pre-writing activity
utilizing brainstorming and listing techniques (Interview notes, February 23, 1995). In the
last five minutes of this session Kei explained dl in Japanese what was expected of the
first major writing assignment (Task 1). Foilowing is an abbreviated English translation of
her instructions. They were given orally; no wntten instructions about the task were
provided.
Kei repeated the above information, in slightly different ways, a couple of times while
giving the instructions for this assignment, probably wishing to be assured that her points
got across to the students. Kei also required the students to make a n outline in either
Japanese, English, or both, to organize their ideas M o r e starting to wri te an essay. The
students were asked to turn in their outlines as well as their final products. There were no
questions about this assignment [rom the students.
I n hindsight Kei thought this task was too controlled to allow originality.
According to her, most of the students' essays contained no more than what ivas talked
about in class (Interview notes, January 21, 1995). The students perceived variously the
provision of specific information on content, rhetoncal patterns, and language for Task 1.
as revealed in their written comments given in the Task 1 pst-writing questionnaire. 13 For
instance, Judith cvho "ivas not so much motivated to wnte on rriatiga [comics]" felt that the
pre-writing discussion in class had made the writing task easier. But there were Cathy and
Mary who had initially thought that the task could be easier because of the pre-wnting
discussion but in fact found the task to be still difficult. Both attributed the difficulty to
their lack of linguistic cornpetence in Japanese. Colin had something interesting to say:
It is easy to :nite a composition when al1 the necessary information
including vocabulary and sentence structures [as Kei did] are laid out on the
table. In a sense, the difficulty for a foreign language leamer is that the
writing process c m be quite technical. After all, to achieve greatness in
writing, unconsciousness plays a major role. (Colin's wntten comments in
the Task I pst-writing questionnaire.)
The session right after the completion of the first theme study was the beginning of
the second theme study, living in Japan. This study lasted 5 weeks with 3 sessions before
and 2 sessions after the winter break. It proceeded differently [rom the first theme study.
First of all, instead of focusing on one particular topic of the chosen theme. reading
materials for this theme study covered different topics such as young people's employment
opportunities, male-female differences, and societal structures in Japan. They were al!
contrived to suit the leamers' Japanese proficiency levels; a list of vocabulary needed for
each reading was given. Kei's instruction included lexical and structural exercises.
comprehension check (display) questions, and extended (referential) questions for
discussion. 1 noted a shift of instructional foci. Statements Iike the one below, which Kei
made in the second session of the new theme study, were never heard during the course or
the first theme study.
- -
13 See chapter 3 for detailed information about individual students and chapter 4 for an explanaûon of
Do you want me to go over some grarnmar as well? (Some students nodded
their heads in agreement.) Some of you seem to be needing some grarnmar
exercises. So let us work on this (refening to structural and lexical exercise
worksheeis accompanying the reading text under study) today. Also while
reading, if you have any questions about grammar, ask me. 1 will explain to
you. (An English translation of Kei's Japanese utterances tnnscribed in
Field notes, November 17, 1994.)
In the interview we had two days after this class session, Kei made the following rernark as
if she were speahng to herself:
What 1 [i-e., Keij really want is to have the students express their opinions
and share their own experiences in relation to what we are reading in class. 1
want to do something more than explaining grammar and vocabulary,
something substantial and meaningful for their lives. But at least one third
of the students in the class are still struggling with structural and lexical
problems. How can they possibly engage in meaning-construction processes
without a sufficient degree of grammatical and lexical control over the
Japanese language? (Interview notes, November 19, 1994.)
Around this time Kei was having individual conferences with the students to discuss their
Japanese language studies during her office hours and noted that "they have different
problems and these problems are mostly micro-level issues" (Interview notes, November
17, 1994).Apparenlly she saw the firne had corne, the time to pay more attention to micro-
level linguistic problems. On the other hand, meaning-focused activities. mostly in the
form of discussion, continued concurrently.
1 saw the curricular even& happening in these sessions a s a pedagogical application
of the interactive view of language processing in reading (e.g.. Adams & Collins, 1979;
Carrel1 et al., 1988; Lesgold & Perfetti, 1978) that aims at the development of top-down
and bottom-up language processing ski[ls, although Kei did not articulate her pedagogical
stance in such terms. I n making instructional decisions, Kei constantly experienced an
intemal stmggle to be coherent and accountable. For instance, in an interview after the
class that ernphasized the study of small units of text such as words and phrases, Kei
confided to me her concems about effects of language-focused esercises that tended to bc
During the winter break Kei was in Japan participating in a 5-week JFL teacher
training course. As it turned out, this experience brought significant changes to her
teaching in the subsequent classes after the break. There are two things about her
experience in Japan that are important and relevant here. Among the courses offered
during the training session, Kei found the course on the teaching and learning of E L
reading most usefuI. The course served as a refresher of what she had learned--such as an
interactive approach to reading and a schema theory-in a course on reading taken at her
graduate school in Canada in the previous year. She was amazed at the advanced Ievel of
her understanding of the issues lectured on and discussed in the classes this time. She tried
to explain to me, "My better understanding of theoretical issues this time was. I think,
because the course was offered in Japanese" (Interview notes, January 5, 1995). She did
not dismiss another possible reason, her previous exposure to the same or similar
information. But she apparently preferred to emphasize the former reason. More than once
in the same interview, she said to me, "It was so much easier to do things in Japanese. I
could read so much and so quickly yet 1 could understand better [in Japanese]" (Interview
notes, January 5, 1995). She then added. "I've never realized that doing things in a foreign
language can be so difficult" (Interview notes, January 5, 1995). This realization of hers
made her more sympathetic toward her JFL students grappling with language problems.
Consequently, she began to see micro-level language issues more senously than before.
Another important point about Kei's experience in Japan was her learning of the
J F L text readability measurement research based on Klare's ( 1974) work. Using the
formula given by this JFL readability measure, Kei assessed the readability of the written
texts she had used in the first hall of the Japanese reading-and-wnting course and figured
that they were far beyond the proficiency levels of most students in her class. She began to
think "the texts were probably linguistically too difficult for the students to activate fully
the cognitive faculty that processes language for connection and comprehension"
(Interview notes, January 5, 1995). My interview notes record:
Classes after Kei's trip to Japan differed from the preceding ones. They were more
carefuliy pre-organized and systematic, following the sequence of content schema-setting
activities, linguistic schema-setting activities, and reading comprehension esercises. The
used in expressing one's opinions and making an assertion that are subtly different from
one to another depending on the wri ter's intention and the degree of his o r her confidence
in the statement he or she is making.14 This particular focus of instruction l5 was, as Kei
14 [a)
Forty-seven expressions of this kind were presented to the students. They included ornou think],
omowareru [it secms to (me)], dervmakarooka [isn't that ...?], and nakerebariaranai [ m u t beldo].
15 The usefdness of such instruction was meotioned expressly by Jme in her written comments in the
Task II pst-writing questionnaire and during the interview. It is unknown, however, how the other students
thought of such language-focused instruction.
had exphined to me in our interview two days earîier (Interview notes. January 34, 1995).
prompted by her discovery of the flat and du11 tone of the students' writing in the previous
assignment. Kei thought their compositions lacked the variety of such expressions.
The second writing assignment (Task II) was to write an essay based o n the
readings about living in Japan. Kei t a i h d about the assignrnent for 2 minutes, a11 in
Japanese. As in the case of Task 1, no written instructions were given. No question was
raised by the students about this assignment. The following is an English translation of
Kei's instructions about the task:
W e have been reading on various topics about living in Japan f o r the past
several weeks. For this writing assignment, I want you to pick up one from
those topics you've found most interesting and present your opinion on it.
When you write this composition, you may, for instance, Say something like
"1 have read such and such a thing in class but I think such and such. 1 agree
with these points but not with those points. And my opinion i s such-and-
such" o r something like that. 1 would like you to follow this kind of
presentation pattern. And &O, you don't have to limit yourself t o the course
readings. You may refer to o r quote from the readings you may have done
on your own. (An English translation of Kei's instxuctions for Task II.)
A s it turned out, nor al1 the instructions were heeded by the students. It was
"disappointing" for Kei to find that most of the Task II essays were merely descriptive or
expository without the statement of one's opinions. She regretted that not al1 of her
instructions about this writing task were acted upon by the students. Nonetheless, she was
pleased to see more originali ty in the Ta& LI essays and thought that "they are better
wri tten than the Task 1 essays" (Interview notes, February 23, 1995).
Kei's approach to JFL writing was undoubtedly what Reid (1993) called "writing-
based" n t h e r than "language-based" (p. 29). Kei's teaching emphasized JFL wnting as a
cognitive ski11 rather than a language or grammar skill. This d w s not mean. however, that
Kei dismissed the importance of "micro-monitoring" ski11 in discourse production; rather,
her intended focus was to allow interaction between "macro- and micro-moni toringn (Ellis,
1994, p. 132) skills in the process of creating compositions.
For both the Task 1 and Task II assignments Kei required the use of a specific
organizational technique for presenti ng wri tten discourse: the development of paragraphs
by presenting pros and cons of a selected issue and stating one's opinions about them.
However, this organizational pattern was inconspicuous or simply non-esistent in the tests
written for Task II, whereas it was manifest in evet-y student's writing for Task 1. As a
consequence, the two writing assignments stand in contrat in tenns of their modes of
discourse; Task I was argumentative and Task II fundamentally descriptive or informative.
There are other differences as well. The Task 1 assignment was, in a way, more
controlled than the Task II. No choice of topics was given in the former task, whereas in
the latter the students were free to wnte on a topic of their choosing under the broad
common theme of living in Japan. A discussion preceded the assignment of the former as a
paraphrase some of their remarks about the two tasks from individual interviews (see
section 3.9.3), "not on1y the necessary information" (i-e., content) "but also the structure"
(Le., rhetorical organization) "was provided" for Task 1, but Task II was "a write-whatever-
and-however-you-want kind."
Chapter 3: Students' Characteristics
It was on my second visit to the class that I was given the first 10 minutes to talk
about my research and to distribute a letter asking students to volunteer for the research.
Volunteering was considered desirable as participants would have to be willing to offeer
extra time and energy to complete such tasks for the research as producing extensive
verbal reports while writing compositions and attending interviews. The letter was written
in English. stating the nature of the research tasks to be camed out by participants
(Appendis D). I t also indicated that the research findings 1 would obtain were to be used
for doctoral research and that participants would be given a stipend of $100 as tvell as
individualized suggestions for irnproving their Japanese wri ting in retum for their
participation in the study. Thirteen students signed a form of consent to participate in the
study by the end of that class session. l 6 This unespectedly large tumout (86.7%)was. as I
found out later. mainly due to my offer to pay US$60 for each person to take a
standardized onl proficiency intenriew test, one of the required research tas ks. Apparent1y
they were anxious to know how proficient they were in Japanese through a standardized
means of assessment.
16 One student decidd to participate Iater but withdrew after a trial think-aloud session.
36
A questionnaire and interviews were the primary methods 1 used to gather profile
information about the student participants. Al1 necessary contacts with the participati ng
students were made while 1 was in the classroom, normally during the time waiting for the
teacher to a m v e and begin a lesson. No request was made of Kei to spare any of her class
time for this purpose. Additional contacts were made by phone later to rnake sure that the
participants received my instructions correctly and to provide them with an opportunity to
ask me questions.
A week after they signed the consent form for their participation in my study. 1
gave the students a Cpage questionnaire (Appendix E), asking them to complete i t at home
and retum it to me in the following class session. The questionnaire was wntten in English
and based on the background questionnaires used by Cumming (1988, pp. 322-224) for the
study of ESL writing and by Oxford (1990, p. 282) as a supplement to the Stntegy
Inventory for Language Leaming instrument. The questionnaire sought information on (a)
general and linguistic background, (b) experience with the Japanese language, (c)
motivation for learning Japanese, (d) self-evaluation of Japanese overall and wri ting
proficiency and of first language (Ll)17 wnting proficiency, and (e) writing habits in
Japanese and LI. Table 3-1 presents a surnmary of the participants' responses to the
selected items of (1) ethnicity, (2) oral LI, (3) written L1, (4) self-rating of L l writing
proficiency, (5) degree of importance of learning Japanese, ( 6 )length of residence in Japan
- - - - -
17 In this thesis, the term Jîrst language or LI refers to the language a person feels most cornfortable
using. It may or may not be a person's rnother tongue or the language aquired first. A persoa may have
different LIS for oral and written communication. Sm Richards, Platt, and Platt (1992. p. l m ) and Stem
(1983a. pp. 9-13).
in the past 5 years, (7) self-rating of overall Japanese proficiency in cornparison to JFL
pers in class, and (8) in companson to native speakers of Japanese, and (9) self-nting of
Japanese wnting proficiency in cornparison to JFL peers in class, and (10) in cornparison
io native speakers of Japanese.
Table 3-1
Strtderr ts ' Characteristics
Partici-
- Wri tten Self-
7
Self-
pant L1 rating of rating of
Japanese Japanese
Jasmine English
-writing writing
cf. cf ass cf. native
[air
Judith
JOy
FPnlpl
Ja ese En ish
,
Engiish
English
poor
fair
Cathy
Colin
Charles Chinese
Mary
Mike
-4-
Chinese s~andyin
English
- -
fair
Eddie goai
"m i year fuir POO' fair
3.2.1.1. Participants' Ethnicities and Lls. Each of the 13 students who stayed
throughout the research penod was identified by a pseudonym beginning with the first
letter of the ethnic group to which he or she belonged. Five of them (Jasmine, Jane,
Judith,l8 Joy, and Jack) were Japanese by ethnicity; ail escept Jasmine were born to native
Japanese parents and schooled in Canada. Jasmine, whose parents were also native
lapanese, was born and raised in Brazil until s h e moved to Canada with her family at
Grade 4. Six students (Cathy, Colin, Charles, Mary, Mike, and Martin) were Chinese by
ethnicity. Cathy, Colin, and Charles spoke Cantonese as a mother tongue and were
educated in Hong Kong until they rnigmted to Canada with their families 5 o r 7 years ago.
Mary, Mike, and Martin spoke Mandarin. Mary and Mike came to Canada as immigrants
when they were in Gndes 7 and 4 respectively, w hereas Martin was bom to a Mandarin-
speaking family in Canada and schooled in English here. [t may be important to note,
because of some shared elements of the Chinese and the Japanese writing system (see
Taylor & Taylor. 1995), that the 3 Cantonese-speahng students and Mary possessed a
relatively high levef of Chinese litemcy, that Mike's Chinese litency was at an elementary-
school level, and that Martin could speak but neither read nor write Chinese. Eddie and
Eliot were white anglophone Canadians of Anglo-saxon origin. Since 1 know al1 these
languages myself, 1 felt capable of handling these participants in the research.
3.2.1.2. Participants' Ages and Major Fields. The participants' ages ranged [rom
18 to 25. Al1 the students were in the final year of their undergraduate studies escept for
the 9- sophomores, Jasmine and loy. Five students (Joy, Jane, Jack, Martin, and Eliot) did
not choose Japanese-related subjects as a major field of their studies; their majors were,
respectively, immunology, psychology, commerce, electncal engineering, and physical
pography. The other students majored in Japanese Studies alone o r in combination with
other subjects such as economics and linguistics. Colin was then p u n u i n g a second
bachelor's degree in Japanese Studies; he had previously obtained a bachelor's degree in
science [rom the same university. Most of the smdents were multilingual, knowing
languages other than Japanese and English.
l8 Judith had a Japanese mother and a Chinese father and comrnunicatcd with the mother in Japanese
but in English with the father. Her Chinese roou were thin as she spoke no Chinese. For this reason. 1
wtegorized her wi t ' i n the Japanese ethnic group in this shdy .
3.2.1.3. Participants' Experierices with the Japanese Lunguage. The students'
esperiences with the Japanese language varied. Jasmine. Jane, Judith, and Joy had, as it
were, lived with the Japanese language throughout their lives, whereas Jack stopped using
Japanese altogether on entering kindergarten; he then decided in adulthood to re-leam the
language by taking Japanese language courses at the university. Ail the other students took
up the study of the Japanese language through formal instruction after entenng the
univenity, though some students had tned to learn some Japanese by themselves before.
Eddie spent a year at a university in Japan as an eschange student in his junior academic
year in 1993-94. Martin and Eliot spent the same year in Japan but as Company trainees
rather than as students. This arrangement was part of the university's special Japanese
language prognm for professional purposes in which Martin and Eliot received a year of
intensive formal instruction in the language prior to their departures to Japan. by attended
for two years an international high school in Japan, where al1 subjects were taught in
English, before she enrolled in the university in Canada. Judith was enrolled in a JFL
teacher-training course in Japan for a year in 1992. Al1 the other students had neither been
to Japan nor visited there.
3.2.1.4. Participants' Motivatiotis for Learning Japanese. Despite their
differences in age, major field. ethnicity, and experience with the japanese language, the
students were al1 motivated to pursue their study of Japanese. The?; indicated high levels of
cornmitment, interest, and motivation at various occasions. According to their responses to
Item II-(@ of the background survey questionnaire, they were al1 interested in the Japanese
language and culture and needed or wished to use the language for their future careers. The
students of Japanese ethnicity, except Judith, mentioned that their Japanese language study
was also motivated by their desire to maintain ties to their relatives in Japan and to
preserve the sense of their own heritage. Furthermore, the latest news of the students 1
received in spring 1996 proved that their motivation at that time was substantial and
continuing. lasmine, Jane, and Judith had since been training to be JFL teachers. When his
plan to live in Japan upon graduation failed, Jack went on to a law school at another
university in Canada espressly to becorne a specialist in legal matters concerning Japan-
Canada relations; he chose to live in a dormitory where the majority of residents were
Japanese students [rom a university in Japan. Cathy had a full-tirne job but was worlung as
a volunteer clencai assistant for a Japanese heritage-language program every Saturday just
because she wanted to stay in touch with the Japanese language and people. Colin was now
preparing to write a thesis on Japanese history for a master's degree which he had been
pursuing at the same university alter graduation. He was also hoping to be awarded a
scholarship to conduct research in Japan. Upon graduation Mike retumed to his native
Taiwan [O help his father's business that had a number of contacts with companies in
Japan. Martin was completing a master's degree in engineering a[ an Arnerican university
and had k e n promised ernployment by a large Company in Japan. Eddie had recentl y been
admitted to a master's program at the university of his undergraduate study and was
planning to do research on Japanese religion. Eliot was pursuing a master's degree in Japan
on a scholarship. It was toward these goals that the students probably wanted to improve
and refine their Japanese during the year 1 conducted my research. I n fact most of them
were concurrently taking the other highest level course of Japanese speaking and listenine
taught by another instructor, another apparent indication of their high motivation for
Japanese language study.
had wntten for homecvork assignments in the course (and that are the foci of my
investigation) were used as sarnple essays for the assessrnent of the participants' Japanese
writing proficiency. The length required in both tasks was about 2 pages of regular-six
writing paper or gerikooyooslii (Japanese and Chinese manuscript paper conwining 400 or
500 small squares into each or which one chancter fi ts). The average num ber o l characters
per essay was around 800 to 1000. When 1 obtained copies of the submitted essays, which
were al1 handwri tten, 1 typed them before giving them to nters for fear that the writers'
idiosyncratic handwriting and the untidy appeannce of some of their tests would affect the
nters' judgments of the quaii ty of the essays 19 (see Appendis F for typewritten sample
essays). In making these transpositions to typed test, 1 did not correct or edit the essays,
however.
For the L1 essays, al1 the "J."~O"M" (escept Mary), and "E" students wrote
compositions in English of MO to 600 words in length under the ritle. "What the English
language means to me." The "C" students and Mary wrote compositions in Chinese of 700
to 1 0 0 characters in length under the title, "What the Chinese language means to me."
Cathy, Colin, Charles, and Mary, who considered Chinese to be their wntten LL and wrote
Chinese essays, also produced essays in English under the same title " What the English
19 Some people may consider the quality of handwriting as one feature not to bç negfected in assessing
an essay (Vaughan, 199 1). For the purpose of the present research, however, 1 decided that readers should not
confuse the appearancc of a papa with the quali ty of what is said and how i t is said in the papcr (CarIson.
1991, p. 308).
20 Joy failed to produce an L1 essay.
language means to me" 4 months dter their production of Chinese essays, to see if there
were any differences in the quali ty of their writing in the two languages. Al1 these essays
were wri tten expressly for my research and produced at home on participants' own time.
Most of the English essays were wordprocessed and al1 the Chinese essays were
handwritten. The handwritten English essays were typed without correction or editing, for
the sake of consistency, before submitting them to nters. The Chinese handwriting was
neat and the appearance of the essays was tidy. Therefore, the Chinese essays rvere given
to n t e n as they were. The topics yielded both narrative and descriptive modes of rvnting.
Incidentally, these essays provided me with useful information about the writers' linguistic
experiences and helped me understand the individuai students better.
3.2.2.1. Writing Assessnlent Itislshument. There is no single essay scoring scheme
applicable to al1 Ianguages or dl contexts (Purves, 1992). But there seem to be certain
common elemen ts essential to corn p s i tions wri tten in any contest. Jacobs, Zinkgraf,
Wormuth, Hartfiel. and Hughey (1981, p. 34) pointed out three essential elements focused
o n by composition teachers, testers, and students since the time of Arktotle: what 20 sav
(content), hoiv IO orgnniie it (organization), and Izow to say it efectively (use of the units
of language). Because of these salient features of any piece of writing, 1 iavored multiple-
trait, nther than primary-trait or holistic, scoring (see Hamp-Lyons, 19%b, for an account
of different scot-ing procedures) for the assessrnent of the English, Chinese, and Japanese
essays. Besides, "the multiple trait procedure possesses psychometric properties that
enhance the reliabiliiy of single number scores built from its components" (Harnp-Lyons,
199 1b, p. 151).Deciding how to obtain comparable scores between essays of different
languages in different contexts, 1 was faced with two choices. One choice was to ask raters
to make judgments on their own intuitive criteria and to rate on a 4- or 5-point scale the
quality of each of the three main components--content. organization. and language use.
The other option was to use an established instrument with scoring criteria capable of
scoring an essay on the above components, pending the question of "tnnsferability"
(Hamp-Lyons & Henning, 1991, p. 338) across languages o r tasks. 1 chose the latter option
and considered Ham p-Lyons's 9 - p i n t s c d e as a candidate (Harnp-Lyons, 199 1a).
Hamp-Lyons's scale, known as the New Profile Scale, was developed to be used in
scoring the wnting component of the British Council's English Language Testing Service
(ELTS) test (1980- 1989) taken by pst-secondary nonnative speakers of English wishing
to attend college o r uni versity in Britain (Hamp-Lyons, 199 1a; Hamp-Lyons, 199 1b;
Hamp-Lyons & Henning, 1991). Naturall y the task type and scoring procedures of this
writing test reflect what is vaiued in writing in the western academic contest. One obvious
esample is the inclusion of the argiirnentatioti traits in the scoring instrument. Considering
apparent differences (in languages involved, purposes, tasks, writing conditions, etc.)
between the ELTS and rny research context, the application of Hamp-Lyons's scale (the
version given in Hamp-Lyons, 1991a. pp. 149-151) to the latter may seem problematic. On
my examination of the instrument, however, 1 found the criteria or band descriptors fairly
general and appropriate for the assessment of the essays 1 collected. 1t certainly remains a
21 According to Hamp-Lyons (1991b). "the safest way to combine scores is to weight each facet
equally" (p. 249; cf. Jacobs et al., 1981).
(Appendix G). 1 used trait scores to examine the qualities of Japanese essays (see chapter
3.2.2.2. Writing Assessrneni Raiers. In all, seven volunteer raters were involved: 2
English, 3 Chinese." and 2 Japanese (see section 5.1.1.1for more information about the
Japanese raters). They were al1 native speakers of the respective languages. The Chinese
and Japanese raters were al[ balanced bilinguals of Chinese or Japanese and English, which
made it possible to present the scoring instrument in its original English form. Al1 the
raters were experienced language teachers familiar with recent research on writing. One
Chinese rater had taught for 5 yars and al1 the others had teaching esperience of 10 to 18
years. One held a Ph.D. in language education; two Engiish raters held master's degrees in
Teaching English as a Second Language; the rest were complcting a Ph.D. in second
language acquisition at the time of the nting. They were told that scores would be used
only for the purpose of my research and that the wnters would have no access to the
scores. They were also informed that the essays were written by native or non-native
speakers, but no other information on the wrî ters was disclosed for ethical and halo eflect
considerations. In fact the raters had never met the participating students. Due to some
diffïculties in making arrangements, no special training was provided to the raters except
the written instructions on the nting procedures (Appendix H); nor were the conditions
under which the rating was performed strictly controlled. None of the raten had used
Harnp-Lyons's scale before. Despite al1 these unfavorable conditions, intemter reliability
correlations turned out relatively high, .76 for the Japanese essay ratings, .95 for the
English, and .90, -92, and .98 for the Chinese. These correlation coefficients were
considered sufficient to assure the ntings for this study were reliable.
22 Three raters, instead of 2 as are commonly utilized in many writing assessments, scored the Chinese
essays. A third rater. a Hong Kong Chinese. was added to the fmt two volunteers. who werc bolh cducated in
the People's Republic of China (PRC). because al1 the Chinese essays in the present study were wrirten in the
original form of Chinese charaeters used in Hong Kong and Taiwan nther than the simplified version which
is the standard written Chinese in the PRC.Among these C h i n e s e - s p e - gplaces, however, there should be
no differcnt standards applied ta rtietorical and grammatical requirements in a piece of writing.
3.2.2.3. Participants' Ltzriguage-Related Cltaracteristics. The students'
characteris tics on language-related factors are summarized in Table 3-2 (an expanded
summary of the students' characteristics appearing in Table 3- 1). This summary presents
the individual's Japanese and English or Chinese essay scores given by the two or three
nters as averages. '3
Some interesting features appear in Table 3-2. Al1 the ethnic Japanese students
except Jack were nted sirperior or ndvmrced-higlr on the JST and recei ved relative1y high
scores on their Japanese essays (28 to 34) as well as on their L1 cssays (30 to 35). The 3
non-ethnic Japanese students with recent residential experience in Japan (Martin, Eliot, and
Eddie) were nted odvauced-liigli or advnnced on the JST but their scores on the Japanese
essays (23 or 23) were not as high as the scores of the high JFL-proficient ethnic Japanese
students. although their scores on the L1 essays (31 to 34) were comparable. The other
students fell in the infermdia~eband of the JST rating scale; their Japanese essay scores
m g e d between 15 and 26 while their LI essay scores were between 23 to 35.A condensed
surnmary of these trends is given in Table 3-3.
23 1 was toId during interviews that Mary, Martin, and Eliot had their Japanesc friends r a d and correct
their Japanese compositions for Task II before handing h e m in. Thus, the scores given to their Task II essays
were excluded from this calculation. Ai1 other essays were submitted without any input from others, as 1
verified during the interviews. Two sets of Japanese essays (Le., Tasks I and II) were averaged. for al1
participants except h l q , Xhîin, and Eliot, to generate scores indicating their Japanese writing proficiency.
Cathy, Colin, Charles. and Xlary received two sets of scores for their L1 writing, one for the Cbinese
and the other for the English essay. Thcir Chinese çssay scores wçre substantidly highcr by 4 to 8 points so 1
u s a i that measure as an indicatian of rheir L 1 w ri ting expertise.
Table 3-2
M c i -
P t overdl
writing
witing
WY.36
cf. clas; native
I cf. ctass: oative
Cathy
Colin
-L
Cantonese
1
Cantonese
I
Chinese
Chinese
1
fair 30 O Pmr. Pmr
4-
+
Charles Cantonese Chinese
Eddie
-4-
English English excellent 32 1y m
1
gd;poor
advanced 1
g d ; poor
[air. poor 1 33
Table 3-3
Surnrnary of Striderrts' L1 Wriiirzg,JFL Oral. and JFL Writirzg Skiiis
1
Participants LI essay scores E L orai proficiency leveis JFL essay scores
superior
"Ji's (except Jack) 30 - 35 advanced-hi& 28 - 34
advanced-high
"E"s& iMartin 32 -34 advancd 22 -23
Jack, "C"s& %l"s
23 -35 intermediate-high, mid, low 15- 26
(except Martin) h
Another curious trend in the data is that the high JE-proficient ethnic Japanese
students evaluated their cornpetence in writing in Japanese to be only fair or poor w hen
they were asked to assess it as compared to other students in their class, but they
considered thei r overall Japanese proficiency to be good in corn panson wi th thei r peers.
And their Japanese compositions, in fact, received high scores. Eliot, Eddie, and Martin
rated their overall and written Japanese likewise as good orJair relative to other students in
the class, which does not fit well the gap we find between their JFL oral proficiency levels
and J E essay scores assessed by JFL specialists. The intermediate JFL-proficient students
(escept for Jack) also rated their o v e d l and written Japanese similarly but at the lower end
of the scale, i.e., fair or poor. 1t is difficult to make sense of this trend. But one thing that
might be said is that the orally proficient ethnic Japanese learners were overly concerned
about their less skilled writing ability and underestimated their actual cornpetence in
writing in Japanese. In other words, writing was probably a specific concem for them,
whereas, for other students, it was not necessarily a focal point of their Japanese language
studies but just one of many aspects to be improved.
For the participants' self-ntings of L1 writing skill, Jack. Colin, Martin. and Eliot
rated theirs as excellent. If we suppose that the rating of excelle~ztrefiects a high degree of
confidence in written language, such confidence indicated by Jack and Colin does not
seem to have been camed over to their Japanese writing esperiences: they assessed their
Japanese writing skills as only fair or poor. This may be because of their insufficient
ability to use the target language (though Jack indicated his confidence by rating his
overall Japanese proficiency as good). On the other hand, Martin's and Eliot's ratings of
their Japanese writing skills as good rnight be related to their confidence in writing,
Japanese, or both. The other students nted their L1 ivriting skills as good or fair and might
have considered themselves "average" writers who could write (but not particularly well)
or "inexperienced" wri ters who had little pnctice in wri ting. Self-reporting and self-
assessrnent data pose questions of reliability and validity, and they necessarily have
limitations. Nonetheless, such data can assess people's psychological s tates about the
matters quened. In my study these self-rating data were consulted to examine participants'
attitudes toward Japanese and L1 writing.
My study focused o n the two major writing tasks the students worked on for the
course. How did the students perceive the tasks? What were their expectations o r targets in
these tasks? T o understand the students' viewpoints, 1 met wi th the participants
individually or in pairs (according to their preferences)ZJ for 20 minutes to 1 hour between
Febniary 28 and March 16, 1995, after their completion of the second task in rnid
February. The interviews were conducted in English and structured around four main
questions probing for information on the students' perceptions of JFL writing and leaming.
The questions were:
1. What do you think you learned from writing the two compositions for the course?
24 There were 7 individuals and 3 pairs (Jasmine and Martin. Judith and Colin, and Joy and hllary).
The prepared questions for the interview were deliberately made broad and
redundant, probing for the interviewees' prime concems from different angles. A perusal
of the interview transcripts led me to identify five themes commonly talked about: (a)
conceptions of wtiting in Japanese, (b) expectations about one's own Japanese writing, (c)
problems in writing in Japanese, (d) experiences of leaming through wtiting in Japanese,
and (e) conceptions and experiences of wri ting in LI.
What stood out in the interview data (the full summary of the data appears in
A ppendix J) was the leamers' preoccupation wi th language production. Their prirnary
concem was how to put their thoughts into appropriate language. Apparently writing in
Japanese in this context, for them, was synonymous with ski11 in usage and structure of
language. It appeared that the students, regardless of their levels of proficiency in
Japanese, viewed JFL writing from the standpoint of language rather than ideational
content. Some s tudents were more explicit on this point than others during their interviews
with me. For instance, Martin did not "think the content is really importantwx; for Mike.
writing a Japanese composition was "a chance to practice using Japanese, focusing on the
right word choice and stuff'; and Eliot viewed writing Japanese compositions as "one of
the ways of getting better Japanese." Grammatical correctness was emphasized by Cathy,
Charles, Mary, Martin, and Eliot. Judith, Joy, and Charles felt that their lack of vocabulary
25 This and other quotes in section 3.3 wcre talrcn from the transcripts of respective individuals'
rernarks during their interviews with me, unlcss indicated othcnvise. The words are minimaiilly edited for
readability.
was hindering their writing processes. Such specific problems as the writing of kanjiz6 and
sentence-final expressions were raised by lasmine, Jane, Judith, Joy, and Eddie. Further,
most of these students associated their experiences of leaming through JFL writing with
the learning of some aspects of the target language. Apparently, writing compositions in
Japanese forced these IFL leamen to think about syntactic and lexical properties of the
Japanese language (cf. Swain & Lapkin, 1995). and this process might have served
functions conducive to L2 Iearning, as suggested by Swain (1995).
On the other hand, no one really mentioned the problem of coming up with ideas
for essays during the interviews (although Judith, Joy, Cathy, and Eliot spoke of their
concems about putting ideas together or the organization of ideas). Even Judith, who
struggled in vain to write something "personally meaningful" and "interesting" in order to
enjoy the writing processes, had enough things to write and did not talk about content as
her problem in writing in Japanese; instead, she saw kanji, vocabulary, and expressions as
hurdles. Joy "had to do a lot of research for the second [writing] task." Similarly, Charles
"had to get sorne information for the content of the essays." But it appeared that neither of
them saw this as a problem; rather, they attributed their content-related leaming
experiences to such work, and identified vocabulary, grammar, or both as their problems in
writing Japanese essays.
It seems that these adult lemers writing in a foreign language experience just the
opposite of what Bereiter and Scardamalia (1987) discovered about children's problems in
writing essays in their native language, ix., "problems of finding content, not of finding
26 Japanese texts are written in a mixture of different types of scripts. They use mostly Chinese
characters called kanji for content words and one form of a syllabary called hiragana for grammatical
morphemes. Because of the onhographic and semantic complexity, Japanese people expend an enormous
amount of time and effort on learning kanji. It is possible to write a Japanese text al1 in hiragana without
using kanji as in most texts intended for little children. But such texts, as Jane correctly pointed out dunng
her interview, "look very childish." See Taylor and Taylor (1995) for a detailed description of the Japanese
writing system.
27 Exceptions were Cathy and Charles. Cathy did not find anything substantial to have the sense of
learning in. Charles mentioned content learning, not languagc learning, as a result of his writing Japanese
essays; for language Iearning, he, rather, talked about "read[ing] a lot" as "the major point of studying
Japanese well." Jasmine. Jane, Joy, and Eddie indicated content leming (cf. Gere, 1985) as well as language
learning that might have resulted from writing Japanese compositions.
language to express it" (p. 62).*8Participants in my study, nther, had problems of finding
language to express themselves, not of finding content to wnte. In a way their attitude
toward J F L wnting overlaps with the picture of wnting behavior of unskilled mother-
tongue college students that has emerged [rom a nurnber of writing process studies (e.g.,
Perl, 1979; Pianko, 1979; Shaughnessy, 1977). depicting such writers as persistent1 y
concerned about sentence-level correctness.
For the students in my study, JFL writing was primarily a language production
activiiy. However, some students did imply that they also paid some attention to the aspect
of wnting concemed with "meaning making" (Flower, 1993, pp. 17-23) that pictures
writers engaged in the process of representing their thoughts, feelings, and images in text.
Jasmine, for instance, "tried to wnte [a Japanese essay] as a short essay like putting the
points down and esplaining why"; Judith emphasized the importance of finding topics ihat
are "persona11 y meani ngful" and "interesting"; Joy, Cathy, and Colin approached the
Japanese writing task in such a way as they would d o in creating text in their Lls,
following "the prewriting [process] that is basically the same" (Joy), focusing on the points
to be made in a piece of writing (Cathy), or "searching Tor an image, the sou1 of an essay"
(Colin).
It is difficult to find any clear patterns about the relations between students'
characteristics and their perceptions of JFL writing and learning. However, it seems that
highly proficient, native-like leamers are more able to expend their cognitive energy on
elements skillfully and automatically in a certain task leave attention free to be used for
28 See also Durst's (1989) and Langer's (1986a. 19û6b) studies indicating that elernentary and
secondary school mother-tonguc students of English paid proportionally less attention to such issues as
mechanics, syntax, and lexical choices whilc they composed; instead. these students focused more on
fonnulating ideas and relhement of meaning.
higher levels of information processing such as deriving and making meaning. There are,
however, a few cases in my study that do not fit exactly with this picture. I examine two
such cases--Jme and Colin--below.
Japanese, saying, "1 didn't h o w [my Japanese writing skill] was this bad." Because of her
strong sense of her hpanese heritage, she felt that her Japanese writing should be as good
as the writing of native Japanese people of her age, using "more decontive, mature, and
sophisticated forms" of words and espressions and more ka~rji.Writing hpanese essays
provided her with opportunities to be aware of the need of refining her Japanese and to
work toward that laquage-focused goal. Asked about her sense of leaming through JFL
writing, Jane did mention some learning of the content she wrote for the essays as well a s
language use. But throughout her interview, she emphasized her concems about language
issues in conjunction with her cultural heritage. Apparently she did not give much attention
to meaning making during her production of Japanese test; instead, she focused on
language issues.
3.3.1.2. C o h . Colin had a unique view of writing. Writing was an essential means
for him to make his thinking clear. He compared the process of composing a piece of
wnting to that of "playing a jigsaw puzzle" as both seek for a coherent whole. This
process, according to Colin, is valid in any kind of writing including the JFL writing
fiilling into the sea of Japanese culture." He continued, "There you c m pick up words and
expressions in the way [Japanese people] use natunlly." Bei ng an i ntennediate-level
leamer of Japanese, Colin saw language use as "a major barrier" in his production of
Japanese essays. But he took this fact calmly and confidently, saying, Wight now 1 am not
[at the stage where one can use language like a native] but this situation cannot iast for
cver ... When 1 read, 1 try to assimilate the [Japanese] language, give myself to it, and be
friendly to it instead of stmggling with it." Such remarks by Colin about Japanese language
learning are suggestive of his unique approach to language and language learning.
T o Colin, an experienced (but not professional) writer in his L1, writing in any
language is a culture-bound, meaning-making activity. He wanted to write something in
Japanese that "could move the Japanese reader." Creating a piece of writing that "is
coherent and well thought-out," as Kei spoke of Colin's Japanese writing (Teacher
interview notes, November 3-4, 1994), was probably an integral part of' Colin's conscious
and subconscious knowledge. What came into his mind as new knowledge or learning as a
result of writing JFL compositions were some aspects of Japanese language use. The JFL
wri ting assignments provided Colin with opporiunities to " think how to match the content
with linguistic expressions" of Japanese.
Chapter 4: Writing Processes
1 employed the think-aloud procedure (Ericsson & Simon. 1993). which has k e n
used profitably in psychological studies of, m o n g others, reading (Pressley & Afflerbach.
1995) and wri ting (Bereiter & Scardmalia, 1987; Smagorinsky, 1989, 1994b), to trace the
thought processes of writers at work.29 In accordance with the emphasis of my study on the
social and psychological contexts of writing, the collection of think-aloud protocols was
placed in as authentic composing situations as possible. Rather than asking students
individually to appear in an isolated place to conduct a protocol session at an appointed
time in the presence of the researcher, protocols were produced at the participants' own
homes (cf. Smagorinsky's in-progress work reported in Smagorinsky, 1994~;see also
Smagorinsky, 1997).
On the day the writing task to be used for my research was given as an assignment
in ciass, the participating students received from me a packet containing 3 120-minute
blank audiotapes,'O a sheet of general instructions, a sheet of think-aloud instructions
(Appendix K), and a sheet of pst-ivnting questions (see section 4.1.4; Appendix L). They
29 Smagorinsky (1989, 1994b) provided a review of recent claims and cnticisms of protocol analysis
wi th particuiar referace to writing research.
30 The participaois were told to supply lheir own blank tapes in wse they needed more thm 2 tapes to
record the entirc process of writing. They were dso told that the same number of extra tapes as they provided
would be issued Iater. As it turned out, most snidents were able to complete their think-doud sessions within
2 hours, thus leaving 1 tape provided by me unused. A few needed io use the second tape but only part of it.
used their own tape recorders to produce think-aloud protocols. Al1 instructions and
questions were wri tten in English. The think-aloud instructions were adapted from
Ericsson and Simon ( 1993, pp. 376-377) and Flower ( 19W, pp. 73-73) and stressed two
points: (a) to work on the writing task as one normally would do, and (b) to Say out loud
and clearly everything that cornes into one's mind while writing. No tirne limitations were
irnposed; nor was a restriction placed on the use of dictionarîes or reference books. The
students were free to use any languages to report their thoughts while composing. In case
they needed to take a break, they were told to record the time and date of signing off and
signing back in io the tape-recording. They were also requested to fil1 in, right after
completing the writing task (i.e., having produced a final version to be submitted to the
instructor), the pst-wn ti ng questionnaire.
Al1 the participants wrote essays wi th a pen or pencil nther than using word-
processing although a few students mentioned, w hile thinking aloud or during interviews,
their desire to produce essays with word-processing. Audiotapes of the think-aloud
protocols, one copy of an essay produced during a think-aloud session, one copy of the
final version to be submitted to the instructor, and a filled-out pst-writing questionnaire
were retumed to me on or shortly after the day the assignment was due.
There were two main writing assignrnents during the course which were the objects
of my study, as rnentioned earlier. Prior to these tasks, a pilot trial of the think-aloud
procedure was carried out i n exactly the way explained above for the main tasb, using a
summary writing taslc assigned by Kei as homework in October 1994. The participants
were informed that it was a practice session and told of the importance of this trial. The
timeline of the assignrnents from which protocol data were generated is shown in Table 4-
1.
After the trial session, the participants were asked about their experiences in
thinking aloud. None of them had had the esperience of systematically thinking aloud
before. Seven students reported that they felt at ease with the task while the remaining 6
found i t difficul t and were unsure whether they were doing as expected. Nonetheless. al1
the verbal protocols from the trial session turned out more or less satisfactory. A11 the
participants said they liked the idea that 1 was not present during their think-aloud sessions.
Table 4-1
Tirnelirte of Writitzg Assigmneizts
r
Task 1 November 8, 1994 November 17,1954
aloud, obtained dunng the interviews, showed traces suggestive of reactivity to the think-
aloud method which might have resulted in these people's altering their cognitive
processes from what they might have used to c a n y out these tasks under normal (i.e.. non-
protocol) conditions (see Smagorinsky , 1989; Stratman & Hamp-Lyons. 1994). For
example, Eddie said:
[Thinking-aloud] took a lot more thought than 1 thought it would. For
instance, 1 didn't really ever think of the process of looking up words or
creating a sentence when 1 just wrote without talking. It was interesting,
though, to see my own thought processes at work. Actually the method was,
1 thought, very useful because it helped me clanfy what it was exactly that 1
was doing in my mind. On the other hand, this, 1 think, might affect the way
in which 1 write, and therefore these essays may be different from those 1
have written without speaking. (Eddie's interview, M u c h 3, 1995.)
Cathy also found it difficult to verbalize her thoughts while worhng on an essay and said,
"To tell the tmth, 1 had to think of what to Say into the tape first" (Cathy's interview,
March 7, 1995). Eliot gave an outright disapproval of the method:
1 don't like to think d o u d because speahng and thinking are two different
things. 1t's really painful to write and speak at the same time. When 1 hear
my own voice, 1 cannot think clearly any more. (Eliot's interview, March
16, 1995.)
Jack "wasn't sure exactly what was expected at first" but gradudly he "felt comfortable
with [the think-aloud method]" (Jack's interview, March 8, 1995) and invented what he
called "the stream-of-consciousness approach" inspired by the thi nk-aloud me thod, using i t
in the second of the two composition tasks. Using the stream-of-consciousness approach,
Jack first thought aloud into the tape in Japanese to compose, rewound the tape, and
transcribed what was recorded onto paper. Jane was the only participant who esperienced
no difficulty a t al1 in thinking aloud from the stan: "1 don't think it affected the way 1
wrote. 1 don't think it disturbed the process of m y writing. And 1 don't think it made me
nervous o r anything" (Jane's interview, March 16, 1995).
These data suggested that reactive effects did exist in the think-aloud protocols
collected and were rather idiosyncratic, as the prevailing assumption holds (cf. Stratman &
Hamp-Lyons, 1994). Despite the possible esistence of such effects, think-aloud protocol
andysis "offers a unique glimpse into the workings of the human rnind, and has a distinct
persuasiveness due to the storytelling chamcter of the data" (Smagorinsky, 1994a, p. siii). 1
regarded it as one of the essential means to validate my exploratory and descriptive study
of situated writing in JFL.
Table 4-2
Tratwriptimi Conventiom
Mark Signif~cance
A period indicating the closure of an utterance with falling intonation, usually followed
by a pause.
? A question mark indicating a rising (questioning) intonation.
{ } Curiy brackets used for original Cantonese or Mandarin words in romanization where it
is more meaningful to do so.
( ) Parentheses used for the transcriber's cornments.
31 The process of transcription was faciliiated by consulting students' written notes and earlier drafts.
which I collecteci whenever ihey were made available to me.
4.1.3. Coding of Think-Abud Protocois
Following the practice used by Cumming ( 1989), 1 analyzed only verbal reports of
the participants' thinking about their writing. This excluded remarks directed at the
researcher. the reading aloud of text already written, and the sounding out of test to
emerge. Exceptions were words and phrases of text uttered in conjunction with comments
about wri ting. These selected protocols ivere segmented into co~nrnitiiicationuriits (c-units)
and numbered chronologically. Following Langer ( 1986a. l986b), I defined the c-uni t3' as
a separately identifiable remark about a thought or behavior. A c-unit "may have sevenl
sentence nodes as a consequence of having several sentences, several clauses or k i n g a
run-on or compound sentence" (Freed, 1978, p. 43) to express an idea. C-units are not
always grammatical sentences due to false starts and pauses common in speaking. C-unit
segmentation was applied across English (original English utterances and English
translations of Cantonese and Mandarin verbalizations) and Japanese p r o t ~ c o l s . ~ ~
As Smagorinsky (1994) aptly pointed out, a coding system applied to protocols
reflects the researcher's assumptions and agenda. 1 had my own assumption and agenda in
deriving a system to code my protocol data. With my prima. concern about writing-and-
l e m i n g relations, 1 wished to highlight the wnters' mental operations while engaging in
actual production of writlen test My assumption was that such thought processes would bc
suggestive of opportunities for learning. 1 consulted a number of protocol studies of
wnting and decided to adopt parts of Cumming's (1989) and Langer's (1986a, 1986b)
32 The c-unit has k e n used as a measure of the syntactic complexity of native English-speakng
cfiildren's (e-g.,Loban, 1963; Smith, 1978) and non-native EngIish speakers' (e-g.. Brock, 1986; Freed,
1978) oral utterances; it has aiso k e n used to distinguish the stretches of verbalimtions from one another in
overall think-aloud protocols of native English-spea)iing children and adolescents during theu production of
written text (Durst. 1989; Langer. 1986a, 1986b; mars hall. 1987; Newell, 1994). Operational defiaitions of
the c-unit may differ sligfitly from one study to another. This linguistic unit differs from T-unit (Hunt. 1965,
1970)or idea unit ( C M ,1980).
33 The validity of the c-unit as a cross-language measure has yet CO be demonstrated. Howeuer.
Harrington's (1986) successful application of T-unit--a linguistic unit comparable to the c-unit--anaiysis.
which has thus far been most widely used with EngIish and other European (such as French and German)
languages, to spoken Japanesr: tends some support to my application of c-units to Japanese and English
discourses in the same study.
schemes. These satisfied my interest in the what and hoiv of menial opentions while
composing. Thus, 1 first coded each c-uni t for aspects of the ivriter's atterztiorz (gist,
discourse organiwtion, language use-lesis, language use-syntas, language use-spelling, or
writing procedures; Cumming 1989, adapted from Scardamaiia & Pans, 1985), and then
for the riature o f ~ h ewrirer'r rnomloring behizviors (more or less refiective, corresponding
to what Langer called awnreness and use, following Baker & Brown, cited in Durst,
1989v p. 345). Categones are shown in Table 4-3 with esamples. English translations of
these sample transcripts are provided in cases where they tvere Japanese utterances.
Portions of representative protocols in a continuous text with coded catepries are shown
in Appendix M.
Table 4-3
Categories for Codirzg Th Nik-Aloud Protuc~Is
gist = remarks that focus on the substantive content of the emerging text.
How shouid 1 look at this ~robiemof ijime [bdlying] 2 (Colin, Task II)
ee kono sakubun wa mangabunka no pi ten warui ten soshite soreni tsuite no jibun
no iken O kaku koto dakedo [un in this composition 1 am supposed to writc about good and bad
points of uimic culture and my opinion on it.] (Jasmine, Task I)
discourse organization = remarks that focus o n the organization of the test at the
levels beyond the sentence, including concems about cohesive devices that make a
link between two or more sentences.
unto "konoyoona" unto "kono" unto dokokan rieiv paragraph ni shite ii no ka zenzen
wakannai na [um "as such" um "such"um I have no idea where I should k g i n a new pan,gaph.]
(Jane, Task II)
Okay [.. J spïir a parngrapk liere arid acid a feiv settletzces. (Martin, Task II)
- - - - --
34 Durst (1989) adapted and çxpanded one component of Langer's Analysis of Mcaning Construction
scheme (1986a, 1986b), focusing on two aspccts of the writer's monitoring behaviors--awarcness and use of
the writer's thinking processes.
01) language use-lexis = remarks that indicate word- and phrase-Ievel concems.
(Im" tokoro ga" [place] basho @lace] that's better. isn't it? " basho" (Cathy, Task 11)
Everythirig ehe I say everythirzg efse U ~ everythitig
L uh banji [everything] (consulting
dictionary) (Eddie, Task II)
(1s) language use-syntax = remarks that indicate concems about syntactic and
morphosyntactic rules (e.g., postpositions, sentence endings, conjugations) as well as
the formation of an entire sentence.
Yeah biit in this case sfloidd I rue the rrrn ukemikei [passive voice]? (Mary. Task i)
Okay 1 use ni ri] " zensekai ni [in rhe whole world] " (Cathy, Task 1)
(lm) language use-spelling35 = rernarks that indicate concems about orthognphic
conventions.
gaman gaman kanji de gaman tte kakoo [ i'm going to wri te 'gamao' [patience] in kanji.]
(Jane, Task II)
Note. The first of the two example statements provided under each of the above categones
is coded "more reflective" and the second esample " Iess reflective."
(m) more reflective = remarks that indicate esplicit on-line monitoring, Le., remarks in
which the w n ter says "1 think" or " 1 know", expresses an opinion, makes a judgment,
or indicates hislher uncenainty while writing.
(1) l e s reflective = rernarks that describe the writer's on-line behavior o r report what
happened and what has been decided in the writer's mind, not s o esplicitly reflecting
on hislher thinking processes o r the task.
35 Al1 the statements under this category concemed the spelling of kanji or katahria (phonetic scripts
used to represent foreign--mostiy Enplish and other European--1oan words in Japanese). except one siatement
that was about the expression of a number: "Um ah veah 1 shouldn't write two in Arabic nurnbers" (Cathy.
Task 1). For descriptions of the Japanese wri ting system. see Taylor and Taylor ( 1995).
While examining the protocols to establish the above category system, 1 decided to
include another dimension, i.e., languages the wri ter used in making metacogni tive
document the Izow of concurrent thinking about writing while a fmt dimension the whaf.
Once the coding system was established, I coded each segment for the three
dimensions of the system. Because c-units are. as mentioned earlier, segmentable
staternents for a thought or behavior distinct from another, one category was sufficient to
code separate segments in most cases; double or larger configurations of coding were very
few; for a second dimension, of course, either one of the two mutually excIusive categories
had to be used to code a segment. Also because some segments contained only minimal
dimension. Intra-coder agreement, checked on 10%of the total segments 1 weeks after the
initial codings, was 97.5% [or both dimensions.
To supplement the think-aloud protocol data, the participants were asked to fil1 out
a post-cvn ting questionnaire (Appendix L) right after completing each task. The
questionnaire asked about (a) the level of satisfaction the writer felt with his or her own
essay just produced, (b) the level of difficu1t the writer esperienced in genenting ideas,
and (c) the level of difficulty the writer esperienced in expressing ideas in Japanese. It also
provided space for comments o n the writing task just completed. The participants'
comments on the questionnaire were informative, esplaining the strategies they used in
writing essays, elaborating on specific points of difficulty, or reasoning about laborious
and less labonous parts of the writing process. I utilized these pieces of individual,
Due to poor conditions of 5 participants' recordings on one or both tasks, only the
two sets of complete protocols obtained from 8 participants (Jasmine. Jane, Jack. Cathy,
Colin. Mary, Martin, Eddie) were analyzed. i tallied al1 c-units coded under respective
categories for each protocol then converted these to percentages. The tai lied figures are
treated as cumulative percentages for the protocols containing uni& with multiple codings
(Le.. more than one category coded). An overview of the resul ts is given in Table 4-4. In
this summary four fundamental categories are highlighted that represent four mutually
exclusive aspects of writing people may focus their attention o n while composing: gist,
discourse organization, language use, and writing procedures. Thus, the three sub-
T a l e 4-4
Slimmaq of Thirik-AloridProtocol Data
attention paid to discourse organization or wri ti ng procedures. Two cases (Jack and
Martin) went against this general pattern, hoivever. The largest proportion of Jack's on-
line cornments focused on the aspect of rvriting procedures, followed by gist and
language use. Martin's attention more or less evenly divided between gist, language
use. and writing procedures. Another unique case was Colin, who focused most of his
attention on gist and paid much less attention to the other three aspects. On-line verbal
comments about organization were very few across the cases (cf-. Cumming, 1989;
Sasaki & Hirose, 1996).
More than a half of the on-line comments in al1 but a few cases (Jasmine, Task II; Jack,
Tasks 1 and II; Colin, Task II) were reflective in nature, suggesting, on the assumption
that learning is a manifestation of thought (e.g., Smith, 1990), a great number of
opportunities for these students' potential learning while engaging in JFL composition
writing. In generai, Task 1 induced more comments o f a refiective nature than Task II.
Al! the students, escept Jasmine and Jane, relied heavily on their Lls in verbalizing
their thoughts; Jasmine and Jane, who spoke native-like Japanese, produced their
protocols primanl y in Japane~e.3~
To make better sense of trends in the protocol data, I created three broader
categor-ies of ideotiorznl thirzkitlg (combining the aspects o f gist and discourse
organization), farrgimge-relnred thirrkiizg (cornbi ning the three sub-categories of language
use--lelis, syntas. and spelling), and procediirnf thi~ikiiig(w hich is the aspect of writing
procedures renamed for consistency with the other categories' names). These new
categories of attentional foci were examined according to the nature of the writerts
monitoring behaviors (more or less reflective). The iallied figures of these combined
categories appear in Table 4-5 (see Appendis N Cor the full tallies of the six original
categories of attentional foci combined with the two categories for monitoring behaviors).
36 Thcse trends accord with the percentagcs of L1 (Japanese) use in the production of L2 (English)
written discourse reported by highcr and iower proficient L2 learners in Kobayashi and Rinnert's (1994. p.
239) study. Note that Jasmine considered Japanesc as her oral L1 but English as her writtcn L1.whereas Jane
chose Engiish for her orai and written L1.
Table 4-5
Aspects of Attentional Foci and Re/ectiverzess (nzirzk-Moud Protucoi Data)
* ref = reflective
Generally, reflective thinking occuried while the wnter thought about ideas, language.
or both. For Jasmine, Jane, and Colin in Task 1, renective thinking about ideas
occupied a large proportion of their writing processes.
Language was distinctly an object of reflective thinking for most of the writers. Even
the highl y proficient leamers of Japanese, Jasmine and Jane. focused a large proportion
of their attention on language use. But their linguistic concems were at a somewhat
higher levei.37 Jack and Colin rarely verbaiized their mental processes of Japanese
language producti~n?~
37 Jasmine and Jane wrote about their linguistic concerns in the pst-writing questionnaires; they both
indicated their attempts to use a variety of predicative expressions to avoid the monotonous tone of written
text and to use "harder words" instead of simple and basic words. Their thînk-aloud protocols also attested to
this.
38 The very few verbalizations about languiigc issues these intermediate-proficient students produced
made me wonder why. Colin's comments written in the Task II post-writing questionnaire provided some
dues. He wrote. "Although it took only a short period of tirne to finish writing the assignment, important
Among the three sub-categories of language use, lexis was the aspect to which mos t of
the writers devoted most of their reflective thinking39 (see Appendix N). Syntax was
less of a concern to them generally (but Mary was apparently much concemed about
syntax4). They cared little about mechanical matters in general. Jasmine was the on!y
one who showed excessive concems over spelling or the wnting of karzji.
Individual writers showed similar patterns for both tasks in terms of the proportion of
attention paid to respective aspects of writing and the proportion of more to less
reflective thinking under each category. Exceptions were Jasmine, whose intensive
ideational and language-related thinking of a refiective nature in Task 1 reduced
dramatically in Taslc II, and Jane, whose ideational and language-related thinking of a
reflective nature in Task 1 and Task 11 were just the opposite.
Table 4 6 displays the resuits of the individuai participants' responses to the post-
w n ting questionnaires, together wi th their JFL oral proficiency levels and their L 1 and
Japanese essay scores. This matris table left me with the impression that more students
found Task II (which the students interpreted as "write whatever you want") easier than
Task 1 (in which the students were aware that the statement of one's opinions was
required) both in terrns of idea generation and language use. They produced more self-
-
ideas were generated during a long pcriod of time. Extensive preparation before the writing process was
required." A similar retrospection was given by Jack during bis interview with me. Mthough they wcre
referring to the processes of idea generation at a pre-writing stage (which were not tape-recorded) and the
idea generation might have been done in their Lls. they could have been thinking, consciously or
subconsciously. about Japanese expressions lhat would fit the generated ideas during the "iong period of
extensive preparation." Because of such preparation, Ianguagc issues may not have corne to the fore of their
consciousness for verbalizations during the actual taping.
39 Comor-Linton and Haichour's (1997), Cumming's (1990). and Shibata's (19%) stüdics of L2
writing processes showed vocabulary howledge to be a sie4cant factor in writing.
JO This observation is in line with what Mary wrote in her pst-writing questionnaires: "1 found this
assignment quite difficult ... 1 used many [Japanese lanmwge]dictionaria ruid , o r m a r handbooks" (Task 1);
and "There were some difficuit things about writing this composition. I think they are grammar and
vocabuiaxy" Cask II).
satisfying essays in Task II (cf. Kei's better impressions on the Task II essays in
cornparison to the Task 1 essays; see section 2-42).Neither JFL proficiency nor L1 writing
skill correlated with the level of satisfaction the students had with their own essays or the
level of difficulty they experienced in idea generation and language use.
Table 4-6
-
Post-Writing Qtiestiotrnaire Respomes, JFL Proficiency. and LI iVrititzg Expertise
Partici-
- TASKII
Difficul ty
pant
tion with in
30 1 satisfied
not so
difficult satisfied di fficult
-
,
language
use
not so
difficult
-Eliot
advanced-
high 1 22
not so not so
difficult
Eddie 34 1 satisfied
- not so
di fficult
Table 4-7 shows the results of the individual participants' responses to the p s t -
writing questionnaire, together with their perceptions of JFL writing and learning-the
information elici ted in the students' interviews. I noted the following general trends in this
sumrnary:
The students who mentioned some leaming of content as a result of JFL wri ting also
said they experienced difficulty genenting ideas in both or one of the tasks. On the
other hand, the students who mentioned only the learning of language through JFL
writing round idea generation either easy or not so difficult.
Al1 the students (except Eliot) perceived language use as a problem in their J E
writing; language processing was either difficult or not so difficult. but never easy for
Table 4-7
Post- Writing Questionnaire Responses arzd Perceptions of JFL Writing arzd karning
-
*
Partici- satisfaction
Task 1
-
Task II
very sarisfied
satisfied
1 difficult
difficult
not so difficult
not so difficult
rneaning-
making
problem area in area of leamin
language
thm JFLwritin
language &
content
Jase
Task 1 satisfied difficult difficult language language language &
Task II satisfied not so difficult difficult exercise content
Judith
Task 1 satisfied difficult diffïcult meani ng- language Ianguage
Task II not s o satisfied not so difficul t not so di fficutt making
JOY languagt: &
Task 1 çatisfied not so difficult difficult meaning- language
Task II not so satisfied not so difficult not so difficult content
making
Jack
Task 1 not so satisfied not so difficult difficult language language language
Task 11 satisfied not so difficult not so difficult , exercise
Cathy
Task l not so satisfied difficult di fficuit meaning- language & "nothing in
Task iI satisfied not so difficult not so difficult making orgmization particular"
Colin
Task 1 not so satisfied not so difficult difficult m-ng- language language
Task II not s o satjsfied not s o difficult not so difficult makinp
Charles
Task 1 not so satisfied difficult difficult Ianguage language content
Task (1 satisfied not so difficult not so difficult exercise
MW
Task 1 not so satisfied not so difficult difficult language language language
Task II satisfied not so difficult difficult esercise
Mike
Task I not so satisfied difficult language language language
crisy
Task II satisfied not so difficult not so difficult axercise
Martin
Task i satisfïed W not so difficult language Imgurtge language
Task II satisfied not so difficult not so difficult exercise
Eliot I
Kei and the two raters used multiple trait scoring procedures that evaluate
linguistic, rhetoncal, and content features of a piece of writing. What do these scores mean
in my research contest? Certainly they do not provide surnmative assessments of the
students' leaming as a result of writing, but they do provide sorne indications of the
students' current abilities to compose essays in Japanese. Loohng at the component scores
can help to identify, albeit only approximately, where the studenis' strengths and
weaknesses lie, to relate them to the aspects of writing the writers paid attention to during
the process of producing an essay, and to suggest potential opportunities for ittcidentol
learning (in contrast to interttional learning that is active1y desired and controlled by
leaners; see Bereiter & Scardamalia, 1989) attributable to writing experiences that
required effortfui processing of ideas and language.
5.1.1.1. Kei. In search of an instrument to assess Japanese essays wri tten by her
students, Kei wanted one that (a) ivould be available for immediate use (i.e., with no or
Ii ttle modification required), (b) would be congruent wi th her instructional goals and her
beliefs about how Japanese writing skills should develop, and (c) would provide clear and
concise feedback to focus on the leaming efforts of students. She decided on an adaptation
of the ESL Composition Profile developed by Jacobs et d.( 1981), which 1 had translated
into Japanese for my master's thesis on JFL writing (So, 1989).41 Kei considered this
scoring instrument to satisfy her requirements and used it cvithout modification. She noted
that the weights assigned to the content (30%)and organization (70%) components are
relatively large," but she observed "that suits the purpose of my coursen (Interview notes,
February 10, 1995). She liked particularly the fact that the band descriptors and al1 other
information in the scoring report were given in Japanese, providing the students exposure
to the Japanese language in a relevant contest.
A s this description implies, Kei approached the assessrnent of essays [rom the
standpoint of a person involved in both teaching and assessing. She mentioned in one of
Our interview sessions that essay assessrnent was primanly meant to be a n encouragement
for her students. i.e., to help her students gain confidence by highlighting the good traits of
their writing (Interview notes, February 10, 1995). On the same occasion she also
expressed the difficulty she expenenced with choosing the "right" descriptors and
41 Hirose and Sasaki (1994, p. 228) also translated Jacobs ct d.'s profile into Japanese (O assess
Japanese compositions written by native speakers of Japanesc participating in their study on Engiish-as-a-
foreign-lmguagewriting.
42 The other components consist of vocabulary. laquage use. and rneclranzcs, which are weighted
20%. 25%. and 5% respectively.
assigning scores to respective essays because of her familiarity wi th the essay wnters, a
kind of halo effect. It may be said that Kei's scores on her students' compositions make
sense pedagogically, but they do not necessarily carry psychometric values. To understand
the mechanism of the classroom system in relation to writing tasks, which is an
ovenrching purpose of my research, it is important to look at Kei's scores and comments.
on the one hand; on the other hand, 1 balanced this perspective by also weighing the scores
obtained from the two independent JFL teacher raters who had had no contact with the
essay writers or their instructor (Kei). The latter scores are thus free from halo effects and
thus rnay be considered "more objective."
5.1.1.2. Independent Rates. The two independent raters were carefully selected to
satisfy the following criteria: (a) being a female native-speaker of Japanese, (b) k i n g
experienced in teaching J E to university students in an English-speaking country. and (c)
king expenenced in assessing JFL writing for i ts communicative effectiveness. In other
words, I searched for i ndependent raters w ho shared Kei's identity, sociocultural context,
and values about language teaching." 1 wished to obtain from these nters essay scores that
were free from halo effects yet "intemally valid." The two volunteer raters, fernale native
speakers of Japanese, were very similar to Kei in terms of educational and professional
experiences as well as their current teaching contests and orientations. I had cvorked wi th
both of thern in tertiary-level JFL education at an institution where 1 was previously
employed in Singapore and knew them cvell. A t the time of data collection for this study
they were teaching JFL at a university in Australia. Al1 correspondences with them were
done through e-mail and regular mail. Since their scores were also to be used as measures
of the participants' Japanese writing ski11 (see section 3 - 7 2 ) . it was considered more
meaningful to apply the same rating scale used for L1 writing assessment, i.e., Hamp-
43 How different readers in different contexts (e-g., teachers of Japanese as an LI. non-language
teachers, non-native speaker teachers of JFL) might read and respond to the same essays is an important
question in order to create a universal definition of "good JFL writing." A growing body of such research in
ESL contents ( e g , Brown, 1991; Connor-Linton, 1995) attests to the usefulness of such inquiry. but it goes
beyond the scope of my current research.
Lyons's 9-point scale (see section 3.3.2.1). I mailed the raters a packet containing the
essays of Tasks 1 and II,U an instruction sheet, the rating scale, and instructions for n t i n g
procedures (Appendixes G and H), allowing them a month to complete the assessments.
Although they worked in the same institution, the two raters assessed the essays
independently without any discussion of the assessment task between them. Both raters
were also assiduous in providing comments in a space given on the score report form.
These comments were mostly idiosyncratic responses and reactions to unusual or
intangible qualities of the writing that they had noticed but thought were not encornpassed
by the traits and their descriptors of the assessment instrument (Harnp-Lyons, 19% b).
To summarize Kei's and the two independent raters' scores on the studenis'
Japanese compositions. 1 conflated Harnp-Lyons's scale's original categories of linguistic
accuracy and linguistic appropriacy into one category called larlgrîage use. and called the
original category of communicative quali ty simply confenl. Likewise, I confiated Jacobs et
al .'s scale's original categories of vocabulary, language use, and mechanics into one
category cailed Iungzîage me. These changes enabled me to focus on the three essential
aspects of a composition (i.e., content, organiuiion. and language use) and helped me in
making meaning of Kei's and the two raten' scores. 1 avenged the composite scores or
linguistic accuracy and linguistic appropriacy on Hamp-Lyons's scale for the single
category of language use. 1 adjusted Kei's scores to make them numerïcally comparable to
the scores on Hamp-Lyons's scale by multiplying the content score by 9130. the
44 To eliminatc the possibility that the rater wouid cany over her judgments on the quality of one essay
to that of another essay written by the same author, different sets of names were used for the Task 1 and Task
II essays COdisguise matched pairs. Since ail compositions wcre typed beforc submitting them to the raters,
the nters had few clues to identiry which cssays of Task 1 and Task II wcre written by the same author.
organization score by 9/70, and the language use score by 9/50.45
The table given in
Appendis O displays the modified scores for the three aspects of the students'
compositions that Kei assigned and the two other nters also assigned for the two taslrs, as
well as from the thi nk-aloud protocol data the percentages of ûtten tion (where these figures
are available) each student paid to these aspects of wri ting during the processes of wri ting
the compositions. The table also shows Kei's and the nters' comments, originally wntten
in Japanese but translated into English"
My impressions of these ratings ivere as follorvs:
Generally, Kei's scores were higher than the independent nters'. This phenornenon was
particularly acute with the students of less-than-near-native Japanese proficiency (Le.,
Jack, Cathy, Colin, Charles, Mary, M i h . Martin, Eliot, and Eddie). For esample, Jack
received 23.4 points [rom Kei for his Task II essay which was nted 10.5 and 11.5 by
the raters. Kei awarded Cathy 23.2 for her Task I essay that scored 14 and 1 1 according
to the nters' judgments. Kei's judgment of 75.8 for Colin's Task I essay received 13.5
and 7 from the nters. Eliot's Task I essay received 34.4 liom Kei, compared to 17 and
12 from the raters. On the other hand, discrepancies were very small for the near-native
proficient students, Jasmine. Jane, Judith, and Joy. There ivere 1'5 cases in al1 where
Kei rated the compositions lower than the independent raters: 6 cases with the less-
than-near-native group, amounting to 17%. and 6 with the near-native group,
amoun ting to 38%" A mong the 6 cases wi th the former (i .es,less-than-near-native)
- -
45 1 derived these manipulation formulas from the fact that the maximum points are 30 for content, 20
for organization, and 50 for language use (the sum of 20 [vocabulary),25 [language use], and 5 [mechanics])
on Jacob et aL's s d e , and 9 for each of these three components on Hamp-Lyons's scale. I do not believe that
these mathematical manipulations alone enable valid cornparison between scores on Jacobs et d.'s scale and
Hamp-Lyons's scale. 1 manipulated the scores, however. for the sake of convenience, so these adjusted
scores should be taken as appro.ximations when compared to the scores based on Hamp-Lyons's scale. As a
result of these manipulations. the total masirnum score is 27 points, buitt from its component scores in
newly-created categories of content, organization. and language use, which are weighted a maumum of 9
points each equally.
46 Long comments (most of which ivere Kei's) arc abridged for the sake of brcvity.
47 6 + (2 cornparisons Wei vs. Rater 1, Kei vs. Rater 21 x 2 t a s h x 9 students-Jack, Cathy. Coiin.
Charles, Mary,Mike. Martin, Eliot. and Eddie) x 100 = 16.66.
6 + (2 comparisons [-ei vs. Rater 1, Kei vs. Rater 23 x 2 tasks x 4 students-Jasmine. Jane, Judith,
group, 3 cases were where the essays had previously been corrected by native speakers,
mostly in respect to the use of language.
There was a consistent pattern for the same reader's ntings of each essay's three
components. That is, the same reader tended to rate the three aspects (content,
organization, and language use) of a piece of writing similarly. Only 19 (out of 2349
ases showed a difference of 2 or more points between the three cornponent scores; the
rest showed a difference of less than ? points?
The same readers tended to rate each writer's two essays similarly. Note that the two
nters were unaware which essays were written by the same author and that Kei nted
the two sets of writings at an interval of 3 months and she did not refer to the scores of
the first essays while scoring the second ones. Only 7 (out of 3 9 M ) cases went against
this general pattern, showing a difference of 5 or more points be tween the scores of the
essays for Task 1 and Task II written by the same author. Four (Rater 2's ntings of
Mary's, Martin's, and Eliot's essays; Rater 1's ratings of Martin's essays) of these 7
cases were where the writers had sought native speakers' advice on one of the two
tash. 51
The readers commented about the writing generally or o n each aspect of the writing
(content, organization, or language use). Genenl comments, posi t h e and negative,
were made for 38% of the total number of essays; comrnents about content for 35% of
the total; comments about organization for 13%;and comments about language use for
native" were the most cornmon type of comments given to the students of the near-
native group (Jasmine, Jane. Judith, and Joy) (6789). and al1 of these were positive.
On the other hand. the students of the less-than-near-native group received comments
on language use most frequently (57%%)and such comments included both positive
and negative rernarks, such as: "good at connecting one sentence to another." "The
spoken and written foms of language are mised," "The writer seems to possess
sufficient vocabulary but laclis grammatical cornpetence." and "There are grammatical
mistakes but they do not bother me too much."
1 applied the SOLO taxonomy (Biggs & Collis, 1982; see also Biggs & Moore,
1993) to assess the cognitive structural cornplexity of the students' written texts. 1 wanted
to see what might distinguish mature [rom immature or deep from shallow thinking
manifested in the written products.55. The SOLO tasonomy kvas developed based on the
assumption thai the quality of students' thoughts would closely relate to the quality of their
learning. It is a classification system that describes the quality of learning outcornes
according to five levels: presrrricrriral, ariislrr<ctiual,rnrcltisiritcrriral. rela~io~rai,
and
exfended nbstraci. It is a conceptual fnmework built upon the empirical study of students'
52 Differenc types of comments could be made by a reader reading one piece of writing. For instance,
Kei's comments on Colin's Task I essay reads. "Very well organized (organization). lnsightful (content).
Enjoyable read (general). Rich vocabulary, though some mistakes in their usage (language use)." Such
multiple configurations of comment types were not very common. though. The great majority of comments
had single or double configurations. The percentages were derived from dividing the frequency of each
comment type by the total number of essays on which Kei. Rater 1. and Rater 2 commented (13 students x 2
tasks x 3 readers = 78).
53 16 general comments (given to the near-native group) i (3 readcrs x 2 tasks x 4 near-native
students) x 100 = 66.66.
54 3 1 comments on languagc use (givcn to the less-than-near-native group) + (3 readers x 2 mks x 9
les-thiui-na-native studcnts) n 100 = 57.j0.
55 In relation to the comection between the thinking process and the written produci, Smith (1 994, p.
34) contended, 'We cannot observe ourselves thinking, but we can observe the products of thought. And one
responses in sevenl subject areas i ncluding history, mathematics, Englis h. and modem
Ianguages. In applying this scheme to my written product data, 1 looked to the illustration
of SOLO analysis of English essays written by Austraiian high school students in Grades 7
through 12. Biggs and Collis defined the rive SOLO levels (applied to the analysis of
English essays) in ternis of characteristics such as the defining and refining of meaning
through word choice, appropriate syntax, and so on. 1 list the main features of each level in
Table 5- 1.
Table 5-1
Descrip~iorrof SOLO Leve fs
Note. Adapted from Evaluating the Quality of learning: The SOLO Taronomy (Siructure of rhe Observed
Learning Ourcorne) (pp. 109- 1 11). by J. B. Biggs and K. F. Collis. 1982, New York: Academic Press.
The purpose of this assessrnent was to measure the depth of ideational thinking
during the production of JFL written discourse. so I tried as much as possible to focus on
the "deep structure [italics in the original] of language" (Smith, 1994, p. 49), Le.. its
of the most powerfd tools for doing so is writirrg [italics in the original]."
meaning. 1 tried as much as possible to read the students' compositions as a semantic
representation, ignoring the language use problems typical of JFL leamers. This attempt,
however, created a paradox because meaning can be conveyed only through the "suî$zce
structure [italics in the original] of language" (Smith, 1994, p. 49) or its physical,
observable properties. Deficiency in the language (Japanese in this case) skill wa.5 sure to
affect the meaning conveyed, and thus i t s readabiIity. The reverse is true, too. The accurate
and fluent use of language might have boosted the readabili ty of an essay, making its
content look more sophisticated or comples than it actually was. Although I was well
aware of this difficulty, 1 still camed out an assessment, on an exploratory bais, of the
qualities of ideational thinking represented and organized in the students' two
compositions. 1 hoped the SOLO analysis, attempting to evaluate the quality of thinking
behind the observable product, would be able to provide a different perspective on the
students' compositions than Jacobs et al.3 or HampLyons's essay nting scales had,
offering more profound insights into the leaniing of their JFL authors.
Once again Kei vohnteered to collaborate with me as a second rater in this
assessment task. 1 met with Kei on an appointed day, which was already one and a hall
years after the completion of my data collection. We first went over an esample of SOLO
analysis on the high school English writing given by Biggs and Coilis (1983, pp. 108-131).
We spent about 40 minutes discussing the features of the five SOLO levels in light of the
sample essays given by Biggs and Collis and typical JFL students' writings we had often
corne across in our teaching. We found that the level descriptors designed for the anal ysis
of English expressive writings would be applicable to the essays 1 had gathered in my
study. Cognizant of my intention for the SOLO analysis. Kei agreed to focus on meaning,
ignoring grammatical or lexical mis takes inasmuch as they would not bnng the resul ting
text to the point of unintelligibility. To facilitate this process, we decided that we should
not spend more than 2 minutes reading a piece of writing to detemine its SOLO level. To
minimize halo effects, neither the authorsf real names nor pseudonyms were used to
idcntify the essays; al1 the essays were simply numbered, for the purpose o l identification,
1 to 36 with the 13 nndomly ordered essays of Task II bearing the numbers 1 to 13 and the
13 nndomly ordered essays of Task 1 bearing the numbers 14 to 36. We also anticipated
that there might be essays showing features belonging to more than one level. In such
cases, we agreed we should indicate al1 possible levels.
Once boih of us felt cornfortable about the nting criteria and procedures, we began
the assessments from Essay 1 to Essay 16 in order, at the sarne time, but independently.
Kei completed the assessments in 35 minutes and 1 in 45 minutes. There were no more
than two levels assigned to one essay. We called the essays belonging to two levels
"transitional," following Biggs and Collis's system. Perfect (8 cases) and partial56 ( 10
cases) matches were put together to calculate an intemter agreement of 69%. Considering
the absence of formal training and Our limited time for discussion of the criteria. this level
of agreement suggests our judgrnents were fairly reliable. For the 8 cases of complete
mismatches, Kei and I re-read the essays in question together and discussed their
appropriate levels. This session took place on the same day, dter a break of ?. and a haff
hours during which we did not touch on the subject; the session lasted 35 minutes. The re-
nting process went smoothly and we came to agreed levels easily, requiring little debate.
Most of the time ei ther one of us changed the chosen level to the level selected by the other
immediately after re-reading the essays in question, typically accornpanied by such
remarb as "How did 1 corne to rate this so high (or low)?" or "1 want to change rny nting."
Two cases required more deiailed discussion and re-assessrnent and we seitled on a mid-
level between the levels we had chosen on ginally.
--
56 Partial matches happened where both or either one of us assigned two levels to one essay. In these
cases ody the level w e both chose was taken to Iabcl a given essay.
5.2. Answering the Researclt Questions
Table 5-2 summarizes the trends in the essay scores and cornmentary data,
demarcated by a dichotomy between the near-native and less-than-near-native groups. In
al1 these comparisons, the near-native students' performances (as judged by Kei and the
two raters) were superior and stable relative to the performances of the Iess-than-near-
native leamers. This finding may be explained by the presence or absence of the "foreign
language effect," which "refers to a temporary decline in the thinking abili ty of people who
are using a foreign language in cvhich they are less proficient than in their own native
language" (Takano & Noda, 1995, p. 658). Takano and Noda explained the cognitive
mechanisms of the foreign language effect as follows: Because working memory is
limited, one cannot easily concentnte on the more abstnct levels of meaning or semantic
integrity until the processing of the lower, subordinate levels (e-g.,orthographics, word
choice, wi thin-sentence gnmmar) of discourse production has become automated (cf.
automatic processing vs. controlled processing; see McLaughlin, 1987). This is to say, lack
of ski11 in linguistic processing reduces one's capacity for ideational thinking. Does this
mean that linguistically less proficient students cannot utilize writing as a means to gain
access to, explore, and develop their ideas? 1s i t futile to espect that linguistic a n d
ideational gains will be achieved by these students engaging in a writing task?
Table 5-2
Srcrninary of Japanese E Î s n y Scores arzd Cornmeizis
- - -
The low nti ngs on content and organization for the less-than-near-native learners'
essays appear to suggest a presence of foreign language effects. However, if we look at the
percentages of their attentional foci during the process of writing (see Appendis O), we sec
there was in fact little quantitative difference between the near-native and less-than-near-
native groups.9 The highly proficient Jasmine and Jane paid as much attention to content
or gist (somewhere between 20 and 50%)atid language use (somewhere between ?O and
60%) as did the less proficient Cathy, Mary, Martin, and Eddie. The unique case was Colin
57 A further study may bc carried out to examine the students' think-aioud protocols to see if therr:
were differences in the qualities of knowledge or W g they brought to bear.
about; it thus should have become the focus of his attention during his production of
Japanese written discourse. On the contnry, Colin nrely thought out loud about his
language use (4%in Task 1 and 17% in Task II) while composing (see botnote 38).
What is the meaning of Colin's intensive engagement in content genemtion and
refinement during the production of his Japanese compositions? How might i t be related to
his learning esperiences? Next 1 looked at the results of the SOLO analysis, hoping that
they would shed some light on these questions.
The results of the SOLO analysis are given in Table 5-3. Here again the near-native
versus less-than-near-native distinction seems to best describe the results. The essays of the
near-native Jasmine, Jane, Judith, and Joy were judged rniiltistriictiiral, rniiltistriictwal
trarzsitional, and relnrionnl whereas the essays of the less-than-near-native students ranged
from prestri<ciiirczl to ii~iisiriicinralrrairtitioiial. The hi gher-order t hinki ng58 of the near-
native group might have been enabled by their Iàcility with the language (i.e., their
automaticity in language processing); on the other hand, such thinking rnay have been
hindered by the "foreign language effect" (Takano & Noda. 1995) in the case of the less-
than-near-native group. But how about Colin, who emerged with multistructural
transitional and relationai discourse structures? The SOLO analysis evidenced the quality
of his thinhng despite his lack of Japanese proficiency. Apparently there are more things
than foreign language effect to enplain foreign language writing perlormances.
58 This tenn requires a definition. 1 used the term broadly here as refemiag to the kind of thinZring thrit
leads to an intercomected and hierarchical stnrcturing of one's howledge and a better organization of this
hierarchy of howledge around explanatory or causal relationshps (Carnine & Kameenui, 1992; R. Glaser,
1985). Smith's (lm,pp. 23-26) phi~osophicalargument against the notion of higher-ordcr thinking is
signifiant and should be borne in mind.
Table 5-3
SOLO Levels cf Japntrese Witten Texts
I t was tme in most cases that the students' linguistic cornpetence in Japanese was a
main factor to distinguish the high from the low qualities of their Japanese essays. The
essays written by the students of native-like proficiency consistently scored much higher
than the less-than-native-like students' essays in al1 three components (content,
organization, and language use). Their tests were also judged to present more complex
cognitive structures. Other factors such as iask and cognitive performance during the
production of the essays appeared to have little association rvith the qualities of the written
products (see the table in Appendis O and Table 5-3).
Al thoug h there were some qualitative differences between the near-native and the
less-than-near-native students' Japanese essays, al1 the tests (including the near-native
students' essays) were, to a greater or less degree, written in the "concrete-symbolic" mode
(Biggs, 1987, p. 117) where language was used to dexribe the esperienced world or retell
class notes or information obtained from other sources. AIthough some traces of
reflectiveness were observed in the essays wi th mul tistructural transitional and relational
stnictures, most actually displayed the kind of "knowledge-telling" in writing (Bereiter &
Scardamalia, 1987) that is said to resul t from a sentence-by-sentence routine during which
the writer's concerns are simply what to say next, in suitable language, rather than to
attempt to transfonn one's knowledge in the processes of composing or what Bereiter and
Scardamdia d l e d "knowledge transforming" in writing.
When 1 was done with the coIlection of data (which are displayed in this and the
preceding three chapters) in April 1995, 1 found myself ovenvhelmed by the amount and
vanety of data 1 had collected. They seemed rich yet difficult to understand for their
significance. They appeared connected in a complex way, if only by virtue of their having
corne from the same context, which was what 1 wished to understand better; yet they were
still disconnected. This sensation is probably one that frustrates most grounded, natudistic
researchers; wi thout a pre-ordained research design, researchers feel out of control and
" unscientific." Inductive analyses in naturally esisting settings wi th naturally functioning
human participants ma- not be theoretically tidy, but their compleaity is potentially as
exhilarating as the real life they attempt to study (cf. Newman et al., 1989).
In this and the preceding three chapters 1 have laid out, discretel y and as completely
as I c m , al1 the data I collected from Kei, her classroom, and her students. Putting al1 the
pieces of collected information into a wntten text was itself a process of reduction and
interpretation, as were al1 the preliminary analyses, codings, and ntings 1 did. This process
was also a self-conscious one, shaping where my focus on the JFL students' expenences of
wntingto-leam was heading. A t that time some imagery of the phenornena 1 experienced
as a researcher began to form in my mind. I saw images of a JFL teacher concemed about
the current state of language instruction skewed toward mechanistic, shallow-level leaming
of language foms without encounging ideational thinking and mindfulness. I also saw her
highly motivated JFL adult students of the three different ethnic groups and varied levels
of Japanese proficiency and writing skill exhibiting similar and differing characteristics in
the processes and products of their Japanese writing.
My foregoing impressions and intuitions about the data have shaped these images
into various f o m s of questions about the JFL wnters' cognitive operations of linguistic
and ideational processing. From the pedagogical point of view, the principal issue is
whether thinking and mindfulness can be encounged in the production of foreign language
written discourse. This problem is big and complex. For instance. although the genenl
belief is that ideational thinking skills are complex and language slcills more rudimenîary,
just the reverse may be the case in activities of foreign language discourse production.
Furthemore, the hierarchy of basic skills to cornplex processes--for instance. from wri ting
a simple single sentence to the production of meaningful written discourse--is so ingrained
in language activity that it may be difficult to conceive of the interdependence of language
processing skills and the skills of reasoning and thinhng.
1 had prepared al1 the data in prelirninary forrn for analyses. and consolidated the
nonmetric and thus qualitative, to re-assess the data. 1 present the procedures and results of
dual-scaling analyses in the next chapter.
Chapter 6: Dual-Scaling Analyses
the elimination of detail. 1 saw this process as a virtue, for it helped to clarify the foci of
my analyses. In the same chapters 1 used the matrices to explore relationships between
different elements by visual inspection. A further process of abstraction was, however,
necessary (and proved invaluable) for dual-scaling analysis. This process involved the re-
examination and re-organization of the existing categories and as the necessi ty arose, the
splitting, slicing, combining, creation, and elimination of categories as well as the
Appendix P), which provide an overview of al1 the main features of each case. Tables Pl
to P6 contain 44 different kmds of information for each student. I devised this large set of
data so as to make it resemble 44 items of multiple-choice data. Table Pl containing Items
1 to 10 shows a summary of the data collected through the initial questionnaire surveying
the participants' backgrounds and linguistic experiences. Table P2 summarizes the results
of the assessrnent of three language skills (Items 11-13),The data summarized in Table P3
corne frorn the interviews conceming the participants' conceptions of JFL writing and
leaming (Items 14-16). Table P4 gives a summary of the participants' responses to the
post-writing questionnaires (Items 17-22). Table P5 is a summary of the think-aloud
protocol data focusing on reflective mental activities (Items 73-30). Table P6 summarizes
the component scores of Japancse essays assessed by Kei and the two independent raters as
well as the SOLO levels of the essays (Items 3 1-44).
Note that numbers were used, for simpiicity, to represent the values (3 to 4 options
per item) chosen by individual participants or identified by the researcher; however, they
do not carry any numerid values. Also, numbers are shown in bidface where 1 was able
to collect complete sets of data, including the think-aloud protocols. The entry 'O'indicates
missing information. Nishisato (1994, pp. 300-306) described different procedures to
handle missing pieces of information in dual-scaling analyses. The D U A U Statistical
Software Series package (see Appendix of Nishisato, 1994; Appendix II of Nishisato &
Nishisato, 1994) that 1 used for data analyses adopts the method that analyzes only
observed responses, ignoring missing ones. Although this means an inevitable influence on
the outcome of scaling, this method, according to Nishisato (1994), is probably the best
approach to handle missing bits of information so long as they occur infrequently (which
was the case in my research). In my data, Joy's L1 essay score was the only missing piece
of information that affected the outcome of scaling (see Table P? in Appendix P). Cases
where think-aloud protocols were unavailable were excl uded from analyses involving
these data.
In Tables PI to P6 the same option categories are not repeated so as to avoid
redundancy whenever they appear more than three times i n the same table. The
demarcation of the essays' total and component scores into the poorJair, good, and
excelleilt categories (Items 11, 13, 3 1-42) was made following Jacob et al.'s ( 198 1)
assignment of these terms to certain numencal ranges. Percentage ranges used as values to
assign to each case's think-aloud protocol data are arbitrary; they were demarcated in the
way that made sense to me after my careful esamination of the data.
My understanding of dual scaiing cornes from the writings and lectures by, and
persona1 communications wi th, Professor Shizuhi k o Nishisato w ho proposed the name
duni scalitzg for the technique and developed it into a practical t m l for data analysis. 1 owe
the following description of d u d scaling to his work (Nishisato, 1994, 19%; Nishisato &
Nishisato, 1984, 1994).
Duai scaiing is, a s mentioned earlier, a method of analyzing categoncal data whose
origins can be traced back to the 18th century (Nishisato & Nishisato, 1984, Appendix II).
It is capable of handling a variety of categorical data such as contingency, frequency,
mu! ti ple-choice, paired com parison, rank-order, successive-category , sorti ng, and
multidimensional categorical data. As the amount of research in duai scaling has increased
markedly over the past few decades, the scope of its applications has broadened as well
(Nishisato & Nishisato, 1984, 1994).
T h e method enables the measurement of the reIative "distances" between cases
(Le., participants), and between items (or options in the case of mu1tiple-choice data), by
assigning optimal weights both for items (or options) and for participants. In othcr words,
dual scaling is an analytical procedure that attaches weights to items and scores to
participants in a way that masirnizes the squared-correlation ratio (i.e., a ratio of the
between-column, o r between-row, surn of squares to the total sum of squares). The duality
implied by its name refers to this symmetry of the analysis. Maximizing the ratio of the
between-item sum of squares to the total sum of squares results in optimal weights for the
items. from which optimal scores for participants can be directly derived. Likewise.
optimally assigned participant scores imply that weights for the items are optimal as well
and can be expressed as a function of participants' scores.
The crus of dual scaling lies in its simultaneous maximization of the between-row
and the between-column surn of squares. This simultaneous, optimal quantification of the
rows and columns of a data rnatnx is one of the most remarkable katures of the dual-
scaling procedure. In addition, since no particular distribution for responses is assumed in
dual scaling, no assumptions have to be made regarding the distribution of the data. This is
a strength in terms of its applicability as well as a weakness in its inferential potential.
Indeed dual scaling is sample-dependent so the results of its analysis cannot be genedized
to other populations. What dual scaling does is to provide "a simpler, often ciearer,
description" of a given data set (Nishisato, 1994, p. 17). To use Eisner's ( 199 1, p. 95)
distinction between description and interpretation, dual scaling gives an account of, but
does not necessarily account for, the given data. My research, like many other studies in
educational research, values a full description of a particular group of people and the
patterns of their behaviors more than genenlizabili ty. 1n this circumstance dual scaling
offers a particularly effective technique for obtaining rich descriptive analyses. It is also an
excellent tool Tor esamining the interrelationships among items and participants and
provides a wealth of information that would probably be lost or overlooked in other types
of analysis.
59 There arc two types of analysis that c m be carried out with dual scding. One procedure is called
standard andysis or option weighting that focuses on the entire data set. The other is called forced
ciassification, the procedure developed by Professor Shizuhiko Nishisato. Forced classification allows the
investigator to focus his or her anaiysis on a specific aspect of the data; he or she can specify a pariicular
canied out 6 analyses in a cumulative fashion. These analyses addressed the three sets of
research questions 1 posed related to the threc cornponents of Biggs's 3P model focusing o n
students' characteristics, iheir writing processes, and their written products.60 1 did not
analyze data on the tacher, Kei, in this way, as they were not in a form that was amenable
to such analyses. The first anal ysis (Analysis 1) subjected the information col lected
through the initial background survey questionnaire (Items 1- 10, Table Pl) to dual scaling
to provide an overail picture of the particular group of people participating in the study.
Analysis 2 espanded the scope of Analysis 1 to include the assessrnent of the participants'
language skills (Items 1 1- 13, Table P7) and their conceptions of JFL writing and leaming
(Items 14- 16, Table P3) to answer the research question pertaining to students'
chmcteristics (see section L .4). My next level of analysis included the wri ting process data
to address the third set of research questions. Responses to the pst-wnting questionnaire
(Items 17-12, Table P4) were added to the preceding 16 items to make Analysis 3(a) for dl
of the 13 participants. Moreover, Anal ysis 3(b) included the thi nk-aloud protocol data
(Items 23-30, Table P5) as well as the pst-writing questionnaire data for 8 participants (as
the rernaining 5 participants failed to produce analyuble think-aioud protocols). The
fourth and final set of rcsearch questions concerns al1 aspects OC the 3P model as a
classroom system. To address these questions, 1 used al1 the items escept Items 23 to 30
for the 13 participants in Analysis *a), and Analysis 4(b) included al1 the items for the 8
participants who produced usable thinhaloud protocols.
The DUAL3MC prognm extracted three solutions (or orthogonal cornponents) for
each analysis by derault; however, I present only the first two of these solutions in
discussing the outcornes. Dual scaling yields many solutions. According to Nishisato
(1994; see also Nishisato & Nishisato, 1984, 1994), there is no clear-cut answer to the
- - - - -- --
variable (or a set of variables) of his or her interest and examine the relationships in the data with respect to
this predetermined focal point. I used standard dual scaiing in this thesis research as an aid in summarizing
cornplex data in a simple, clear. and useful m m e r .
60 I also adcirascd these questions scparately in chapters 3.4, and 5, where 1 described the prelimhary
d y s e s of the relevant data and their results. See section 1.4, where the research questions are inaroduced.
question of the number of solutions to obtain. He recommended interpretability as a
prac tical cri tenon for deciding how many solutions to extract. Typicall y the first solution
tends to reveal a general division while the subsequent solutions capture more
idiosyncratic traits attributed to a small number of participants. In the present research I
considered the first two "best" or "optimal" solutions sufficient for explaining g e n e d
patterns of the information in the data sets.
Perceritage horrrogerreity is an index of how good the solution is as compared with the
perfect case (i.e., al1 the inter-item correlations are 1 and a single item contains al1 of
the information in the data). This statistic equals 100 limes the squared correlation
ratio.
Item stntistics--S%), the sum of squares of weighted responses of each item, is a vital
statistic in test construction and indicates the relative contribution of Item j to the test
(Le., the set of al1 the items subjected to the analysis), which 1s proportional to the
square or item-total correlation, Eut).&i,, the positive square root of R2üt) or item-
total correlation. indicates the estent to which Item j is correlated with the test; the
higher the value of Rtit), the greater the relevance of Item j to the test. Thus, this
statistic can be used to select a subset of homogeneous items by discarding those items
) retaining those items with large values of the statistic.
with small values of R Q ~and
I took the following steps to interpret the results of the dual-scaling analyses. First,
I looked at percentage homogeneities of Solutions 1 and 2 to see if the given data set
contained a dominant dimension or component. Second, to grasp the nature of the
solutions, 1 plotted each participant on a two-dimensional gnph using his or her projected
scores for Solutions 1 and 3 as the coordinates for the horizontal and vertical &.es.61 I then
partitioned participants into groups and identified those options shared by participants in
each group. Each group was further partitioned into subgroups by looking at items whose
options were not shared by al1 the participants in the proup.6? My esamination of these
patterns was important because these "patterns contain the full information of the [given]
data" (Nishisato, 1994, p. 160).
To facilitate this process, 1 identified the items with hîgh values of R üti rvhich were
major contributors to the analysisa; these items were thus capable of par-tiiioning the space
relatively neatly and chancterizing the clusters by their respective options. That is to Say, 1
looked at only a subset of strongly relevant items, nther than the entire set. In this contest
the importance of the percentage hornogenei ty, the use of w hich often mises questions,
61 Nishisato (1994) devoted one entire chapter to discussing problems associated with graphical
representations of duaI-scaling outcornes. He stated, "Granting that graphicat dispIay is almost indispensable
for interpretation of the quantification results, one should nevertheles be aware of some potential pitfaiis and
logical difficulties associated with graphical display" (p. 26 1). Despi te many uaresol ved problems wi th
grapbiul display in generai, Nishisato found a theoreticaily sound and p r a c t i d y useful graphical method to
present the results of dual s d i n g of multiple-choice data. The essence of his method is plotting the projected
scores of participants in two-dimensionai space for a pair of solutions and labeling them by their response
patterns. 1 used this method; however, the large number of i t e m included in my ruialyses caused difficulty in
labeling participants by their response patterns, which are too long to be displayed on a single graph.
Therefore, responsç patterns do not appear in my graphs. Rather. the participants' names are used to denote
the points in the plot. The concurrent opecation of classifying participants into clusters and distributing item
options into separate regions was, nonetheless. canied out in interpreting clusters of participants in tenns of
their common response/behrivior patterns by consulting Tables PI to P6 in Appendix P.
62 This operation can be repeatcd to yield "a tree structure, an outcome of hierarchid clustering"
(Nishisato. 1994, p. 289).
63 The numbcr of contributing items becomes smallcr as we move from the first to the subsequent
solutions, pointing to the decrease in the number of participants conuibuting to the latter solutions (Nishisato.
1994).
should diminish since the percentage homogenei ty applies to the entire set of items, not to
the selected subset of items (S. Nishisato, personal communication, June 30, 1997).
What the appropriate significance Ievel of Rut) is is a question yet to be explored
(Nishisato, 1994), however. Nishisato (1994) noted the nature of this question differs from
the traditional test for significant correlations, and the "relation of item-total correlation to
the smooth transition oï response patterns is a topic that has never been explored" (p. 160).
In the present study 1 considered items with Rg.0 of .50 o r higher to be major contributors,
following the practice demonstrated by Nishisato and Nishisato ( 1984, chap. 3) in their
dual-scaling analyses of multiple-choice data.
T h e percentage homogeneity was 47.3 1% for Solution L and 19.61% for Solution 3
in this analysis. suggesting that this instrument (Le., the questionnaire from which the data
were derived) contained medium and lower degrees OS homogenei ty for respective
solutions. Similarly. these medium and relaiiwly low values of the percentage
homogeneities imply that this group of participants (or respondents) were rather
~ ~ is, the instrument did not contain n dominant dimension o r
h e t e r o g e n e ~ u s .That
component; rather, the anal ysis captured individual di fferences in answering di fferen t
a This kind of argument applics both to the naturc of item distributions and to the nature of participant
distributions because of the symmetry of dud swling (Nishisato & Nishisato, 1984). This unique
characteristic of dual scaling, inentioned in section 6.2 in this thesis, is evident in ihe way Nishisato and
Nishisato (1994) explained the m&ng of ihc technique's name: "'symrnetric quantification' of a two-way
table of cxtcgorical daia" (p. 115).
T o interprei the clusters in ternis of their cornmon response patterns. I considered
the items ivith RGC)of -50o r higher for the two solutions (Tables 6- 1 & 6-2) and examined
response pattems of these items by l o o h n g at Table Pl (Appendix P). Tables 6- 1 and 6-2
also include the values of SS(j) as well as options wi th outstanding bipolar weights65 (i-e.,
options of a particular item that stand o n the dichotomous ends of a scale), which indicate
distinct traits of people in a certain group. These two ways of interpreting the information
about the participants' response patterns complemented each other and helped m e g n s p
the nature of the solutions better.
Table 6-1
Major Coritributors ami Their Bipolnr Optiotis (Aoiysis 1. Solrctioii 1 )
i tern description
oral LI Chinex
Table 6- 1 contrasts the oral and written Lls of Anglo-saxon students against those
of the ethnic Chinese students. The other contnstive factors were self-ratings of o v e n i l
and written Japanese compared to peers (good vs. poor), importance of Japanese study
(important vs. very important), and length of residence in Japan (more vs. less than 6
months). Table 6-2 similarl y contrasts the ethnic Japanese students and the Anglo-saxon
students.
65 In case the samc or very close weights were derivcd for more than one option of a particular item.
aii of these options are listed; for instance, in SoIution 1 of h d y s i s 2 (see Table 6-3) the projected wcights
were minus 0.92 for the option of superior and minus 0.80 for the option of advancrd of the item of JST
rating, and the projected wcight was minus 0.77 both for the option of Japanese and for the option of h g l o -
Saxon in the item of ethmcity.
Table 6 - 2
Major Contributors and Their Bipolar Options (Andysis 1. Soktio>r2)
item description - - -
ethnicity Japan-
self-rating of overd1 Japanese (cfmtive) fair
self-nting of L1 writing iair
on1 L1 Japanese
self-rating of Japanesc writing (cf.peers) poor~fair
length of rcsidence in Japan Lcss than 6 months
Among the items listed in Tables 6-1 and 6-2, so-called "very good" items for the
purpose of classification--that is, items that are highly correlated within the questionnaire
(Le.. items with higher Rüi))--in this analysis were: ethnicity (Item l ) , oral L1 (Item 2).
wntten L 1 (Item 3), self-ntings of Japanese proficiency overall in comparison to peers
(Item 7), and self-ratings of Japanese proficiency overall in comparison to native speakers
(Item 8). The other items in these tables did contribute to uncovering some response
pattems hidden in the data, but they are less useful than Items 1, 7. 3, 7. and 8 in
classifying the participants into distinct clusters by their options. In the following
descriptions of the clusters, 1 compared the participants' options on the selected items to
identify the response pattems underlying the solutions.
Jack were less confident. nting it as pour. Judith and Joy had recently stayed in Japan for
more than 6 months but the others had not.
Another cl uster consists of ethnic Chinese students-Cathy, Colin, Charles, Mary,
and Mike--who spolie either Cantonese or Mandarin Chinese as their L1. Although they
had been studying in an English-speaking environment in Canada for some time, they still
felt more cornfortable writing in Chinese than any other Ianguages, escept for Mike who
had been in Canada since Grade 4, the earliest aniving immigrant among the five, and who
chose English as his written L1. Al1 these students rated their ovenll Japanese as poor in
companson to native speakers. Cathy, Colin, and Charles also felt that their overall
Japanese was poor in cornparison to their peers in the class; but Mary and Mike nted theirs
asJiair, rating higher than the 3 Cantonese-speaking students. Supplementary information 1
obtained during the interviews might esplain Mary's and Mike's higher ratings on this
item. Both Mary and Mike had relatives in Japan and had visited Japan in their young
childhood, whereas the Cantonese students neither had such contacts nor had visited Japan
at d l . None had a recent experience of king in Japan for an estended p e n d of tirne.
The third ciuster consists of native English speakers. Eliot and Eddie were white
native-born Canadians while Martin was a Chinese-Canadian bom and raised in Canada-
These 3 students had spent one academic year in Japan to study or work prior to their
enrollment in Kei's course. Although they ail le1t their Japanese was poor compared to
native speakers, Martin and Eliot rated their overall Japanese, compared to their peen, as
good, and Eddie rated his as fair. Their relatively high confidence in their Japanese
indicated by these ratings rnight have something to do with their recent experience of
l 1tem 6 (length of resîdence in Japan in the past 5 years)
living in Japan. In fact the R ~ t of
in this analysis was reasonably high (-72 for Solution 1 and .51 for Solution 2 ) and could
be useful in distinguishing this particular group of people from the other groups.
Some other interesting trends are worth noting here. Discrepancies between the
self-ntings of overall Japanese proficiency and written Japanese were most notable for
ethnic Japanese students, while the other students' ratings on these two items were
consistent. This finding points to a gap that ethnic Japanese students perceived between
their overall proficiency and writing sliills in Japanese. It may be further inferred from this
that these edinic Japanese students had set higher goals for their Japanese wnting, wishing
to be able to wnte as well as they could s@, for instance. Another interesting point is the
self-rating of L1 writing ability (which was in fact not a very good item, with Rct) of -31
for Solution 1 and -68for Solution 2. contributing little to the clear demarcation of the
participants). That is, those w ho rated their LI wri ting ability as fair were al1 female escept
Mike, while those who considered themselves as either good or e.rcelletrr writers in their
Lls were male students. Although gender was not included in this statistical analysis, it
may have influenced these people's self-ntings of abilities and attitudes.
responselbehavior patterns to these items by consulting Tables Pl, P?. and P3 (Appendis
P)-
Table 6-3
Major Co~tributorsatld Tileir Bipolar Options (Attaiysis 2, Solution 1 )
item description <------ ---- ---------->
Table 6-3 highlights the contrat between the ethnic Japanese and Anglo-saxon
students and the ethnic Chinese studen ts; Table 6-4 contrasts the Anglo-Sason students
with the ethnic Japanese students. And these contrasts are clearly indicated by the three
distinct clusters shown in Figure 6-3. These clusters are main1y characterized by the three
distinct leveis of JST ratings (whose Rut) was -91 for Solution 1 and .78 for Solution I ) ,
which happened to correspond roughly to the three distinct ethnicities (with R G ~of) -83 for
Solution 1 and .78 for Solution 2). All ethnic Japanese students were rated sriperior on the
JST except Judith, who was advarrced,66 and Jack, who was i~itermdiate.Al1 Chinese
66 Judith was rated advmced-plus, the level characterizcd by "remarkable fluency and ease of speech"
according to the ACTFL Japanese Roficiency Guidelines (American Council on the Teaching of Foreign
Languages. 1987). The advanced-plus speaker may experience a breakdowu under the demands of superior
leveI complex tasks. Eliot was also an advanced-plus speaker while Eddie and Martin wcre nted advanced.
Ai though Judith and Eliot received the sanie rating on the IST, my observation was that Judilh's ability to use
the Japanese language was much better and more native-Iike than Eliot. This difference 1 noticed between
these two students may be due to the fact that Japanese was one of Judith's two home lanemges while that
was not the case for Eliot who had had a much more limited amount of formal and informal Japanese
instruction compared to Judith. This issue certainly speaks to the complex nature of the concept of
proficicncy and the mechanism of tcsting, but it is not relevant in the present thesis and thus not discussed
students were rated intermediate. Eddie, EIiot, and Martin were advarrced.
Table 6-4
Major Contributors arid Tlieir Bipoiur Optiom (kialysir 2. Solutioiz 2)
item description <----------
Other items listed in Tables 6-3 and 6-4 further charicterize these three groups
generally. For example, the superior Japanese-proficiency group (including Judith) scored
in the excellerit range on their Japanese essays, consîdered JFL writing as a meaning-
making activity, and had a felt-sense of having learned about language and content through
engaging in JFL writing tasks. The Japanese essay scores of the advanced Japanese-
proficient group fell in the good range, and they regarded JFL writing primarily as an
activi ty for language exercises. This conception of JFL writing as a mere language esercise
was also a characteristic of the Chinese-background participants w h o were j udged
intemediate on the JST and produced Japanese essays in the /air or good range. Boih the
resembles that in Figure 6-2, showing three distinct clusters, with Jack isolated from any of
these clusters.
Looking at Tables 6-5 and 6-6 as well as Tables Pl to P4 in Appendix P helps to
identify each cluster's common charac teristics in particular relation to the items added to
this analysis, i .e., the retrospective information on wri ting processes gathered through the
pst-writing questionnaires (1tems 17-72).Tables 6-5 and 6-6 highlight respectively the
con tnsts between the Chinese students of intermediate proficiency in Japanese and the
Anglo-saxon and ethnic Japanese students of advanced or superior Japanese-proficiency.
and between the Anglo-saxon and the ethnic Japanese students. The three clusters shown
in Figure 6-3 reflect these contrasts.
Table 6-5
Major Contribulors arrd Their Bipolur Optiom (kzalysis 3(a).Soluliorr 1 )
item description <-- ----------- -- - -
Table 6-6
Major Corztribzitors orid Their Bipolar Op~iorls(A~zniysis3(a). Solrition 2 )
item description
ethnicity Japanese
oral L1 Japanese
(Item 9 with Rüt) of .58 for Solution 1 and of .71 for Solution 3). The students who nted
their Japanese writing skills as pwr or fair in comparison to their p e r s mentioned (on the
Task 1 post-writing questionnaire) difficulties they had in language use (Jane, Judith. Joy,
Jack. Cathy. Colin, Charles, Mary, Mike, and Eddie). Jasmine rated her Japanese wn ting
ski11 only as fair yet she responded on the pst-writing questionnaire that the use of
language was not so difficult for her. The students who mted their Japanese writing skills
as good (Martin and Eliot) did not find the aspect of language use so difficult, according to
their responses to the pst-wri ting questionnaire.
For Analysis 3(b), the percentage homogeneities of Solutions 1 and 3 were 37.69%
and 30.66% respectively. The clustering patterns shown in Figure 6-4 are basically what
appeared in Figure 6-3. Jack is again isolated [rom any of the three clusters. Tables 6-7 and
6-8 and Tables Pl to P5 in Appendis P help us esamine the participants' chancteristics in
tenns of the items highly correlated within the analysis.
Table 6-7
Mnjor Coatribiriors ami Their Bipolar Optiotrr (Arialvsis 3(b),Solution I )
item description ---- ---------------- >
The contrasting characteristics of the item options listed in Tables 6-7 and 6-8 bring
us certain images of the three respective groups demarcated clearly in Figure 6-4. The
intermediate Japanese-proficient people were mostly Chinese and were not very satisfied
with their Task 1 essays, in which they esperienced dilficulties using language but not
necessarily in generating ideas. Idea genention was not a problem for them in Task II,
either. Thirty to 10% of their verbalizations of concurrent thoughts in both Tasks 1 and II
were about language use. In contrast, the supenor Japanese-proficient people were very
satisfied with their essays for Task 1. They round it difficult to generate ideas, but they did
not find it so difficult to use language for Task 1. And they verbalized less their thinking
about language and more about content for Task 1. But their verbalizations of thoughts
about language increased for Task II. As in their experiences in Task 1, they had difficulty
generating ideas for Task II. The advanced Japanese-proficient people viewed JFL writing
pri mari1y as a language esercise (in contrast to the superior-proficient students '
conceptualization of JFL writing as meaning-making), expressed no difficulty in
genenting ideas for Task 1, and stated a reasonable degree of satisfaction with their Task 1
essays.
Dual scaling captured these characteristics. From this we c m d n w distinct images
of the three groups.6' But there existed an a m y of individual differences that do not fit
neatly into the three clusten shown in Figure 6-4. For instance, if we look at the items
conceming thinking processes for the production of a piece of writing (Table P5 in
Appendis P68), the corn plesi ty of the data structure involving 8 participants becomes
apparent. Sorne manifested consistent performances across Tasks I and II (Jack. Mary,
Martin, and Eddie). but others did not. Eddie and Mary paid more attention to language use
than gist in both tasks. Cathy was like them in Task 1, verbalizing her concems about
language use more oiten than about pist. But in Task II her renective thinking about
language use decreased. In both tasks about 30 to 30% of Martin's thinking was of a
reflective kind and about language use; another ?O to 30% was of a reflective kind and
about gist. Jack's protocol data showed little reflectiveness in his thinhng. Jasmine, Jane.
and Colin thought reflectively about gist in Task 1, but they did much less in Task II.
Jasmine was concemed about language use in Task 1 but not so much in Task II. Jane
manifested the opposite phenornenon. Colin did not verbalize rnuch of his thinkng about
language use in either task. The aspect of writing procedures was least attended to
reflectively by al1 the participants. In sum, it is hard to find any consistency wi thin this set
of think-aloud protocol data, nor to see consistency in their association wi th other variables
-- - -- - --
67 This implies that thesc images are not necessarily the exact descriptions of al1 ihe individuais
cornprising respective groups, but rather prevalent tendencies.
68 The idonnation contained in Table P5 focuses on reflective remarks of concurrent thinking while
writing and does not inciude less reflective remadcs. for it is reflective thin)iing that is believed to accornpany
"meaningful learning" (Smith. IW, p. 127).
included in this anal ysis.
Table 6-8
Major Corilribirtors attd TTiir Bipoiar Optiom (Amlysis 3(b).Soiu~ion2)
item description <-------- ----------- --------A--------
>
rnainly characterized by three levels of Japanese proficiency (Le., 1tem 12 was a major
contnbutor with Rüt) of -89Tor Solution L and -76 for Solution 2). Jack is now plotted with
the other intermediate proficiency students. To identi fy the chancteris tics of product data
for these respective clusters, I examined the matns presented in Table P6 in Appendix P as
well as the lists of al1 the contributing items (i-e., items with Rüt) of .5û or higher) for
Solutions 1 and 2 (which are given in Tables QI and Q3 in Appendix Q because of their
length).
T h e lists of items with high values of Rtit) in this analysis (Tables Q 1 & Q?)
include a number of items concerning the qualities of written products. This rneans these
items contributed to the segmentation of the space of Solutions 1 and 2 into three distinct
clusters shown in Figure 6-5. This further rneans these clusters can be identified by distinct
characteristics of written products. In fact, regulanty in the transition of option pattems can
be easily identified in the results of the assessments of the participants' Japanese essays
(Table P6 in Appendix P). Generally speahng, the supenor Japanese-proficient group nas
associated with excellent qualities of Japanese essays on three components (content.
organiution, and language use) across the trisks, the advanced-proficient group with good
qualities, and the intermediate Japanese-proficient group with fair o r good qualities.69
In terms of SOLO Ievels, distinctions were clear between the superior and the
intermediate/advanced Japanese-proficient groups. The writings (across the two tasks) of
the superior proficient students showed more complex structure, whereas the wntings of
the less proficient students appeared simplistic. Of special note, though, is Colin who
clustered into the intermediate Japanese-proficient group. Although the qualities of other
testual features of Colin's Japanese essays were seen to be about the same as those of other
intermediate students, his essays were judged to be as cornples as those of the superior
Japanese-proficient students in terms of cognitive structure mani fested in the tests.
69 In seelring to identify some patterns in che results of the Japancse essay assessrnenu, the Task II
essay scores of b l q , blartin, and Eliot were not taken into consideration. for those essays had previously
been correcteci based on native speakers' input before submission, as rnentioned in chapter 5.
\ :. -2,.
. lu-
.- - E.
For Analysis 4(b), the percentage homogeneities of Solutions 1 and 2 were 37.95%
and 31.01% respectively. The distribution of the participants plotted in Figure 6-6 was
essentially the same as that in Figure 6-5. An esamination of major contributing items with
R ~ t of
l -5or higher for Analysis 4(b) ( s h o w in Tables 43 & 44 in Appendix Q) confims
the images emerging from the previous analyses. That is, this data set contains three
distinct clusters divided by the three proficiency levels and the three ethnicities. The
superior Japanese-proficient group consisting of ethnic Japanese students were inclined to
approach JFL writing as a meaning-making activity and to feel they had lemed about not
only language use but also content through their JFL writing. During the processes of
writing, idea genention or language use was never easy for them. The protocol data
indicated that they did devote a fair amount of cognitive energy to thinking about
language, gist, or both. Another characteristic of this group was the high quali ty of the
characteristics in their backgrounds and less distinct but unique features in their views of
and behaviors in JFL writing. The advanced Japanese-proficiency group was apparently
more confident in Japanese and approached JFL writing with less struggle than the
intermediate Japanese-proficiency group, who understood well and admitted openly their
lack of cornpetence in the Japanese language. Despite such differences. the qualities OC the
two groups' Japanese essays were almost i ndistinguishable. This fact brought the two
groups into close prosimity in Figures 6-5 and 6-6 compared to the previous Figures for
the analyses without essay assessrnent data. AI[ of the component scores of both groups
were in the fair or good range, and the cognitive structure manirested in their writing was
less comples than that of the supenor Japanese-proficiency group. Also. they shared the
viecv of JFL writing as a mere language esercise and of having leamed, if anything, about
the use of language, but not s o much about content. while they wrotc in Japanese.
a ) .
Chapter 7: Conclusions
This chapter concludes the dissertation. In this final chapter t retum one more time
to the entire data set to corne to a better understanding of the nature and meaning of the
students' experiences of J R wri iing and learning in this one JFL classroom. At the same
time, 1 attempt to situate the study in a broader context of scholarly work on literacy,
biliteracy, and bilingual praessing. First, 1 describe the situational and individual factors
of rny study in terms of the "continua of biliteracy" (Homberger, 1989),70which provide a
system to define biliterate situations comprehensively, enabling meaningfui cornparisons
among different instances of them. Once my research context is defined in biliterate terms,
1 revisit the four sets of guiding questions pertaining to the main components of Biggs's 3P
mode1 (see section 1.4)--the teaching context, students' chancteristics, wnting processes,
and written products. I summarize and discuss my answers to the questions based on the
results of the analyses presented in the previous chapters. Finally 1 reflect on my research
overall and address my ovenrching question: What does wnting as a mode of leaming
mean in the contest of foreign language instruction and in relation to the proposition that
foreign language writing is more than just wnting a foreign language? Suggestions for
further research and implications for classroom instruction and curriculum design are also
provided.
70 See also Cumming (1994) for an adoption of Honiberger's framework as a comprchensive basis to
describe the wide scope of biiiterate issues addresscd in recent studies on U readng or writing.
7.1. Understanding tlw Conîext of JFL Writing
71 The importance of such a conceptuai framework for understanding biliterate: 1contexts becomes
apparent if we recognize the cornplesity and diversity of biliteracy around the worid. Cumming (1994)
provided cornmon exampIes that cm be positioned at extreme ends of Honiberger's nine continua. 1 cite
some of his exunples to illustrate complexities inherent in studies of biliteracy: foreign tourists reading maps
at the micro end and the EngIish-language policy in Hong Kong at the macro end of a continuum; use of
Hebrew in Jewish religious pmctice at the literal end and traditions of folk tales at the oral end of a
continuum; and dominant use of English in many parts of North Arnerica at the monolingual end and
customary concurrent use of two or more languages in many parts of Aîrica at the bilingual end of a
continuum.
classroom; moreover, the macro-context, which 1 did not address, was one where Japanese
is not widely used but rather English predominates institutionally and in the society at
large. This JFL ciassroom's focus on the written language defines i t at the written-
language end of an oral-written language continuum. Since Kei concentrated on the
reading component more than the writing component in her teaching, the context was at a
point toward the receptive end of a receptive-productive continuum. In terms of L1-L3
transfer, the students apparently experienced variable situations or different points dong
this continuum, sorne experiencing more transfer across their languages than others, and
Chinese having different affinities to Japanese than English does.
With respect to the media of languages defined by the last three continua (Le.,
simulîaneous-successive exposure, similar-dissimilar language structures, and convergent-
divergent scripts), the contest differed from group to group. The ethnic Japanese or
superior Japanese-proficient people had had early exposure to oral and written Japanese.
whereas the other participants did not The latter group of students started to leam kpanese
well after they had acquired literacy skiils in their Lls. Thus, according to Homberger's
successive exposure to Japanese for the ethnic Japanese group; for the other ethnic groups,
it was at the successive end. Further, the context was at a point toward the convergent end
of a convergent-divergent scripts continuum for people with Chinese literacy skills because
of the orthographie elements shared by the Chinese and Japanese languages. But it was at
the divergent end for the people who used English as their written LI. On a continuum of
similar-dissimilar language structures, the contest should be placed at a dissimilar end for
al1 the participants since al1 the tanguages involved here (i.e., English. Chinese, and
However. the exact point may be closer
Japanese) belong to di fferent linguistic familie~.~z
to the sirnilar end for Chinese speakers than for English speakers because English is an
72 English is a Germrinic language. Japanese belongs to the i U h c language family while Chinese to
the Sino-TibetanIanguage family (Taylor &Taylor, 1995, p. 5; Fromkin & Raiman, 1983. chap. 9).
Indo-European language according to general typology, whereas both Japanese and
Chinese are different non-Indo-European languages.
In sum, the biliterate context of my study can be situated at a point of intersection
between the micro, the Ii terate, and the multilingual ends of Homberger's continua. The
constituent members of this context are characterized as king at a comrnon point near the
wntten. receptive ends but at different points dong the LI-L2 transfer continuum. In terms
of the media of languages involved, the context presented itself differently for each
subgroup. To al1 the students, the Japanese language was structura11y "dissimilar" to their
Lls. But these people's experiences differed on the continua of simuItaneous-successive
exposure and the convergent-divergent scripts. Figure 7- 1 shows these trends on the nine
continua. 1t should be noted that al though the continua are presented separately here, they
are, as pointed out earlier, inevitably and inextricably interrelated. Similady, any point on a
single continuum is related to al1 other points on the same continuum (Homberger, 1989).
monolingual bilingual
receptive produdive
L1 L2 t ransfer
Figure 7-1. The present JFL writing contest as a biliterate instance situated on
Homberger's nine continua.
Note. The asterisk (*) indicates a point that applies COal1 the particip,mts; 'J" refers to the point applicable to
ethnic Japanese people of English as their L1; 'C" refers to the point applicable ro ethnic Chinese people
with Chinese literacy skills; and 'A" refers to the point shared by ethnic Anglo-saxon or native English-
speaking people. This representation focuses on common features, rather than idiosyncratic, individual
features. That is to Say, individual ciifferences within the ethnic Chinese group. for example. are not
represented. The Mandarin-Chinese-speakinghiike had Iitde ski11 in Chinese Iiteracy but established literacy
in English and thus should be positioned at a point near the divergent end of the last continuum. Such
individual features are not shown here. No point is indicated on the L 1-L2 transfer continuum as 1 was unable
to identify any common features on tbis continuum.
1 observed such tensions in Kei's teaching practices. Her intent was at first to shift
Behind this classroom scenario was Kei 's concern about the ps ychological
dimensions of her J E students attempting to become literate in Japanese. Her specific
question was: What linguistic knowledge would be required to perform li terate tasks in
Japanese? As the classes went dong, Kei became increasingly concemed, but remained
uncertain, about the kinds of linguistic knowledge that might facil itate the processes of
Japanese discourse production. Her lessons contained "planned and improvised elements"
(van Lier, 19%. p. 200) to focirs on larigunge, the term suggested by van Lier (p. 203) to
phenomenon" (McKay, 1993, p. In, attempting to establish a link between li teracy and
cognitive development. What she did not emphasize was the sociocultural dimension of
literacy, Le., social and culturai noms and conventions about the uses or Japanese written
texts.
Note, however, that Kei's teaching context described above constituted only a part
of each learner's unique context shaped by his or her particular needs and purposes.
Naturally, different students devoted their "perceptual, ... emotional, and cognitive
energies" (van Lier, 1996, p. 103)differently to JFL literate tassks in their personal lives,
dthough they were dl recipients of Kei's instruction in the same classroom.
How did students' characteristics relate to their perceptiorrs of JFL ivrifiiig aizd learriiiig?
Students' personal characteristics and their perceptions of JFL wri ting and leaming
marked them into the following three distinct groups:
The students who were highly proficient in Japanese were ethnic Japanese and
indicated their confidence in spoken Japanese but not in wntten Japanese. Two of these
4 students had recently stayed in Japan for 1 or 2 years whereas the other 2 had n o such
residential experience. The students regarded English as their L 1 but showed a la& of
confidence in writing in English. They seemed to approach J F L writing as a meaning-
making activity and to feel that they leamed about language and content through
engaging in J E writing tasks.
The students who had an advanced level (but not as high as the proficiency of the
ethnic Japanese group described above) of Japanese proficiency were native-born
anglophone Canadians. They al1 had recently stayed in Japan for 10 or 12 rnonths.
They were relatively confident in their Japanese and ais0 in their L1 writing. These
students tended to regard JFL writing primarily as an activity Tor language esercises
and to feel that their learning through JFL writing involved. if anything, language use.
tVha f textir al qualifies of JFL wririrrg nid srrtderirs rruzriifes~in rrrms oJ h g u a g e use.
corrrenk and orgarrization?
How ivns the cornplexiiy of cogriitive sîr~ictiirernatii/ested iri tfreir ivritterr fexîs?
How rvere rlzese efernerrts refated to strtdmts' cfraracteristics, irrstrrîctiorrnl corrtext
variables. and irr -process be haviors?
The patterns and links that i observed in the data (particularly the data collected
from the students) and those that were established through dual scaling provide evidence
for the connections between categories depicted in Figure 7-3. Figure 7-2 gives a gnphic
summary of the salient features of the data 1 considered and their cor.nections. Solid lines
indicate distinct relations, whereas dotted lines show more tentative links. Multiple sources
of evidence and multiple dual-scaling analyses have shown particular connections between
the students' levels of JFL proficiency, the qualities of their JFL wri tten products, and their
perceptions of JFL writing and leaming.
What has prïmaril y emeged from the dual-scaling analyses are di fferent patterns
demonstrated by the native-like and the less-than-native-like Japanese-prolïcient people.
The native-like Japanese-proficient individuals produced essays of better quality in terms
of testual and cognitive stnictunl features, and they focused on both semantic and lexico-
grammatical components invoived in the production of their written discourse. In contrat,
the Japanese essays written by the less-than-native-like Japanese-proficient students were
clearly constnined in both textual and cognitive structurai features. and their primary focus
in the production of their written discourse was on the lexico-grammatical systcm. These
findings seem to confirm the distinctive stntegic and linguistic features of E writing, in
cornparison to L1 writing, that Silva (1993) pointed out based on a review of previous
studies of E3L writing.
The relations between in-process thinking patterns and other categories of JFL
writing performance are inconclusive from my analyses, leaving much room for further
investigation. There was nonetheless an indication of some relation, so 1 have indicated
this by dotted lines in Figure 7-2. The category of "LI writing experience" is included in
Figure 7-2 as one varhble that might explain the characteristics of Colin. who digressed
from the i ntermediate Japanese-proficiency group and came closer to the superior
Japanese-proficiency group in terms of the cognitive stnicture mani fested in his wri tten
texts. His paying much attention to gist dunnp his production of the Task I essay and his
view of JFL writing as a meaning-making activity are also characteristics of the superior
Japanese-profïciency group. These interesting observations (i.e., the superior Japanese-
interested and engaged writer in a foreign langage. For this reason 1 have added to Figure
7-2 the category of L1 writing experience, which was lost sight of in my processes of data
reduction. as a possible expianation for the idiosyncrasies Colin demonstnted.
One way of viewing the categories represented in Figure 7-3 is as conditions for
leaming (Spolsky, 1989).74 In this view these categories constitute tzecessary, fypical, or
gracied conditions.75 depending on the nature of the relationship between a particular
condition and a particular learning outcorne. However, further research is required to be
precise and clear about the nature of each condition and its relation to other conditions and
to the goals and outcomes of leaming. I t is also important to consider these matters through
an understanding of the configuration of various contextual factors for a particular
biliterate instance under consideration (as 1 did above in section 7.1, using Hornberger's
nine continua of bilitency).
M y ovenll research findings tend to define this particular instance or JFL writing
as "an individual shll" (McKay, 1993, p. 8) or in Street's (1984) terms "an autonomous
mode1 of literacy" (also cited by McKay. p. 8), in contrast to a sociohistorical or
ideological perspective. Among the major issues of this individual, ps ychological
- -
73 The content and amount of information collected on the individual parricipants' writing experienccs
during the interviews were inconsistent and hardly translatabIe into categories to be displayed in matrices.
Two pieces of information concerning the participants' L1 writing included in the matrices were self-ratings
of their Ll writing s k l l and the scores of their LI essays written for this research. The latter did not show
Colin to be any more outstanding than others; al1 students received the highest or the second highest range
scores. The self-rating of his writing skill as excellent seemed to be suggestive of his unique undersmding of
writing. But some other students dso rat& rheir LI writing sklls as e-zellenl. tbough their views of writing
were not comparable to Colin's. Thus, this item was not very useful in distinguishing Colin from others,
eithcr.
74 SpoIsky (1989) applicd in his development of a general theory of second Ianguage Iearning the idea
of a "preferencc modeIWCint proposed by Jackendoff (1983) for linguistic andysis. See also Elfis (1994, pp.
679-6%)) for a brief review of Spolsky's attempt.
75 Spolsky (1989) explained graded conditions as "the more something is tme, the more its
consequence is likely to occur" and typical (or typicality) conditions as llapply[ingJ typically but not
necessarily" (p. 12). In çontrast, necessary conditions arc the conditions without which certain outcomes will
not be produced.
perspective that 1 have highlighted were (a) definitions of literacy as a skill, and (b)
relationships between litency and cognitive development (McKay, L993). I want to
discuss these issues regarding my research findings.
highly educated and highly litente in their Lls. Consequently, as Olson ( 1990) contended,
these leamers attempting to write in JFL could have benefited tremendously [rom their
abilities to write and think in their Lls while they wrote in JET. This issue reflects
Cummins's (e.g., 1980, 1991) theories of the cross-linguistic interdependence of cogni tive
skills. Reiated to this theoreticai proposition. one central question prevailed throughout rny
research: How does one's proficiency in a foreign language interact with one's cognitive
engagement in idea and test processing during the production of written discourse in that
language (cf. Cumrning, 1989, 1990; Carson & Kuehn, 1994; Edelsky, 1986: Whalen &
Menard, 1995)?Some research has indicated that lack of proficiency in a foreign language
can prevent a writer [rom engaging in the generative and recursive processes of idea
production during the linear process of text production76 (see, for instance, Yau's study,
76 1 have adopted thc terms and concepts of "text production" and "idea production" found in Collins
and Gentnerfs(1980) cognitive description of the cornposing process:
It is important to separate idea production from text prduction. The processes involved in
producing text, whcther they operate on the word level. the sentence level. the paragraph
level. or the text Icvel. must produce a linear sequcnce that satisfies certain grammatid
d e s . In contrast, the result of the process of idea production is a set of ideas with many
intemal connections. only a few of which may fit the iinear mode1 desirable for text. (p. 53)
1987). I t is possible to esplain this phenomenon from the perspective of automaticity
theory: When the language is unfamiliar and little practiced, the task of text production
alone consumes cognitive resources leaving little room for idea production (Ringbom,
1987). Nonetheless, a writer like Colin, a mature writer in his L 1, seemed to suffer very
little. despite a lack of proficiency in Japanese, in engaging himself in idea production
metalinguistic activi ty, based on considerations of the students' think-aloud and interview
protocol data, which featured their concems about language. But 1 did not make any
conceptual or operational distinctions between linguistic proficiency (the abili ty to use a
specific language effectively) and metalinguistic ability (the ability to reflect o n the
language used). Future research that might compare these two h n d s of ability in an L2,
then relate them to the leaming of the language and of content expressed in wtiting using
that language, should not only help to illuminate the relationships between L2 writing and
leaming, but also to clarify the concept of writing as a metalinguistic activity in L7
contests.
Distinct characteristics shown by such participants as Colin, Jane, and Martin led
me to view JFL writing in my study as a personal construct, reminding m e of Bell's (1995)
autobiographical study of learning to write in Chinese. Bell, a native speaker of English,
described her becoming l i t e n t e in Chinese as an emotionally charged process of
transforming her own consciousness. L? students enter their litency classrooms with their
own assumptions, purposes, needs, and preferences in regard to literacy acquisition in a
new language. This is particularly true for adult learners who have had previous
experiences of leaming different foreign languages, or who began learning to read and
wnte in a target language after establishine their litency skills in their mother tongues. In-
depth case srudies that Cocus on students' persona1 espenences and that attempt to derive
m e a n i n g of L3 writing in personal o r esperiential terms will enhance our understanding
about why particular students deal with L3 writing tasks in certain ways (e-B.,
Srnagorinsky, 1997).
Whenever two languages are involved in discourse activity, lnngttnge trarisJer or
cross-lirlguistici@rence (Gass & Selinker, 1993; Kellerman & Shanvood Smith, L986;
Odlin, 1989) becomes an issue. This problem loorned large in my study (and 1 touched on
it above in citing Cummins's mode1 of cross-linguistic interdependence). Although the
transferabili ty of linguis tic and li teracy knowledge between languages has been well
supported empirically (as pointed out by Cumming. 1994, and Bell, 1995; but also note
Bell's cri tical view of this idea), a few key areas need further investigation to renne this
notion. The linguistic interdependence hypothesis and most other ideas about the benefits
of bilingualism assume that education or other societal contexts might provide sufficient
opportunities to enable L2 learners to become fluent users of their L2s (Mayer & Wells,
1996). This is seldom the case in a foreign language context, however. In my study, this
assumption was met only by the few ethnie Japanese students who grew up bilingually.
They ivere fluent speakers of Japanese. Although they were not very confident in their
writing, their Japanese writing was superior in terms of textual features and cognitive
structure manifested in their texts. On the other hand, the so-called "successive exposure"
learners with limited opportunities to use the Japanese language were less fluent in
Japanese and had rnany fewer opportunities to use the language for communication and
purposeful interactions. Although the amount of their Iapanese language input as well as
the level of their Japanese language proficiency differed markedly from individual to
individual, the qualities of these people's Japanese writing were more or less equally
constrained, except for the cognitive structure of Japanese essays wntten by Colin. the
intermediate Japanese-proficient but competent L 1 writer. Based on these observations, we
might ask: What is the threshold level of L2 proficiency required for average writers to
produce L2 essays that manifest cognitive complexity? This is a major issue in need of
future research.
Another aspect of the interdependence hypothesis that could benefit frorn
refinement concerns the effects of "language distance" (Odlin, 1989, p. 32; see also
Corder, 1978) upon bilingual transfer in literate tasks (as rnentioned by Cumming, 1994,
and Cummins, 1991). My research findings have little concrete to say on this because the
variable of language distance was confounded with the variable of L2 proficiency in the
classroom context. However, the context of bilingualism 1 studied differed markedly from
the contexts where most of the research that supports the notion of transferability of
language skills has previously been conducted, involving two Indo-European languages;
for instance, English-speaking children leaming French in immersion programs in Canada
(Swain & Lapkin, 1982). Spanish-speaking children leaming English in bilingual programs
in the Southwestern United States (Edelsky, 1986), and French-speahng adults learning
English in Ontario (Cumming, 1989). Virtually dl of these studies took place in secotzd-
latzgtîage, rather than foreign-laquage, contexts where learning is associated with
"adequate esposure to [the target language] ... and adequate [integrative] motivation to
leam [that language]" (Cummins, 1981, p. 79). This was, only to variable extents, the case
for the learners 1 studied, rvho had limited routine contacts with Japanese and were not
attempting to i n t e p t e themselves in the society of Japan per se. Future, carefully designed
research o n leamers of non-cognate languages in foreign language settings may provide
illuminating insights inro this issue and i ts variable effects o n writing in L2 (cf. Uzawa &
Cumrning, 1989).
The final point 1 want to rnake concems instruction. Kei is now (summer 1997)
preparing for the çame course for the coming academic year as 1 observed for my research
three years ago. She has k e n thinking hard about how to present balanced lessons in such
bipolar relational terms as form and meaning, part and whole, and process and product. 1
would point her (and l i ke-minded teachers) to a number of innovative instructional
approaches to literacy that seemingly have produced impressive results (see Cumming,
1994. p. 9). For esamples, Valerie Anderson's (Anderson, 1995; Anderson & Henne.
1993) Adolescent Literacy Project (ALP) cornes to mind. The core of the ALP lies in an
instructional plan to improve the English literacy of culiunll y and ethnically diverse,
inner-city high school students with literacy skills trvo o r more years below their grade
levels, by helping them to relate reading, writing, and purposeful i n q u i q . I t is based on a
number of learning theones such a s problem-centered leaming, strategic thinking,
intentional leaming , col laborative leami ng, and process wri ting. Successful work of a
similar nature in L2 settings was reviewed by Elley (1994). Studies evaluating the effects
of instruction based o n such innovations are needed; s o is documentation of teachers'
improvisation processes in teaching, in order to understand esactly how theones believed
to enhance leaming actually work to affect students*learningn and cumcular processes.
As Cumming (1994) pointed out, such research "remains remarkably sparse" (p. 9) in
case study approaches in educational research. The advantages included (a) the
compieteness and depth of analysis, (b) the hypothesis-generating nature of studies, and (c)
the role of cases that challenge or contradict current beliefs. The disadvantages included
(d) lack of generalizability, (e) lack of objectivity, and (0 a data-dnven, iather than theory-
driven, approach. My thesis research reported here embraced al1 these features, which
together contributed to the way 1 now understand the relations of JFL wnting and learning
as well as the advantages and limitations of case study research.
- - -- --
- - - - -
77 Onc implication from my research concerning the mcasurcment of students' leanting is that
different schemes may assess differcnt aspects of lcruning quafitics (see the multi-trait rating scheme for L2
wri ting and the SOLO a d ysis used io evaluate the same pieces of students' Japmesc cssays).
References
Adair-Hauck, B. ( 1996).Prac tical whole language strategies for secondary and university-
level R. students. Foreigtr Langiîage Arzak, 29.33-270.
Adams, M. J., & Collins, A. M. (1979).A schema-theoretic view of reading. In R. O.
Freddle (Ed.),New directions iti discourse processing (pp. 1-22). Norwood, NJ:
Ables.
Biggs, J. B., & Collis, K. F. (1982). Evalriatirig the quality of leortiing: The SOLO
Tuxunoniy (Structure of the Observed Lear~zirtgOutcorne). New York: Academic
Press.
B iggs, J. B., & Moore, P. J. ( 1993). The process o j lenrrzing. (3rd ed.). Sydney: Prentice
Hall.
Breen, M. P. (1984). Process syllabuses for the language classroom. In C. J. Brumfit (Ed.),
General Engfish sylïabirs design: Ciirricslutn and syllabiis desigti for the general
Etzglisil classrootn (pp. 47-60).London: British Counci 1.
Bridwell, L. S., & Beach, R. (1984). Introduction. In R. Beach & L. S. Bridwell (Eds.),
New directiotrs in cornpositiotr resrarch (pp. 1 - 14). New York: The Guilford Press.
Brinton, D. M., Snow. M. A., & Wesche, M. B. ( 1989). Cotzterit-based secotxd la~zgirage
imtricction. New York: New bury House.
Brock, C. A. ( 1986). The effects of referential questions on ESL classroom discourse.
TESOL Qrtarterly. 20,47-58.
Brown, J. D. (1991). Do English and ESL faculties rate writing samples differently?
TESOL Qirarterly. 25,583-603.
Cantoni- Harve y, G. ( 1987). Content-area langiiage imtritctiotr : Approaches and
strntegies. Reading, M A : Addison-Wesley.
Carlson. S. B. (1991). Prograrn evaluation procedures: Reporting the program publicly
wi thin the poli tical context. In L. Hamp-Lyons (Ed.),Assessitig second latigrtage
writirzg iti academic corrtexts (pp. 293-320). Nonvood, NJ: Ablex.
Camine, D., & Kameenui, E. J. (Eds.). (1992). Higlier order thir>kitcg: Designitzg
ciirricz~lrunfor mzittslre~rnedstride~~ls.
A ustin, TX: pro-ed.
Carrell, P. L., Devine, J., & Eskey, D. E. (Eds.). ( 1988). ItiIeractive approaches ta secoiid
latzgziage readitig . Cambridge: Cambridge Uni versi ty Press.
Carson, J. E., & Kuehn, P. A. (1994). Evidence of transfer and loss i n developing second-
language wri ters. 1n A. Cumming (Ed.), Bilingiial perfortnance bi readirlg niid
ivritircg ( p p . 57-38 1). Amsterdam: John Benjamins.
Center for Applied Linguistics. ( 1992). Japarzese Speaking Test. Washington, DC: Center
for Applied Linguistics.
Chafe, W. L. ( 1980). The deployment of consciousness in the production of a nanative. In
W. L. Chafe (M.), The pear stories: Cognitive. cuftiîrd, and linguistic aspects of
rzan-ative proditction (pp. 9-50). Nonvood, NJ: A blex.
Chaudron, C. ( 1988).Second fanguage clussroor~r~:
Research or1 teacliing and learrzing.
Cambridge: Cambridge University Press.
Clandi ni n, D. J. ( 1986). Classroom pracfice: Teaclier irnages in acfion. London: The
Falmer Press.
Clandinin, D.J., & Connelly, F. M. (1991). Nanative and story in practice and research. In
D. Schon (Ed.), The rejlective tzirn: Case sticdies of reflective practice (pp. 358-
28 1). New York: Teachers Colleg Press.
Cole, M. ( 19%). Cirlhîral psychology: A orrce alrd jirtrtre discipline. Cambridge, M A : The
Belknap Press of Harvard University Press.
Collins, A. M., & Gentner, D. (1980). A framework for a cognitive theory of writing. In L.
W. Gregg & E. Steinberg (Eds.), Cognitive processes irr writirrg (pp. 51-72).
Hillsdale, NJ: Lawrence Erlbaum.
Connelly, F. M., & Clandinin, D. J. (1988). Teacliers as curriciifum plantzers: Narratives
of experietice. New York: Teachers College Press.
Connor, U. ( 1987)- Research frontiers in wri ting analysis. TESOL Qiiarferfv,21.677-696.
Connor-Linton, J. ( 1995). Crosscult u r d cornparison of wri ting standards: Amencan ESL
and Japanese EFL. World ErzgIishes, 14,99-115.
Connor-Linton, J., & Haichour, E. H. (1997, March). The relation between linguistics
cornpetence and writing proficiency: ~videncefrom language episodec Paper
presented at the Annual Conference of the Amencan Association of Applied
Linguistics, Orlando, Flonda.
Corder, S. P. (1978).Language distance and the magnitude of the language leaming task.
SZirdies iri Secorid L m g zrage Acqtt isirio~i,2.27-36.
Eisner, E. W. ( 199 1). The eriligl~tetzedeye: Qzralilative irtqriiry artd the enharrcernent of
educa~iorrnlpractice . New York: Macmi Ilan.
Elley, W. B. (1994). Acquiring literacy in a second language: The effect of book-based
p r o g m s . 1n A. Cumming (Ed.), Biiiiigrml performarzce in reading atid writiq (pp.
33 1-366). Amsterdam: John Benjamins.
Ericsson, K. A., & Simon, H. A. (1993). Protocol arialysis: Verbal reports as dara (2nd
ed.). Cambridge, MA: The MIT Press.
Fanselow, J. F. (1990). "Let's seen: C~ntrastingconversations about ieaching. In J. C.
Richards & D. Nunan (Eds.), Secorid lariguage teacher edrccariorz (pp. 182- 197).
Cam bridge: Cam bridge University Press.
Rower, L. (1990a). Introduction: Studying cognition in context. In L. Rower, V. Stein, J.
Ackerman, M. J. Kantz, K. McCormick, & W. C. Peck, Readitrg-to-write:
Erploritzg a cogtriiive atrd social process (pp. 3-32) . New York: Oxford University
Press.
Flower, L. (1990b). Preface. In L. Flower, V. Stein, J. Ackerman, M. J. Kantz, K.
McComick, & W. C. Peck, Readitzg-tu-writing: Exploritig a cognitive and social
process (pp. v-vi). New York: Oxford University Press.
Rower, L. (1990~).The role of task representation in reading-to-write. In L. Flower, V.
Stein, J. Ackerman, M. J. Kantz, K. McCormick, & W. C. Peck, Reading to rvriie:
Expkwirzg a cognitive & social process (pp. 3575).New York: Oxford Universi ty
Press.
Flower, L. ( 1993). Probiern-solvirig strategies for writittg (4th ed.). Phi ladel phia: Harcourt
Brace Jovanovich College.
Hunt, K. W. ( 1965). Grarninatical structures written al tlcree grade le vels. Urbana, 1L:
National Council of Teachers of English.
Hunt, K. W. ( 1970). Syiztactic mafzcrity NI sclrool-childreii aizd adults ( V 01. 35). Chicago:
University of Chicago Press.
Jackendoff, R. (1983). Setnailtics w d cogtiition. Cambridge, MA: The MIT Press.
Jackson, P. W. (1992). Conceptions of cumculurn and curriculum specialists. In P. W.
Jackson (Ed.), Hmidbook of research ON ciirriciiltirn (pp. 3-40). New York:
Macmillan.
Jacobs, H. L., Zinkgraf, S. A., Wormuth, D. R., Hartfiel, V. F., & Hughey., J. B. (1981).
Testiizg ESL corriposition: A prnctical approacir. Row ley, MA : New bury House.
Johnson, R. K. (1989). A decision-making framework for the coherent language
cumculum. In R. K. Johnson (Ed.), n i e second langilage ci~rricnfurn(pp. 1-23).
Cambridge: Cambridge University Press.
Jorden, E. H., & Lambert, R. D. (1991). Juparzese latigsage imtruction iri the Uriited
States: Resources, practice, atid iri vesirnenr strategy. Washington, DC: National
Foreign Language Center.
Kanagy, R. (1995, July). Bibliognphy of research o n the acquisition of Japanese as a
secondlforeign language. Available HTTP: Hostnarne: uoregon.edu Di rec tory:
http://darkwing.uoregon.edu/-kanagy/jslarhmp.html
Kato, Y. (1995). Differences in cognitive process between slcilled and unskilled writers.
The Joiïrnol of Japaiiese Latigirage Eriiication Methoh, 2,4647.
Kel lerman, E., & Shanvood Smith, M. ( 1986). Crosslinguistic iri/luences irz second
language acquisition. New York: Pergarnon.
Mare, G. R. (1974).Assessing readability. Reading Research Qicarierly, 10,61-103-
Klein, W. ( 1986). Second latiguage acqiisition. Cambridge: Cambridge University Press.
Kobayashi, H., & Rinnert, C. ( 1994). Effects of first language on second language wri t i n g
Translation versus direct corn posi tion. 1n A. Cumming (Ed.), Bilirigiîal
perfurrnatice itz reading and ivritirig (pp. 2Z-255). Amsterdam: John Benjarni ns.
Koda, K. ( 1993). Task-induced vanabili ty in FL composition: Language-specific
perspectives. Foreigrt Lntiguage Aririals, 26,332-346.
Kroll, B. ( 1990). Introduction. I n B. Kroll (Ed.), Secotid Lmzgitage Writit~g:Research
irzsightsfor the classrootn (pp. 1-5). Cam bridge: Cam bridge Uni versi ty Press.
Kubota, R. ( 1996). Cntical pedagogy and cntical literacy in teaching Japanese. Japatzese-
Laiigriage Editcatioti aroiotzd the Globe, 6,354.
LaBerge, D., & Samuels, S. J. (1974). Toward a theory of automatic information
processing in reading. Cogriitive Psydiolugy. 6,393-323.
Lange, D. L. ( 1990). Sketching the cnsis and explonng different perspectives in foreign
language curriculum. In D. W. £3i rckbichler (Ed.), New perspectives atid tieiv
directiorzs iri foreigti latiguage edrocation (pp. 77-109). Li ncol nwood, IL: National
Textbook Company.
Lange, D. L. (1992). Foreign language education. In M. C. A l h n (Ed.), Etzcyclopedia of
edirca~iottafresearcli (6th edi tion ed., pp. 531-530). New York: Macmillan.
Langer, J. A. (1986a). Cliildren reading atid writitig: Strrictiires and strategies. Norwood,
NJ: Ables.
Langer, J. A. (1986b). Reading, writing, and understanding: An analysis of the
construction of meaning. Writteti Comrnioiication, 3 , 319-267.
Leaver, B. L., & Stryker, S. B. (1989). Content-based instruction in foreign language
classroorns. Foreign Lurigringe A~tials,22,269-275.
Lesgold, A. M., & Perfetti, C. A. ( 1978). Interactive processes in reading comprehension.
Discoirrse Processes, 1 ,323-336.
Littlejohn, A., & Windeatt, S. (1989).Beyond language learning: Perspectives on materials
design. In R. K. Johnson (Ed.), rite second language ciirricrilrim ( p p . 155- 175).
Cam bridge: Cam bridge University Press.
Loban, W. D. ( 1%3). The langiiage of elernenfary school cliildren . Urbana, IL: National
Council of Teachers of Engiish.
Marshall, J. D. ( 19â7). The effecis of writing on students' understanding of literary texts.
Research iri rlie Tenchirig of Erzg lish. 21,30-63.
Mayer, C., & Wells, G. (1996). Can the linguistic interdependence theory support a
bilingual-bicul tunl mode1 of literacy education for deaf students? Joiirrial of Deaf
S~iidiesand Deaf Ediicatiori. 1.93- 107.
McKay, S. L. ( 1993). Agrridas for secorid lariguage literacy . Cam bridge: Cam bridge
University Press.
McLaughlin, B. ( 1981). Themies of secmd-lnnguage learrzirig . London: Edward Arnold.
Met, M., & Galloway, V. (1997). Research in foreign language cumculum. In P. W.
Jackson (Ed.), Haridbook of researclr ort cicrricrrlutn: A project of lhe rirnericna
Educatiomzl Research Associafion (pp. 85?-8%). New York: Macmi 1lan.
Miller, J. P. ( 1988). The holistic czirric~ilrrm.Toronto: OISE Press.
Nishisato, S., & Nishisato, 1. ( 1994).Dial scalitig iti a riiifslzell. Toronto: Microstats.
Nunan, D. (1988). The learrier-ceriired crirricrtliirn. Cambridge: Cambridge University
Press.
Odl i n, T. ( 1989). Lang rmge Trarisfer:Cms-liriguistic iriflrtence iti larzg linge leaniitig .
Cambridge: Cambridge University Press.
Olson, D. R. (1990). Contribution to the Forum: When a learner attempts to become
litente in a second language, what is she or he attempting? TESL Talk, 20, 18-20.
Olson, D. R. ( 1994). The world or1 paper: The coricepaal atid cognitive itnplications of
writirig atid readittg . Cambridge: Cam bridge University Press.
Ontario Institute for Studies in Education. (1993). OISE griidelities for theses ntid orais.
Toronto: A uthors.
Ootake, H. (1994). Think-aloud protocol analysis of Japanese language leamers' writing
processes and strategies. Nikorigo Kyoirikri [Journal of Japanese Language
Teaching], 82, 193.
Purves, A. (Ed.) (1992). The IEA study of ivrizten cornpositiott II: Edrrcalioti atrd
per/ormmce iti forîrteeri cowtries. Oxford: Pergamon.
Raimes, A. ( 1985). What unskilied ESL students do as they wnte: A classroom study of
composing. TESOL Qrcarterly, 19,329-258.
Reid, J. M. (1993). Tencliiiig ESL writi~ig.Englewood Cliffs, NJ: Prentice Hall Regents.
Riazi, A. ( 1995). Sociali:atiori into acadernic writirig iri n secorid larigrcage: A social-
cogiritive arialvsis of text production and learrririg amorig Irarziarr graduate studetits
ofediccatiori. Ün~ublisheddoctoral dissertation, Uni versi ty of Toronto.
Riazi, A., Lessard-Clouston, M., & Cumrning, A. (1996). Observing ESL writing
instruction: A case study of four teachers. Jormral of Interisive Erigiish Stzrdies. 10,
t 9-30.
Richards, J. C., & Nunan, D. (1997). Second language teaching and leaming. In M. C.
AIkin (Ed.), Eircyclopedia 01edi<cationalresearch (6th ed., pp. 1200- 1208). New
York: Macmillan.
Richards, J. C., Platt, J., & Platt, ii. ( 1992). Lorigtrian dictiorinry of latrgiiage teacliirig and
applied firiguistics (2nd ed.). Halow ,England: Longman.
Ringbom, H. ( 1987). The role of the Jirst larigirnge irz foreigrr laagicage leaniirig.
Clevedon, Avon: Mu1tilingual Matters.
Salomon, G. ( 1991). Transcending the qualitative-quantitative debate: The anal y tic and
systemic approaches to educational research. Mircational Researclzer. 20. 10- 18.
Sasaki, M., & Hirose, K. (19%). Esplanatory variables for EFL students' espositoq
writing. Lnrrggnage Lear~iirig,46, 137-174.
Shaughnessy. M. P. (1977). Errors niid expectations: A guide for rlre tencher of basic
writirrg . New York: Osford University Press.
Shibata, M. (19%). The effects of the L1 onhognphic system and L2 language proficiency
on L3 writing processes. In S. T. Hayes & E. Takahashi (Eds.), Proceedirzgs of the
Eiglit Anmal Coti/erence of the Lake Erie T e a d e r s 01Japanese: Buck to the
bmics--bitildirig arttotrraticity (pp. 137-154). The Lake Erie Teachers of Japanese.
Shiffrin, R. M., & Schneider, W. (LW7). controlled and automatic human information
processing: II. Perceptual leaming, automatic attending, and a general theory.
Psychologica l Review , 84, 127-190.
Silva, T. (1990). Second language composition instruction: Developments, issues, and
directions in ESL. In B. Kroll (Ed.), Seco ,id lorigtiage writirig :Research imiglit /or
t k clacsroom (pp. 1 1-23). Cambridge: Cambridge University Press.
Silva. T. ( 1993). Toivard an understanding of the distinct nature of L3 wri ting: The ESL
research and its implications. TESOL Qtinrterly, 27,657-677.
Smagorinsky, P. ( 1989). The reliabili ty and vaiidi ty of protocol analysis. W t e n
Curnrniinicatiort ,6,463-479.
Smagorinsky, P. (19941). Introduction: Potential problems and problematic potentials of
using talk about writing as data about writing process. In P. Smagorinsky (Ed.),
Speokitig about writi~ig : Reflectiotis on research rnethodology (pp. i x-xix).
T h o u s u d Oaks, CA: Sage.
Smagorinsky, P. (Ed.). ( 1994b). Speaking about ivritirig: Rejlectioas on research
rnethodology .Thousand Oaks, CA: Sage.
Smagorinsky, P. ( 1 9 9 4 ~ ) Think-aloud
. protocol analysis: Beyond the black box. In P.
Smagorïnsky (Ed.), Speakitzg abolir writing: Refectiorrr oti research rnethodology
(pp. 3-19). Thousand Oaks, CA: Sage.
Smagorinsky, P. (1997). Personal growth in social context: A high school senior's search
for meaning in and through wri ting. FVritren Cmnrirlicaiiori, 14,63- 105.
Smith, C. T. ( 1978). Evaluating answers to comprehension questions. The Reading
Teaclrer, 3 1,896-900.
Smith, F. ( 1990). ru tlrink. New York: Teachen College Press.
Smith, F. (1994). LVrititrg nttd the writer (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
Snow, M. A.. Met, M., & Genesee, F. ( 1989).A conceptual frarneivork Cor the integntion
of language and content in second/foreign language instruction. TESOL Qaarterly ,
23,201-317.
So, S. (1989). Process and prodrrct of six college stildettt writers: A direcf observation
stiidy of LI (Etiglish or Ciiitrese) arid L2 (Japatiese) writitrg . U npublis hed master's
thesis, University of Hawaii at Manoa, Honolulu.
So, S. ( 1994a). A holistic approach to foreign language curriculum. Unpublished
manuscript, Ontario Institute for Studies in Education of the University of Toronto.
Strauss, A. L., & Corbin, J. (1990). Basics of qualitative researclr: Grouaded fheorv
procediires and teclmiqiles. New bury Park, CA: Sage.
Street, B. V . ( 1984).Literacy irz tkeory arzd praciice . Cambridge: Cam bridge Uni versi iy
Press.
Sudermann, D. P., & Cisar, M. A. (1992). Foreign language across the cumculurn: A
critical appraisd. The Modem btzgirage Joiirrml, 76, 295-3023.
Swaffar, J. K. ( 199 1). Language learning is more than learning language: Rethinking
reading and writing tasks in testbooks for beginning language study. In B. Freed
(Ed.), Foreign language acquisitiotr researcli and the classroorn ( p p . 752-279).
Lexington, MA: D.C.Heath and Company.
Swain. M. (1995). Three functions of output in second language leaming. In G. Cook & B.
Seidelhofer (Eds.), Priticiple and prac~iceiri npplied liiiguistics ( p p . 135-144).
Oxford: Oxford University Press.
Swain, M., & Lapkin, S . (1981). Evaliiafitzg bilingiial ediication: A Canadiari. case stirdy.
Clevedon, England: Avon.
Swain, M., & Lapkin, S. ( 1995). Problems in output and the cognitive processes the-
generate: A step towards second language leaming. Applied Lingrcistics, 16, 371-
39 1.
Takano, Y ., & Noda, A. (1995). Interlanguage dissimilarity enhances the decline of
thinking ability during foreign language processing. Larrgiinge Lenrtrirrg, 45,657-
681.
Taylor, I., & Taylor, M. M. ( 1995). Writitig and literucy itz Chinese, Korean and Jupunese.
Amsterdam: John Benjamins.
Uzawa, K., & Curnming, A. (i*89).Wnting strategies in Japanese as a foreign language:
Lowering o r keeping up the standards. The Caaadian Modern Languoge Revîew,
46, 178- 194.
Valdes. G., Haro, P.. & Echevamarza, M. P. (1992). The development of wnting abilities
in a foreign language: Contributions toward a general theory of L2 wnting. The
Modern Lunguage Jotirtzul. 76,333-352.
van Lier, L. (1996). hteractioti itz the latzgiiage curriculiirn: A~varetiess.auionomy. and
aithenticity. London: Longman.
Vaughan, C. ( 199 1). Holistic assessment: What goes on in the rater's mind? In L. Hamp-
Lyons (Ed.), Assessitg srcotzd latrgriage writirig itz acadetnic cotr~exfs(pp. 11 1-
125). Nonvood, NJ: Ables.
Vygotsky, L. S. ( 1986). Tho~cglitatrd latrgiiage (A. Kozulin, Tram.). Cambridge, MA: MIT
Press. (Original work published in Russian in 1934.)
Wertsch, J. V. (Ed.). ( 1981). The corzcept of activity b Soviet psychology . Armonk, NY:
Sharpe.
Williams, J., & Snipper, G. ( 1990). Liierncy and bilitrgziulism. New York: Longman.
Willows, D. (1996, November). The balanced and flesible li teracy diet: A teacher
education system for improving litency levels. Paper presented a t the Human
Development and Applied Psychology Research Colloquium, Ontario Institute for
Studies in Education of the University of Toronto.
Yau, M. S.-S. (1981). Two approaches to irtiprovitrg the writitig perforrnnnce of ESL
students. Unpublished doctoral dissertation, University of Toronto.
Appendix A: Letters of Consent
Givert to Kei
Dear [Kei]:
From our earlier conversation I understand that you are wiIling to support my doctoral thesis
research by allowing me to solicit participants from your class of [course number]. observe some of
the classes during the 1-95 academic year, and interview you monthiy during the year about
your perception of course objectives and instructional techniques and your evaluation of course
progress.
Data obtained from you and your class will be used exclusively for the purpose of this research.
Coofidentiality of the involvement of yourself and your class in the study will be strictly
maintained by using pseudonyrns.
At the completion of the research 1 will provide you with a sumrnq report of the study's findings.
Your participation is voluntary. If you decide to participate at this point, you may withdraw from
the study at any tirne.
Attacheci are a soticitation letter to be distributed to students and my thesis proposal. Please read
thern carefully. If you are still interested in supporting my research project. couid you kindly
complete the attached form and return it to me?
Thank you very much for taking the tirne to read this letter. 1 can be contacted at the telephone
number or e-mai1 address below, if you wish to have more information.
Sincerely,
Sufumi So
Tel. no.: 924-5918
E-mail: [email protected]
Signature: Date:
To whom it may concem:
Thank you very much for taking the time to read this letter. I can be contacted at the
telephone number or e-mail address below, if you wish to have more information.
Sincerely,
Sufumi So
Tel. no.: 924-59 18
E-mail: [email protected]
1 have read your letter and would like to support your research project.
Name/Title:
Signature: Da te:
Appendix C: Questionnaire on Teacher Beliefs and Practices of Teaching
of Writing
writing as writing as a
language pnctice discovery process
IDEAL: I 2 3 4 5
ACTUAL: 1 2 3 4 5
Please elabonte o n your answer:
[More space was given in the actud questionnaire. 1
2. What should the role of the teacher in the writing class be?
What was the role of the teacher in the writing class?
to present information to facilitate each
about written Japanese student's writing process
3. What should the role of the student in the wnting class be'?
What was the role of the student in the wriûng class?
to receive information to take active
frorn teacher responsibility for learning
IDEAL: 1 2
IDEAL: 5
ACTU AL: 5
IDEiiL: 1 5
.L\CTU.L\L: 1 5
Please elabonte on your answer:
6. Should class tirne be devoted to prewriting activities such as brainstorming and discussion
of the topics'?
Was class time devoted to prewriting activities such as brainstorming and discussion of the
topics?
for every
assignrnent
IDEAL: 1
ACTUAL: 1
Dear friend:
If you are interested in volunteering for this study, you will be asked:
1. to talk aloud into the audiotape while writing the course assignments given by
Ms. Wei];
2. to attend an interview w hich will be conducted in English tocvard the end of the
course ;
3. to take a widely-recognized tape-rnediated test of Japanese on1 proficiency,
Japanese Speaking Test (JST), developed by the specialists of the National
Foreign Language Resource Center of the Division of Foreign Language
Education and Testing at the Center for Applied Linguistics in the United States
(The testing fee, US$60 per examinee, will be paid by me. A copy of JST
Esaminee Handbook is available from me or Ms. F e i ] for your information);
4. to complete a questionnaire asking about your background and experience of
writing and l e m i n g Japanese; and
5. to write a short essay in your mother tongue.
In retum for your participation in the entire study you will be paid Can$100. Another
benefit of yours may be my feedback to your writing. 1 will diagnose your writing
performance based on the data 1 will have collected from you and provide you with
feedback and suggestions for the improvement of your Japanese writing.
Data obtained from you will be used exclusively for the purpose of this research. What
you may say or do during the study will not be disclosed to your course instructor. It
will in no way be incorporated into the course grades. Confidentiality of your
involvement in the study will be strictly maintained by using a pseudonym.
Your participation is voluniary. If you decide to participate, you may withdraw from the
study at any time.
If you could participate in the study, could you kindly complete the atiached f o n and
retum it to me. 1 wiil contact al1 people who indicate they are interested and make
necessary arrangements wi th thern.
Thank you very much for taking the tirne to read this letter. 1 can be contacted at the
telephone number or e-mail address below, if you wish to have more information.
Sincerely,
Sufumi So
Tel. no. : 924-59 18
E-mail: [email protected]
1 have read your letter describing the study you are conducting on wnting in Japanese as a
foreign language. 1 would like to participate in this research.
Narne:
E-mail address:
Mailing address:
Signature: Date:
Appendix E: Questionnaire on Student Background, Japanese Language
Study, and Writing in L1 and Japanese
1. Identification
a. Narne
b. Age
c. Male Female
d. Major
f. Country of birth
g. Mother tongue
b. Describe briefly the history of your Japanese language study (when, where, how long,
what skills--e.g., speaking, writing, reading, etc.).
c. Have you ever lived in Japan before? If yes, when, how long, and for what purpose?
Y es When? From 19
How long? year(s) and month(s)
For what purpose(s)?
d. How do you rate your overail proficiency in Japanese as cornpared to the proficiency of
otlrer shddents in this class?
Excellent ,Good ,Fair ,Pmr
e. How do you rate your overall proficiency in Japanese as compared to the proficiency o l
riutive speakers of Japanese?
Escellent , Good , Fair , Pmr
c. How do you evaluate your writing profïciency in Japanese as compared to that of native
speakers of Japanese?
Escellent ,Good ,Fair .
Poor
d. Do you have any specific problems in writing in Japanese?
Y es (list):
a. What types of wri ting do p u perform in English (check al1 that apply)? And how often?
diary for yourself: Always , Sometimes , Not very often
personal letters: Always , Sometimes . Not very often
business letters: Always , Sometimes , Not very often
essays or reports for courses you are taking at the university:
Always , Sometimes , Not very often
essays or reports for newspaper or magazines
Always ,Sometimes , Not very often
books (what types? how frequent?):
Please ans wer the satne griestiotis below if yortr strotzge~twritte~ihngruige (Le., the
lnnguage you listed in I-j of this questiutrtraire)is not ErrglisR.
a. What types of writing do you perform in the language listed in I-j or this questionnaire
(check al1 that apply)? And how often?
diary for yourself: Aiways , Sometimes , Not very often
personal letters: Al ways .Sometimes , Not very often
business letters: Always ,Sometimes , Not very often
essays or reports for courses you are iaking at the university:
Always , Sometimes , Not very often
essays or reports for newspaper or magazines
Always .Sometimes , Not very often
books (what types? how frequent?):
-p. - -
Colirt, Task I
Eddie, Tmk I
Appendix G: Essay Rating Scale
Adapted from "Reconstnicting '.l\cademic Wnting Proficicncy"' (pp. 149-15 1). by L. Hamp-Lyons, 199 1,
Assessing Secolrd Language Wrifing in Academic Conte-rfs (cdited by L. Hamp-Lyons). Norwood, NJ:
Ablcx.
- - -
--t-
The writing displays an The writing is organized The reader is aware of
ability to communicate well enough for the
although there is oftcn
strain for che reader.
frequently.
The writiag lacks a clear The reader Ends the
organizationd structure control of vocabuiary.
There is limited ability
to manipulate the
l
message to be followed spelling. punctuau&i or linguistic systems
prammar which inmde appropriately which
iauudes frequently.
There is inabiiity to
manipulate the l&uistic
communicate which purs and the message is spelling, puncturition systems appropriately.
strain on the reader difficult to follow. and t-ar which causes severe
throughout. inad&ate. strain for the reader.
The writing does not The wnting kas no The reader is primaily There is little or ao
display an abiiity to disceniibte aware of gross sense of linguistic
cornmunicate aIthough organizational structure inadequacies of appropriacy. although
meaning cornes tlirough and a message m o t be vocabulary, spelling . there is evidence of
spasmodicall y. followed. punctuation and 1 sentence smcture.
pmmar.
The reader sees no There is no sense of
evidence of control of linguistic appropriacy.
vocabulary , spelling,
Appendix H: Instmctions for Essay Rating Procedures
Dear Rater.
Before you read and rate the essays, please examine the rating scale
adapted [rom the Hamp-Lyons scale carefully. You may rate the essays in
any order.
1. Read an essay quickly for an overall first impression. Based on the first
i rnpression. identi fy appropriate descriptors in cohfi&?L'ïc.~nvE
Q L A U ~
and ORGXSIZATION, and then record numerical ratings in the provided
rating report.
Srull
Ucs~dcsUic fact hat 11uka much M y upeclation w w l d bc l o Icwldn't h a d a t my h g h l IIhelped mc lo l c u n new wo?& 1 redly don7 have much of a jiXirns ~ h fin1
c hme IO untc a
longer. ~~ollurlg
IS untaual pmgrcu above whal Il d last into Japu~saso clrily, ro Ihad I t and Ihc context d h e words problem m t i n g in En&rh 1fccl l a p u r c ~coolpullon
WnUr~gIn any langugcs can k ~ m c perhaps
. wing aprcujoru wule faa rubotible and wun't mwc w l e u comforublc a h i t Irs Uw poactivc ruturc of wnung
rcdrotl5 uld words Uut Imight have rum II i t was Ihc mosl a p p p a l n wnting I n English a c o r n p t i o n as o p p o ~ dto
picked up from prcviour lcuonr way d cxprtuing Out puoculu mncly reading h a t hclps to
md readings. thou@ And Mrnclimcs 1 consdidarc lane's L n p s u c
encountered Lfilcultics with knowledge] in mind
pudclcr and I h e word ordcr [Dnwing on his pcnollll
cxpcricncc mlh Engltrh mfangl
l c c W o g y c w l d rsdly w s t i n
dcvelopin~writ in^ ~ b l l s
Sou have ro do 11hkc other When Japlnew pcoplc read my Nohng was new [contmt-msc] I My Ctuncrc compoauon IS noc Ibis is really lhc fir$ time hat I
E n g l ~ dessays
~ llunk of wlut you m y . Uxy will a l leu1 get the lcuned shJf Iconknt inlomaPon] ha1 g w d and, wcll. my Engl~sh b d to do such a long
arc gomg wnu.Vunk of at l c u l ~dcawhat Iwas rrylng to say. i n c l u r and then t w k dl thc compostlion is not W l good ~ o m p m i u c qIhad l o wntc $0
thee p m b about Ihc choxn conccpu m d lhcn u-rote an cuay cllhcr many (hings in Japmesc
~oplc.clabrate Ihcm. and rcc d 1 wlm'l ~ d l emphasizing
y
Ihc grammu IS concct grammar oc stnrhuc [rhctoncll
or~ivinitim).
Thcrc IS somcthmg vcry s p c c ~ l l m e ultimale p a l i s to gct info Lhc ~ i b c i n able
g lo we apprupriat The cxpericncc rcwured me of Iread and m t e a lot i n Chinme. 1 Is thc frnt expericncc of
abuf r ) ~ cstyle al wnhng In ogc of !he Japanese mind c x ~ c u i o r and
u words bccauo of thc lmporurvo dacqurnng Ihc m r c to m y x l f to rurd wl what wiling c r v y r in Japuusc
Japanese thc style dceply lcel of lhc langwgc Also 11may my Lfc IS Wnong i s power A s Y o u must not smggJc wlh
rmluddcd tn local culUrc k a 8004 way l o lcun for Enash mdng. Imade mguagc but ruimllate ~tand gve
LtCc any otl~ertun& of unbng. vocabulary c x p c n t i a l growlhrinrc 1 u m c vourwll to il
hc strmng pat IS 16 search for hnc, Thc cffcctivo writing couna If you da't h v c a teacher. you
m Image, thc sod of an ciwy p d c u o r hero inrplrcd ma r la rhwldrcad mm good Japanese
d i n g 3 to sce how lhey u c
Inpap$
In the process of writing, people think and Say many things to themselves that are quickly
forgotten. Y e t these thoughts are interesting and important parts of the wriier's problem-
soIving process.
1 am interested in the thoughts that go through your head as you work on the wri ting task.
Work o n the writing task as you normally would do. This means that you can use
dictionaries and reference books as you normally would do.
But for this writing session, please SAY OUT LOUD AND CLEARLY everv&hirza that
you have in your head while writing. You rnay use any languages you are currently
thinking in. You m q switch between languages according to your trains of thought. Avoid
k i n g silent for an. length of time. Remind yourself constantly to keep talking aloud.
If you wish to take a break. you may do so. But rcmember to record the time and date
before you stop the tape, and record the tirne and date again when you resume worlcing on
the assignment.
Appendix L: Post-Writing Questionnaire
Please comment on the ivnting assignment (e-g.,How did you feel about the nature of this
assignment? What strategies did you use to write this sakrcbioi? What were the relatively
difficult and easy things about writing this sakubsn?). Your comments will be kept
confidential. They will not be disclosed to Ms. F e i ] . So please feel free to make any
comments.
Appendix M: Sample Protocols with Coded Categories
Note. English translations of Japanese utterances are given in square brackets. .lapanese words that remain in
these translations are wntten in italics.
anoo saikin katsuji banare shi teim kodomo ga fueteim te yuu guai dakara sore wa
totem0 yoi koto aa PVeU, because ifs been said chat children who are ge&g away from p ~ t e d
words arc incrcasing in number. that (refening to what she said earlier) is very g d . um] @d:
reflective: Japanese
" katsuji banare" banare hanarem tte doo yuu j i ["kotrujibanare" w bat is the h r v i for
bcwarr, Imnareru?](consulûng Japanese dictionary) language use (spelling):
refiective: Ja panese
kakijun ga wakannai "katsujibanare" IIdon't h o w w h t is the stroke order. "kam@mare "]
language use (spelling): reflective: Japanese
sorekara watashi nanka ni totte wa manga O -mu koto ni yotte yappari ni hongo O
zuibun oboeta to omou k m a n o nihongo galrushuu tte yuu to oogesani nani keredo.
maa nihongo no vocabidary [And also. to a person Like me. because 1 ihink 1 leamed quite a
.
bit of Japanese by rading comic books, well, if 1 said Japanese language study it might sound too
big a thing. but a n y û y Japancse v o c a b u l ~ gist:
] reflective: Japanese
vocnb te nan d a t t a k e Dvhat is vocab?] (consulting English-Japanese dictionary)
language use (lexis): reflective: Japanese
"nihongo no nihongo O oboeni" de ii ya ["Japanrse.to learn Japanese" would do.]
language use (lexis): reflective: Japanese
soshiie kono "kaigai deno nihon bunka rikai ni yakudatsu" tte yuu n o w a sono
manga nimo yom keredo, tatoeba sazae-san toka dattara m a futsuu n o [..] O oboeru
tte koto wa dekiru kedo, manga no daibubun wa hon mitaini I;oo iwayum naiyoo ga
fi kushon dakara kanarazushirno yakudatsu towa omoenai kan, sore w a botsu. [And
then, çonceming this statemcnt that "(Comic book) promote foreipersf understanding of Japan," it
depends on the type of comics but, for instance, comics like suzae-san caa be a source for learning
orchnary [..], but most comics are, like book, what you d l fiction, so 1 don't t h i d they can r d l y
hclp. so this is n o g d . 1 gist: reflective: Japanese
If it is. then its. it influences. it is because. whv is it so influential? gist: reflective:
Cantonese
Because it itself is itfonnatiotr ful fillment of the Durpose of i@rtnatiori gist:
reflective: CantonesefEnglish
uh tegamni [easily] ht& riten r k n nten [advantage advantage advantagel but because of
-
this tokuchoo [chancteristics) the problern of nichi~msei[ordinariness] n ten [advantage]
-
is ah nten ah nten [advantage um advanrage] is this this this vew easv tegam tegaruni
joohoo o em [easy COobtain information] verv easv to obtain information. gist:
reflective: Cantonese/Japanese
That's riten [advaotage] joohoo [donnationl [..] the problern will be easv t o solve.
gist: non-reflective: CantoneselJapanese
Also this our final ~ r o b l e mof riten [advantagel is inparagrapli six which talks about
-
the tiatiire d tokuchoo nichijoosei [chmctenstics ordinariness] discourse
organizatiodgist: non-reflective: Cantonese/English
What thev reflect han'ei nichijoosei mangabunka no nichijoo mangabunka wa [[O
reflect. ordinariness. routine of cornic culture. mmic culture is] is the same as S ~ U U ~ ~ O
[religion] the same shuukyoo shuukym ni niteiru shuukyoo ni niteini [religion.
resembles religion. resernbks religion] gist: reflective: CantonesdJapanese
So this problem is whv this comic culture, although this comic culture is like
poprilnr culriire popiilar criltiire yori catr cotripure tu popiilar crilture. gist:
reflective: Cantonese/English
The rialrire of iliis poprilar crilture mangabunka [couic cuiture] is is the popitlarity.
gist: reflective: English
It ils iti.iiettce nJfect ifs itzflieticr is so broad ir reaches everv levels of socieîy bi a
ivay tliat a poprilnr religiori coiild do. gist: reflective: English
So tliey sliare the same characteristic ivhich is whicll corild cati be good or cati be
bad. gist: reflective: English
The &ad [Iritig of coiwse is somelitnes yoii cutitiot selecz sometimes yoii cantiot
select yoiir iti/onnatioti. gist: reflective: English
Yoii are forced to be yoii are forced to accept sorne of l e iri$orrna~iomiti/ormttion.
gist: reflective: English
Biit iu n ivav it also sofves the daily probletri. gist: reflective: English
I tliirrk ltve got to give on exatnple. writing procedures: reflective: English
Urn okay \ v h t shorrld I say afer fhis? hm»i let's see rrh Iziirn gist: reflective:
English
[..] yes sasou sasowanakatta sasowanaide sono bu sasowanaide [to invite. did not
invite, without inviting, bat department. without inviting] language use (syntax):
reflective: English
And Rere is a note here. writing procedures: non-reflective: English
rrlr okay "kekkon [mamage]" This is irz brnckets. writing procedures: non-
reflective: English
U m okav wlmf else c m I say? gist: retlective: English
I have one more page to write. writing procedures: non-reflective: English
Ali. karaoke rrm yeah eeto [weJIl let me tlzitrk okav gist: reflective: English
Uh hrirn hurn k t me see vit's coherenr, are fliq? discourse organization:
reflective: English
[../ sutnerlritzg eelse. gist: non-reflective: English
Hrrrrn ler me go [..] biit a k o knraoke ron idea ulr " bure tei kimashita [took (US Qere)] "
[..f sort of ki,rd of divided irh Rirm discourse organization: reflective: English
&rd rrh "sono baa e iku tabini [every time WC went to that bar]" ano "nankyoku kyoku
kyoku [how m;mv songs. pieces of sangs. pieces] " is that a coirriterfor like sorig?
language use (lexis): reflective: English
1..1kyoku [piece] (consulting electronic Japanese-Englis h dictionary) kyoku kyoku
Ipiece piece 1 -ah language use (lexis):reflective: English
"imamade [untii now]" huh "karaokebaa de [in the karaoke bar]" I thitzk if'sgood
"karaokebaa de lutsuu futsuuni [in the h o k e bar. usuaily. usuaiiy]"ah " futsuuni
lutsuuni [usuaiiy us~aiiy]''language use (syntax): reflective: English
ah qiriet qiiief persori qiriet irh qiiiet persotz q-wi (consulting electronic Japanese-
English dictionary) shizuka [quiet]? quiet persori rnaybe shizuka yasashii [quiet kind]?
language use (lexis): reflective: English
uchi ki [inwnrd] shy uchi ki [inward]itmshy is uchi ki [inwardl dcshm? [is it*?]language
use (lexis): reflective: English/Japanese
kirzd of j cari 't everz rernember how to write natsu [summer] language use
(spelling): reflective: English
I'rrr jiist writirig ffirse[..] thirtgs thnr corne fo my hend. writing procedures: non-
reflective: English
Eddie.
050 Utn koiv fo say everydny li/e itrn mainichi seikatsu [everyday Life]? language use
(lexis): reflective: English
Gee. ivliafs tlie ivord. very good ivord? everyciny li/e I car1 language use (lexis):
reflective: English
Huiv ahurit tfzat? uh Iium im alriglit (reading the sentence jusr wn tten) " bangumi O
mi nagara atama ni kangae ga ukanda [it occurred to me while watching the proenml "
language use (syntax): reflective: English
Maybe instead of dentootekni [traciitionai~y1 ~~(rially futsuu [usuaiiy] fudanni fudanni
tabun fudanni no h m ga [ordinarily. ordinarily maybe ordinarily is beiter] language use
(lexis): reflective: English/Japanese
fudan um fudan [ordinarily] here »te go okay fudan (consulting Japanese-English
dictionary) language use (lexis): non-refïective: English
"keredomo" uh "nihonshakaishi O miruton ["however" uh "if one looked at the history of
Japanese society"1 history o j Japanese socieiy ith Jnpntiese sociev jrrst "nihon shakai
O rniruto" [iîone looked at Japanese society] language use (lexis): reflective: English
["abnomalities are many many ple plentynah plenty is better] ianguage use (kxis):
reflective: Japanese
ion danjo [menand women] istl't there atrother, is tliere n syriotzyrri for yakuwari
[assi,pment of ~OICS]?language use (lexis): reflective: English
Maybe I look rip 'role 'hnri Eriglish orle. writing procedures: reflective: English
s l lurm role role ruot [..J yaku [roiel just yaku [role] rnaybe irr tlie Japatiese otir.
(consulting English-Japanese dictionary) writing procedures: reflective: English
yakuwari yakuwari [assigoment of roies assignment of ro~es]rrh ivfiere ivodd it be?
(consulting Japanese-English dictionary] writing procedures: non-reflective:
English
yaku [mie] tliat's the posi. positiori. language use (lexis): non-reflective: English
yakuwari [ a s s i p c n t of roIes1 iun ilo iio, assirr~ilatea feiv eqitivalrrrt words .
language use (lexis): reflective: English
"danjoyakuwan w a ai mai Dien and women's roies are ambiguous ] " tha1's a riice ivord
"aimai na koto [mmbiguous (hing]" language use (lexis): reflective: English
Kci: Task 1 Kci: Task II Raiet 1: Task 1 Rakr 1: Tark il Rnicr 2 Tark 1 Rakr 2:Task Ii
Jurnlnr
]011i112?1= 24.2 22 W
conknu9) 8.7 87 9 8 9
organSion(9) 9 8.6 9 8 8
languagc 8 8 9 9 8 8
mq9) Very weU mittcn ia al1 Vcry wcU wriacn. 1s ibauthor reaiiy a T k r e is somcthing to Mat bc a ncar native.
commcn~s aspccu. Iratocil ExceUcnl Isn'l shc imorove in che 3rd
[-noir pffodira a native spcakcr7
l o i ür 'iepoam'
cotriii]
Jmc
lola1ou 252 24 2P
conirny9) 8.1 84 8 7
organizaîion(9) 8.6 86 8 7
language 83 U 8 6
usq9) Wei1 ~ r i l kTbt
l~ Clw evidcnot of UJC Tbc 3rd pangraph ir In ordcr io communlcatt
commenu vaabulary imroduccd in iidbor's e f f o n Tbc auboti suppcrrcd 10 bt LiU;iog ber Id-, tbe writcr
~ ~ ; clms l arcl uxd ~ ; ~point skillfulty &vclopcd,
~ skillfully. about ncgative points. bld ii discussu many h h g s ia-
c*irimi Vcry ftw grammatical uslng îbc expnssions in f r t discws p i i l v c &fi
misulu. Tbe use o f a kugbt in Be clau. poim. Fasy 10 tead
greatci vatiery of
cxpreuions and more h J I
migh impmve ihc asay.
Judlih
toiallal)m 224 22 2 s 2ér
conknU9) 84 7.2 8 8 9
organiLaiion(9) R6 5.1 6 8 9
laquage &I ai 8 7.5 RS
iaq91 Vcry wcll wriuca Ablc b Vcry good wnting. Thc body s e c m sbon in The wrircr mites wcll, but Mint bc a mu native
commenu w a numbtr of abstraci proponion I o the could have given more spcaktr.
',ui: ! , rd~? Somc spokm
wordi. introduction ihoughl to the conlent.
COIU=DI) cxpicsions. A fcw
gramrnaiical rnisiakts, b u
passable.
JOY
iota1 (27) L
u 2 2Q.2 22
7
u
1
conlenU9) 8.4 6.9 8 8
organhlion(9) 9 7.7 7 5 B 5
language 83 7.9 7 7J 7 5.5
urec9i Vcw weii wiitcn in al1 Wcll wriiiea laclurion of Vcry wcll witicn Concise. This essay sccms Good in ihe use of ïbcte is no conncction
:owrcte c w n p l u Thcrc arc some problcms incomplcie. conjunctiom. Easy to icad xtwcco ihe bcginning and
rccommendcd wiih ihc c h i u of and uadcrsidob bc ending, and the wbole
vocabulary, but dbers arc s y is uniocwd
al1 Tinc.
22 UA 1P U
U
8.1 7.8 3 4
8.1 Il 3 3
6.8 5.5 4 3.5
Organization i s oby. 3vidcuce of ihe auihofs From tbt start 1 got an From ihc Tirsi sentence 1 do
Meaningr of somc paru are :ffortful process. An impicssion ihat l i s stu&nt na know w b i l e wnlcr
no1 clear. An a n c m p to use rncmpt io w a viiely of ir bopclcss. WMU 10 Sdy. TOOctyplk.
a variciy of vocabulnry Is vocabulary is laudablt, Necds more cxplanation
laudablc, tbough thty are , b u g b iky are n a dways
not always ustd propcily. ~d pmpcrly.
(table c o ~ i t i r i i t e s )
Cvthy
1o1.11(22) l
u Irf u.2 u
C O I I ~ I I U ~8.) I 6.6 5 5 4
orgYiiraiionl9) 81 68 5 4 4
language 7 61 4 4.5 3
mq9) Wcll o r g m c d essay. An Inurtsiing topic, brd l e T h snidcd mus! k a The wnkr x c m IO posmcsi Bccaw of the many hji
commcnis attmpt Io use a variety of auibds own opinion Chinue spcakrr. S k uiu sujlcicnt voabulary, bu w d in t k -y, 1wi
I":!,rg~?
dimiil
vocabdary is laudablc.
Grammatical mbtakcs u c
duhk Some p m
unintclü gi blc.
to gel away by usiog the
'Chintse wotd + dcaru'
lach grammatical
compctcncc
makc m d n g with effon
But synwctic and olbcr
compicuoiu. But g d exprcuioa enon are disturblng.
~nknc~-sentcnce
conncciiom.
Cdln
l0W11271 a Y KA fi Z
conicni(9) 87 81 5 5 3 9
organizalion(9) 9 81 4 6 2 9
Iangiwge $ 1 6.8 4.5 5 2 7.5
Mrsssge clwly The positive and ncgative The m y could bc a Id 3rammar is alrighi up to Very powcrfd, persuasive.
communicatcd Good points are oot clcarly bcttcr if lbe las1 paragraph .kclaisal lcvei. Bu!
choice of vocabuhy but txplaincd Crypic. wcte funhcr devcloped beyood i b t lcvcl thtre ut
used bppmpnatcly too many mistakcr lhat
somerimcs. ~bscurciht w n k h
co~plexsenences. Somc aiendcd maning
Ch uks
?!l L
a lj U
6 5 6 1 3
63 5 4 3 7
67 5.5 4 5 5
The authoh own opinion Must bc a Chinese speaker. Dotsn'i rhc wnkr have his In spik of many mislaka Easy to rcad through Brd
hing. i fannd help but laugh hi om opinion? Probably in langllage we, the ruay ;becoatenl is vcry simple
ruch a phrase like because of the lack of IIe s y to rcad HLmus1 k uid childish
'shi&lJoo&klm['ctotic' in grammatical compekncc, i good wriirr ln Ll sr well
lapanwe]. Ench paragraph Lbe dacripion of k p a m c
k too shn. pcoplc'r tire bai bccomc
vcry flat and one-slded. - - -
;UI P-U 1P
6.6 7 3
81 8.1 5 5 5
7.6 8.8 5.5 7 7
Wcll written as a wholc, Wcll mitien but h c Iwas troublcd by the Lack it look likc an unfinishcd The Tint half I a h likc an
ibougb ibcrc are Mme authoh own opinlos >f cobcrcncc, ratber t h piece. %y wriuen by a nalive
inua-xnicniial misiakrr. missing. grammatical problcms. ipeaker, But t k iatter hdf
Use of a greakr v h e t y of ieeatobc aJFLIcmch
xPtcncc.codiog mithg
rea
66
u
b
lu
5
W
1
6.8 5 a ! I
5.9 1.5 15 L5 1.5
Suddcn change of lhe k r c b 'I', b u are thcre Wbat iil said in lbe csssy t nec& much ellori io dust bt a Chiaest speaker.
rubjcct maacr. Some parcs 'II*and I was iou mi m i r h the tidr dcrsiaod what tbe wnkr The coaicnt dou not match
unintelligi blc. roubled by tk ' d e d and s ying 10 Say, he lide.
'&' f o m k i n g mixtd in
Grammatical mistalw bc w n e cssay.
conspicuous. Lacking in
H l
US
6.9
12
6
2.2
8
lx!
6
i%i
9
8.1 72 5 6 7 8
7.6 83 6 8 4.5 85
Very ~ c l wiiuen
l Rut Wcll wriuen bui a Funay iiilc. Swing Ihai bc The cssay lacks a The spokcn and thc wriitn It's a piiy &ai i h cnlling is
sounds a liiilc ioo conclusion miuhg.Uule Lwws about tbc topic wcii conclusion forin of laiiguagc pic m i quik coniplck.
collaquial. evidence of uiilizing ihc is bcry Engiish. Using the inixd. Tbcrc is an Alihough lhe s p o h
cxprcuions iaught in clars. colloqwal expression of ' n . inilucncc of ihc mother laaguage is w d , il is a
de&. tonguc on ihc use of ibc gaod piecc of wiiing.
Japanex hiigugc. Dib the Good linguistic
mewgc is undcrsunikblc. compclcncc ai ihc
discourse levcl.
?.iJ
84
222
6.9
IZ
2
u
9
81 8.1 4 2 8
79 7.9 6 8 65
Vcry W U wriucn. Usc of difkrcnt lonns of The 'de a r r m ' l o m i s 1 sec no uacc of planning iu hlay ix a Chihincsc spcakcr
Exccllcni cboice and use of scatcace-crding cxprcsion used ioo ofrcn and i b i ihis t m y . 1 cannoi tcll DI high JFL proficiency.
vocabulory. U x of more ir cacouaged Little botha me.The wntcr h i+hrtibc wriicr w a m to
complcn xnenccr to bc evidrnce of lnilizing ~ h c dixourse-lcvcl ~aihrrthan say. He musi bc a p r
cncortngcd. cxprcssions (au~hiin clau. grammatical, problenu. wliicr in t1 as WCU.
brl 11 t2
B.4 J 7 B
K6 4 7 B
aI 1 6.5 5
Vcry w l l oiganirtd and Fhc iitlc is somcwhai The conlcnr is suuicwbi iVcll wiiiieu (rom his awn
wcll cxpicucd ushg r mislcading. Ir's n a clcm to sbaiiow. Ba kcarrrc of ibe ~rspcciive.Grammahl
rruicty of vocabulary. :kend ibat thc writci is witcr's high lcvcl of n i s h h do m i boihcr me
Somc intra-scnicaiial od icfcning KIJapancsc liaguislic compciencc, it's oomuch
grammaUc.1mistaka. iociciy in gencral blrt thc casy to ~ c a dhis rssay.
hcaidcal world in Japn.
Nok Figures 111 i~idicsarc for ihr essays r a d and corrccicd by a native s p a k c r of Japüi~csckforc subriiissioii. Asicrisks (.) iiidicaie tliiii the datri are 1\01avciilablc.
Appendix P: Forty-four Items of Student Data
Table PI
Backgroi~rzdQuestionnaire Data (Zterru 1- IO)
I
1. Ethnicity
( I ) Japanese
(2) Chinese
( 1) Japanese
(2) Chinese
3. Written LI
( 1) Japanese
(2) Chinese
(3) English
4. Self-rating o f L 1 wri ting
(1) ~r
(2) fair
(3)
(4) excellent
5. importance of Japanese study
(1) not so important
(2) important
(3) very important
6. Length of residence in Japan
( 1) less than 6 months
(2)over 6 months
7. Self-nting of o v e d Japancsc
(cf. peers)
8. Self-rating of overail J a p e s e
(cf. natives)
9. SeU-rating o f Japanese writing
Note. Options for Items 7 - 9 are the same as the ones for Item 4.
Table P2
Lmtguage Skilis Assesment Data (Irerns 1 1 - 13)
Table P3
Interview Data (Items 14-16)
use of lanepage
(2) langupe exercise
15. Perceived area of difficulty in
E L writing
(1 ~ ~ ~ p g e
(2) orgaaization
(3) la&uage & organization
16. Perceived area of Iearning thru
JFL w riting
(2) content
(3) language & content
Table P4
Posl- Writirig Qirestiomaire Data (Item 1 7-22)
I
generation for Task 1 essay
(1) =Y
(2) not so difficult
-
. .
(3) difficult
19. Level of difficulty in language 3
use for Task 1 essay
(1) -Y
(2) not so difficult
(3) difficult -
2
20. Level of satisfaction with Task
II essay
(1) not so satisfied
(2) satisfied
(3) very satisfied
2 1. Level of difficulty in idea
-
2
generation for Task II essay
(1) =y
(2) not so difficult
(3) difficult -
3
22. Level of difficulty in langage
use forTask II essay
I
I)
(1) -Y
(2) not so difficult
3 difficult
Table P5
Tlrink-Aloud Protocol Data (Items 23-30)
1 1
(3) 30.1 - 40%
score by Raters
42. Task II essay LANGUAGE USE
score by Raters
43. Task 1 essay SOLO level
(1) prestmctural
(2) unistructurd
1 (3) multistructurril
(4)relationai
44.Task il essay SOLO level
( 1 ) prestnictural
(2) unistnicturai
(3) multistructural
(4)relational
Nore. Options for Items 32 - 42 are the same as the ones for Item 3 1.
Appendix Q: Results of Dual Scaling (Analysis 4(a) and Analysis 4(b))
Table Qi
Major Con~ibi<tors
and Their Bipolar Optiorrr (AtlaZysis 4(a). Solictiotr 1 )
item description
'Iringuage' score by rater in Task 1 fairlexcellent
'orgmization' score by rater in Task II fairiexcellent
lcngth of residence in Japan l e s thm G months
language exercise
difficult
meaning making