Language Testing and Assessment
Language Testing and Assessment
ASSESSMENT
WRITING ITEMS AND TASK
Evidence-centered design (ECD)
Describing items and tasks
Tasks and teaching
PROTOTYPES, PROTOTYPING, AND
FIELD TEST
HERBERT MOUREN
SIANIPAR
LANGUAGE TESTING AND EVALUATION
EVIDENCE-CENTERED DESIGN
(ECD)
ECD is a methodology for designing assessments
that underscores the central role of evidentiary
reasoning in assessment design.
ECD treats knowledge as scientific because it is
primarily a method that leads to the test
designer understanding more about relations
between variables for a particular assessment
context.
information
1. Each participant holds different information
and needs both to give and to receive
information in order to complete the task.
2. One participant holds all the information
and supplies it.
3. Each participant holds all the information.
Interaction
Communication
goal
With respect to goal orientation
1. Participants have convergent goals.
2. Participants have divergent goals.
With respect to outcome options
1. Only one acceptable outcome is possible.
2. More than one outcome is possible.
PROTOTYPES,
PROTOTYPING AND FIELD
TESTS
Prototypes
Prototyping
Field testing
The iterative nature of the process
PROTOTYPES
Prototype comes from the Greek word prototypo
( ), which is sometimes translated as
archetype, made up as it is of the two elements
proto ( ) or first, and typos () or
type. The meaning of type in this sense is of a
mould or stamp, from which other examples could
be created.
From the explanation above, we can conclude
that, in design task, we have to focus of the first
type of task its self, to have a contrast or basic
view developing next task for the learners.
PROTOTYPING
In this part we have to focus how we create a new
test. This is very different from writing new
items or tasks for a test that already exists, and
which is the topic of most other texts on language
testing. We are concerned about the creation
of the first form of a test. Other forms are then
generated from the test specifications.
These are used in rapid prototyping to discover
whether the parts will work well within the
larger product that is being developed.
FIELD TESTING
In the integrated academic writing-reading
task, there are some clues that we can concern
by those purposes ;
Investigating construct-irrelevant influences on
score meaning
Studying internal test structure
Is it necessary to have a minimum reading ability
before it is possible to perform on writing tasks?
Do the writing tasks relate to one another in
theoretically anticipated ways?
Do integrated tasks relate in expected ways to
independent tasks?