Blog
Blog
Are assessments value-laden?
It is often argued that assessments are value-laden. Cherryholmes, Berlak and others, suggest that assessments are, inevitably, value-laden. Berlak (1992) says, “But as Cherryholmes (1989) argues, it is not only that subjective judgements are involved, it is also that constructs themselves are products of power and their use is an exercise of power.” (p. 185). I myself have written that there is no such thing as “assessment degree zero” and that “assessments reify the constructs they purport to assess.”
However, there is another way to think about assessments, and that is by making a clear separation between the constructs that are to be assessed, and the assessments themselves.
Within this alternative view, assessments are value-free, or, more precisely, are no more value-laden than the constructs they assess. This can be illustrated by considering the assessment of history.
For some, being good at history is knowing lots of facts and dates. For proponents of this view, multiple-choice tests are perfectly adequate for assessing history, because using a multiple choice test, one can assess a large number of facts and dates, and score the responses reliably. For others, history is about evaluating conflicting sources of evidence, constructing historical argument, understanding chronology, and cause and effect. For adherents of this view, multiple choice tests are inadequate, because they under-represent the construct of history, and they would see constructed-response tests, preferably including writing extended essay, as more valid. On the other hand, proponents of the view that history is about facts and dates would regard essay-based tests as deeply flawed, since they assess the ability of the student to write, and their linguistic skill as well as historical knowledge (what is sometimes called “construct-irrelevant variance.”
The point is that these different views come into opposition when we try to assess history, but they are not really arguments about assessment. They are arguments about what history is, or should be, about. In other words, they are arguments about constructs.
Of course, assessments can be bad. Assessing students in a language other than that in which they have been taught a subject will lead to results that are impossible to interpret; was the student’s response weak because they did not know the history, or because they were unable to understand the question, or express their response, in the language required in the test.
But if they are well constructed, assessments will be no more value-laden than the constructs they assess. The correct “objects of history” are constructs, and the “exercise of power” is the decision to assess certain constructs rather than others. By being clear about this—by being clear that arguments about assessment are usually arguments about the underlying constructs—we are likely to have far more fruitful and effective discussions.
References
Berlak, H. (1992). Toward the development of a new science of educational testing and assessment. In H. Berlak, F. M. Newmann, E. Adams, D. A. Archbald, T. Burgess, J. Raven & T. A. Romberg (Eds.), Towards a new science of educational testing and assessment (pp. 181-206). Albany, NY: State University of New York Press.
Cherryholmes, C. H. (1989). Power and criticism: poststructural investigations in education. New York, NY: Teachers College Press.
Wednesday, 7 December 2011