Setting Consensus Goals for Academic Achievement

A Special Issue of applied Measurement in Education

This special issue is based on a workshop which began with a description and examination of the current National Assessment of Educational Progress (NAEP) standard-setting model, then looked to standard-setting applications outside of education. These applications included those that focus on human performance and the adequacy of human performance; in these contexts, raters were asked to focus on the knowledge and skills that underlie competent performance. Researchers also examined applications that focus on the impact of environmental agents on life and the ecology; in these cases, raters began with the knowledge that more (or less) of a substance is better and, as for NAEP, the judgment task was to determine "how good is good enough." They wished to examine parallels in the objectives, empirical grounding, judgmental requirements, and policy tensions for standard setting in NAEP and in other domains.

These papers were commissioned to examine the current state of affairs and residual issues with respect to achievement-level setting in NAEP and to help determine whether the models and methods used in other disciplines have useful application to education. It is important to note that the papers represent the authors' views, not necessarily those of the committee or National Research Council. This issue and the workshop discussion point out a number of analogies between the objectives, requisite data, judgment requirements and policy issues for NAEP and other applications. The editors hope that this issue and wide distribution of these papers will prompt others to join in this interesting analysis and debate.