The Psychometrics of Standard Setting
Connecting Policy and Test Scores
Format:Hardback
Publisher:Taylor & Francis Inc
Published:23rd Dec '22
Should be back in stock very soon
This book provides a unifying structure for the activities that fall under the process typically called "standard setting" on tests of proficiency. Standard setting refers to the methodology used to identify performance standards on tests of proficiency. The results from standard setting studies are critical for supporting the use of many types of tests. The process is frequently applied to educational, psychological, licensure/certification, and other types of tests and examination systems. The literature on procedures for standard setting is extensive, but the methodology for standard setting has evolved in a haphazard way over many decades without a unifying theory to support the evaluation of the methods and the validation of inferences made from the standards. This book provides a framework for going beyond specific standard setting methods to gain an understanding of the goals for the methods and how to evaluate whether the goals have been achieved.
The unifying structure provided in this book considers policy that calls for the existence of performance standards, the relationship of proficiency test design to the policy, and tasks assigned to subject matter experts to help them convert the policy to estimates of locations on the reporting score scale for the test.The book provides guidance on how to connect the psychometric aspects of the standard setting process to the intentions of policy makers as expressed in policy statements. Furthermore, the structure is used to support validity arguments for inferences made when using standards. Examples are provided to show how the unifying structure can be used to evaluate and improve standard setting methodology.
"Overall, “The Psychometrics of Standard Setting: Connecting Policy and Test Scores” is an invaluable resource for professionals involved in developing and evaluating proficiency tests. It is particularly well-suited for policymakers, psychometricians, and test developers seeking to ensure their standard setting processes are scientifically sound and aligned with policy objectives. The book’s comprehensive approach, combining theory, practical guidance, and examples, makes it a must-read for anyone looking to deepen their understanding of this critical area in psychometrics."
-Myanca Rodrigues in ISCB News, May 2024
"Reckase takes us on a deep dive into the theoretical underpinnings of standard setting and achieves his goal of providing a more
formal and unified structure to the many facets of standard setting. No light read, this volume is most appropriate for those already quite familiar with the topic or for a graduate course in standard setting. That is, the book will illuminate and provide a different and deeper understanding of the topic for those having already digested the current literature. [...] Reckase’s efforts pay off in a substantial contribution to the measurement literature that strongly complements the existing work. [...] We also strongly endorse this text for a graduate course or seminar on standard setting, as it will provide a strong foundation from which to better understand the various standard setting methods and the commonalities present in the larger standard setting process."
-Daniel Lewis and Sandip Sinharay in the Journal of Educational Measurement, 2024
ISBN: 9781498722117
Dimensions: unknown
Weight: 666g
260 pages