Set legally defensible cutscores with the modified Angoff method

Competence-based exams such as professional certification and licensure exams rely on cutscores (passing scores) to make pass-fail decisions. These cutscores must be derived from psychometrically advanced methods to be legally defensible, the most common of which is the modified Angoff method. FastTEST Web provides a module specifically designed to streamline the modified Angoff process. Subject matter experts simply record their Angoff ratings while in the system; administrators can then export and analyze for inter-rater reliability and other summary statistics. Take advantage of our free trial to see just how easy this process can be.

How does a modified Angoff study work? The purpose is to provide a criterion-referenced cutscore that best identifies examinees that have achieved a certain level of competence. The best people to determine that level are subject matter experts (SMEs), who are typically recognized experts in the field, such as practitioners with decades of experience, dedicated instructors, and executives that often make hiring decisions. A committee of SMEs discusses the qualifications of a minimally competent candidate (MCC) that is just barely qualified, and then each SME estimates the percentage of MCCs that would get each question correct. FastTEST Web provides a way for SMEs to easily review items and provide these "Angoff ratings." The percentages can be averaged to determine a recommended cutscore for the test, or results first analyzed and then further discussed to achieve closer consensus, and then averaged to determine the cutscore. Additional methods such as the Beuk and Hofstee help to further inform the process. The Angoff Analysis Tool provides a framework for all this information.