The sample CPA exam question in Figure 2 exemplifies the importance of including quality distracters in MC questions. MC questions that guide students to correct or incorrect answers or that lack thoughtful incorrect answer choices are ineffective in evaluating student learning.
The challenge is to develop a rigorous MC question where the one correct answer requires insightful knowledge and where incorrect options are viable alternatives in terms of how students might reason incorrectly (Clegg & Cashin, 1986). This statement focuses on a more subtle element of well written distractors – their ability to capture how students are thinking when they are reasoning incorrectly. This is particularly relevant for quantitative MC questions in accounting. …show more content…
Therefore, a considerable amount of cross-disciplinary research has been conducted to test whether MC items assess the same level of students’ understanding as constructed response questions (Becker & Johnston, 1999; Bible, Simkin, & Kuechler, 2008; Kuechler & Simkin, 2003; Simkin & Kuechler, 2005). In particular, Bible, et al., (2008) looked at tests with both MC and constructive response questions to evaluate students’ understanding of accounting. They recognized that their methodology included a mix of questions that varied greatly in quality, format, and scope. Simkin et al., (2011) later followed up on the Bible et al., (2008) article and sought to justify the use of MC questions on accounting certification