Upcoming presentation
Validation and applications of rapid guessing to detect test taker disengagement
By: Steven Wise

Conference
Beyond results: Paving the way for the use of process data
Location: No Location Available
Date: 06/17/2020 - 06/19/2020
Time: No Date Specified
Description
The International Association for the Evaluation of Educational Achievement (IEA) together with the Leibniz Institute for Research and Information in Education (DIPF) and the Centre for International Student Assessment (ZIB) offer an invitation to a three-day workshop on analyzing log file and process data from international large-scale assessments in education. The event will take place as an interactive webinar and online video conference on June 17thĀ – 19thĀ 2020.
See MoreTopics: School & test engagement
Related Topics


An investigation of examinee test-taking effort on a large-scale assessment
Most previous research involving the study of response times has been conducted using locally developed instruments. The purpose of the current study was to examine the amount of rapid-guessing behavior within a commercially available, low-stakes instrument.
By: Steven Wise, J. Carl Setzer, Jill R. van den Heuvel, Guangming Ling
Topics: Measurement & scaling, School & test engagement, Student growth & accountability policies


The utility of adaptive testing in addressing the problem of unmotivated examinees
This integrative review examines the motivational benefits of computerized adaptive tests (CATs), and demonstrates that they can have important advantages over conventional tests in both identifying instances when examinees are exhibiting low effort, and effectively addressing the validity threat posed by unmotivated examinees.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement


Effort analysis: Individual score validation of achievement test data
Whenever the purpose of measurement is to inform an inference about a studentās achievement level, it is important that we be able to trust that the studentās test score accurately reflects what that student knows and can do. Such trust requires the assumption that a studentās test event is not unduly influenced by construct-irrelevant factors that could distort his score. This article examines one such factorātest-taking motivationāthat tends to induce a person-specific, systematic negative bias on test scores.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement


Response time as an indicator of test taker speed: assumptions meet reality
The growing presence of computer-based testing has brought with it the capability to routinely capture the time that test takers spend on individual test items. This, in turn, has led to an increased interest in potential applications of response time in measuring intellectual ability and achievement. Goldhammer (this issue) provides a very useful overview of much of the research in this area, and he provides a thoughtful analysis of the speed-ability trade-off and its impact on measurement.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement


Modeling student test-taking motivation in the context of an adaptive achievement test
This study examined the utility of response time-based analyses in understanding the behavior of unmotivated test takers. For an adaptive achievement test, patterns of observed rapid-guessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior.
Topics: Measurement & scaling, Growth modeling, School & test engagement


Modeling student test-taking motivation in the context of an adaptive achievement test
This study examined the utility of response timeābased analyses in understanding the behavior of unmotivated test takers. For the data from an adaptive achievement test, patterns of observed rapidāguessing behavior and item response accuracy were compared to the behavior expected under several types of models that have been proposed to represent unmotivated test taking behavior.
Topics: Innovations in reporting & assessment, Measurement & scaling, School & test engagement


Rapidāguessing behavior: Its identification, interpretation, and implications
The rise of computerābased testing has brought with it the capability to measure more aspects of a test event than simply the answers selected or constructed by the test taker. One behavior that has drawn much research interest is the time test takers spend responding to individual multipleāchoice items.
By: Steven Wise
Topics: Measurement & scaling, Innovations in reporting & assessment, School & test engagement