Addressing test-taking disengagement: The influence of embedded self-report items and grading on performance
Studies in Educational Evaluation, vol.88, 2026 (SSCI, Scopus)
- Publication Type: Article / Article
- Volume: 88
- Publication Date: 2026
- Doi Number: 10.1016/j.stueduc.2026.101573
- Journal Name: Studies in Educational Evaluation
- Journal Indexes: Social Sciences Citation Index (SSCI), Scopus, Education Abstracts, Educational research abstracts (ERA), Index Islamicus
- Keywords: Grading, Response time, Self-report items, Test-taking disengagement
- Anadolu University Affiliated: Yes
Abstract
Achievement tests are widely used to evaluate students’ academic performance. Critically, the validity of test scores depends on the assumption that students make a certain level of effort throughout testing, ensuring their responses accurately reflect their true abilities, which requires continuous engagement. Disengagement poses a serious threat to the validity of test scores by distorting psychometric properties and reducing measurement accuracy. This study examined the phenomenon of disengaged responding by testing the effects of self-report (SR) item placement and grading conditions on performance. It also explored individual-level predictors such as self-reported effort and response time. A two-way between-subjects factorial design was employed across two phases. Overall results indicated that the effects of SR item frequency and grading on test scores were not supported. However, individual-level variables—response time and self-reported effort—emerged as more reliable predictors of test scores. Recommendations and implications are discussed within the context of existing literature.