Logo image
Factors associated with the equivalence of the scores of computer-based test and paper-and-pencil test: Presentation type, item difficulty and administration order
期刊文章

Factors associated with the equivalence of the scores of computer-based test and paper-and-pencil test: Presentation type, item difficulty and administration order

T.-H. Wang, C.-H. Kao 和 H.-C. Chen
Sustainability (Switzerland), 卷.13(17)
2021
Web of Science ID: WOS:000694447000001

摘要

Administration order Computer-based test COVID-19 pandemic Item difficulty Multi-ple-choice test Paper-and-pencil test Taiwan academic performance COVID-19 experimental design learning primary education student Sustainable Development Goal
Since schools cannot use face-to-face tests to evaluate students’ learning effectiveness during the COVID-19 pandemic, many schools implement computer-based tests (CBT) for this evalua-tion. From the perspective of Sustainable Development Goal 4, whether this type of test conversion affects students’ performance in answering questions is an issue worthy of attention. However, studies have not yielded consistent findings on the equivalence of the scores of examinees’ answering performance on computer-based tests (CBT) and paper-and-pencil tests (PPT) when taking the same multiple-choice tests. Some studies have revealed no significant differences, whereas others have exhibited significant differences between the two formats. This study adopted a counterbal-anced experimental design to investigate the effects of test format, computerised presentation type, difficulty of item group, and administration order of item groups of different difficulty levels on examinees’ answering performance. In this study, 381 primary school fifth graders in northern Taiwan completed an achievement test on the topic of Structure and Functions of Plants, which is part of the primary school Natural Science course. The achievement test included 16 multiple-choice items. After data collection and analysis, no significant differences in the answering performance of examinees were identified among the PPT, CBT with single-item presentation, and CBT with mul-tiple-item presentation. However, after further analysis, the results indicated that the difficulty of item group and the administration order of item groups of different difficulty levels had significant influences on answering performance. The findings suggest that compared with a PPT, examinees exhibit better answering performance when taking multiple-choice tests in a CBT with multiple-item presentation. © 2021 by the authors. Licensee MDPI, Basel, Switzerland.

檔案與連結 (2)

url
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85114009166&doi=10.3390%2fsu13179548&partnerID=40&md5=09a5477e4127be9f17482be8da047e4d檢視
url
https://doi.org/10.3390/su13179548檢視
已出版(紀錄版本) 開放

相關連結

指標

1 檢視次數

詳細資料

Logo image