Home / Current Issue / Paper 1714731
Strategies to Minimize Pseudo-Guessing in Secondary School Economics Multiple-Choice Tests: An IRT (3PL) Study
Subject area: Science,Engineering and Technology · Area of research: Science Education (Measurement and Evaluation)
DOI: https://doi.org/10.64388/IREV9I8-1714731
Abstract
Guessing in multiple-choice assessments threatens the validity of achievement scores, particularly in secondary school Economics where such formats are widely used. This study investigated strategies to minimize pseudo-guessing in SS2 Economics multiple-choice tests using the Three-Parameter Logistic (3PL) model within the Item Response Theory framework. The study adopted an instrumental/measurement research design. The population comprised 2,266 SS2 Economics students in government-owned secondary schools in Nsukka Education Zone, Enugu State, Nigeria. A sample of 340 students was selected using Yamane’s formula and stratified proportionate random sampling. A 40-item multiple-choice Economics test was developed, face and content validated by experts, and pilot tested prior to administration. The instrument was administered as a pre-test and post-test, and data were analyzed using the R statistical environment (mirt package), focusing on the pseudo-guessing parameter (c). Pre-test results revealed c values ranging from 0.18 to 0.25, indicating moderate susceptibility to guessing. Following the implementation of strategies such as improved distractor plausibility and clearer instructions, post-test c values decreased to a range of 0.08 to 0.14. The reduction values (0.09–0.11 across items) demonstrated a consistent decline in guessing probability. The study concludes that targeted item construction and psychometric calibration significantly reduce pseudo-guessing and enhance the validity of multiple-choice assessments in secondary school Economics.
Keywords
Multiple-choice tests, Pseudo-guessing, IRT 3PL, Secondary school Economics, Test validity
References
[1] Al Lawama, A., & Kumwenda, S. (2023). Variation in guessing behaviour across items: Implications for chance success in multiplechoice tests. Journal of Educational Measurement and Evaluation, 12(4), 245–263.
[2] Baker, F. B., & Kim, S.H. (2017). The basics of item response theory using R (2nd ed.). Springer.
[3] Caudill, C., & Mixon, R. (2023). Professional training and item quality in multiplechoice item development. Assessment in Education: Principles, Policy & Practice, 30(1), 78–95.
[4] De Ayala, R. J. (2013). The theory and practice of item response theory (2nd ed.). Guilford Press.
[5] Embretson, S. E., & Reise, S. P. (2013). Item response theory for psychologists. Psychology Press.
[6] Huebner, A. J., Rogers, H. J., & Jones, B. D. (2020). Rapid guessing: Impact on item parameters and test validity. Educational Assessment, 25(4), 314–333.
[7] Persson, B. (2023). Reducing random guessing: Distractor design based on misconceptions. Journal of Applied Testing Technology, 24(3), 102–118.
[8] Robitzsch, A. (2022). Best practices for estimating pseudoguessing parameters in 3PL models. Psychometrika, 87(1), 211–238.
[9] Sideridis, G., & Alghamdi, A. (2025). Guessing behaviour and interpretation of multiplechoice test results. Educational Measurement Quarterly, 47(1), 25–39.
[10] Suksakulwat, Y., Tran, Q. T., & López, M. (2025). Random vs. educated guessing: Itemlevel analysis and implications for test design. International Journal of Testing, 15(1), 56–79.
[11] Wise, S. L., & DeMars, C. E. (2005). Response time effort: A new measure of examinee motivation in computerbased tests. Applied Measurement in Education, 18(2), 163–183.
[12] Yamane, T. (1967). Statistics: An introductory analysis (2nd ed.). Harper & Row.
How to cite this paper
@article{1714731,
author = {Ossai Elizabeth Ngozika, PhD},
title = {Strategies to Minimize Pseudo-Guessing in Secondary School Economics Multiple-Choice Tests: An IRT (3PL) Study},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {9},
number = {8},
pages = {2053-2058},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1714731.pdf},
abstract = {Guessing in multiple-choice assessments threatens the validity of achievement scores, particularly in secondary school Economics where such formats are widely used. This study investigated strategies to minimize pseudo-guessing in SS2 Economics multiple-choice tests using the Three-Parameter Logistic (3PL) model within the Item Response Theory framework. The study adopted an instrumental/measurement research design. The population comprised 2,266 SS2 Economics students in government-owned secondary schools in Nsukka Education Zone, Enugu State, Nigeria. A sample of 340 students was selected using Yamane’s formula and stratified proportionate random sampling. A 40-item multiple-choice Economics test was developed, face and content validated by experts, and pilot tested prior to administration. The instrument was administered as a pre-test and post-test, and data were analyzed using the R statistical environment (mirt package), focusing on the pseudo-guessing parameter (c). Pre-test results revealed c values ranging from 0.18 to 0.25, indicating moderate susceptibility to guessing. Following the implementation of strategies such as improved distractor plausibility and clearer instructions, post-test c values decreased to a range of 0.08 to 0.14. The reduction values (0.09–0.11 across items) demonstrated a consistent decline in guessing probability. The study concludes that targeted item construction and psychometric calibration significantly reduce pseudo-guessing and enhance the validity of multiple-choice assessments in secondary school Economics.},
keywords = {Multiple-choice tests, Pseudo-guessing, IRT 3PL, Secondary school Economics, Test validity},
month = {February},
doi = {https://doi.org/10.64388/IREV9I8-1714731}
}