skip to main content

Predictive Adaptive Test with Selective Weighted Bayesian Through Questions and Answers Patterns to Measure Student Competency Levels

Computer Science Department, Engineering Faculty, Universitas Maritim Raja Ali Haji, Indonesia

Received: 23 Oct 2018; Revised: 11 Feb 2019; Accepted: 29 Apr 2019; Available online: 16 Jul 2019; Published: 30 Apr 2019.
Open Access Copyright (c) 2019 Jurnal Teknologi dan Sistem Komputer
Creative Commons License This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Citation Format:
Abstract
Computer Assisted Testing (CAT) system in Indonesia has been commonly used but only to displaying random exam questions and unable to detect the maximum performance of the test participants. This research proposes a simple way with a good level of accuracy in identifying the maximum ability of test participants. By applying the Bayesian probabilistic in the selection of random questions with a weight of difficulties, the system can obtain optimal results from participants compared to sequential questions. The accuracy of the system measured on the choice of questions at the maximum level of the examinee alleged ability by the system, compared to the correct answer from participants gives an average accuracy of 75% compared to 33% sequentially. This technique allows tests to be carried out in a shorter time without repetition, which can affect the fatigue of the test participants in answering questions.
Keywords: computer adaptive test; Bayesian probabilistic; selective weighted IRT; pattern behavior
Funding: LP3M Universitas Maritim Raja Ali Haji

Article Metrics:

  1. H. L. A. N. K. R. Mitkov, "A computer-aided environment for generating multiple choice test items," Natural Language Engineering, pp. 177-197, 2006
  2. S.-A. A. Jin, "The effects of incorporating a virtual agent in a computer-aided test designed for stress management education: The mediating role of enjoyment," Computers In Human Behavior, vol. 26, no. 3, pp. 443-451, 2010
  3. I. I. B. R. J. M. David M. Williamson, Automated scoring of complex tasks in computer-based testing, New Jersey: LAWRENCE ERLBAUM ASSOCIATES, 2006
  4. M. P. D. J. B. BJ Mason, "AN EXAMINATION OF THE EQUIVALENCE BETWEEN NON-ADAPTIVE COMPUTER-BASED AND TRADITIONAL TESTING," Journal Educational Computing Research, vol. 24, no. 1, pp. 29-39, 2001
  5. H. Jeong, "A comparative study of scores on computer-based tests and paper-based tests," Behaviour & Information Technology, vol. 22, no. 4, pp. 410-422, 2014
  6. L. Wan and G. A. Henley, "Measurement Properties of Two Innovative Item Formats in a Computer-Based Test," Applied Measurement in Education, vol. 25, no. 1, pp. 58-78, 2012
  7. D. Bengs, U. Brefeld and U. Kröhne, "Adaptive Item Selection Under Matroid Constraints," Journal of Computerized Adaptive Testing, vol. 6, no. 2, pp. 15-36, 2018
  8. A. Huebner, M. D. Finkelman and A. Weissman, "Factors Affecting the Classification Accuracy and Average Length of a Variable-Length Cognitive Diagnostic Computerized Test," Journal of Computerized Adaptive Testing, vol. 6, no. 1, pp. 1-14, 2018
  9. N. v. Buuren and T. H. J. M. Eggen, "Latent-Class-Based Item Selection for Computerized Adaptive Progress Test," Journal of Computerized Adaptive Testing, vol. 5, no. 2, pp. 22-43, 2017
  10. B. G. Brossman and R. A. Guille, "A Comparison of Multi-Stage and Linear Test Designs for Medium-Size Licensure and Certification Examinations," Journal of Computerized Adaptive Testing, vol. 2, no. 2, pp. 18-36, 2014
  11. D. I. Belov, "Detecting Item Preknowledge in Computerized Adaptive Testing Using Information Theory and Combinatorial Optimization," Journal of Computerized Adaptive Testing, vol. 2, no. 3, pp. 37-58, 2014
  12. D. I. Belov, "Uniform Test Assembly: Concepts, Problems, Solvers, and Applications for Adaptive Testing," Journal of Computerized Adaptive Testing, vol. 5, no. 1, pp. 1-21, 2017
  13. S. Boonsathorn, "Computer-based test of English competence (CB TEC) for EFL advanced learners: A new format of C-Test," in 15th International Conference on Information Technology Based Higher Education and Training (ITHET), Istanbul, Turkey, 2016
  14. Y. A. A. Hakami, A. R. B. C. Hussin and H. M. Dahlan, "Technology Acceptance for CBT in Secondary Schools of Saudi Arabia," in 5th International Conference on Intelligent Systems, Modelling and Simulation, Langkawi, Malaysia, 2014
  15. A. Jamaluddin, D. Harjunowibowo, M. A. Rochim, F. Mahadmadi, H. B. Kakanita and P. W. Laksono, "Implementation of RFID on Computer Based Test (RF-CBT) system," in Proceedings of the Joint International Conference on Electric Vehicular Technology and Industrial, Mechanical, Electrical and Chemical Engineering (ICEVT & IMECE), Surakarta, Indonesia, 2015
  16. M. S. B. A. Malek, M. A. B. Ahmadon, S. Yamaguchi and B. B. Gupta, "Implementation of parallel model checking for computer-based test security design," in 7th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan, 2016

Last update:

No citation recorded.

Last update: 2024-12-24 11:02:42

No citation recorded.