Sains Malaysiana 41(9)(2012): 1171–1176

 

 

Reliability Analisis of Examination Questions in a Mathematics Course Using

Rasch Measurement Model

(Analisis Keupayaan Soalan Peperiksaan Kursus Matematik Menggunakan

Model Pengukuran Rasch)

Zulkifli Mohd Nopiah*, Mohd Helmi Jamalluddin, Nur Arzilah Ismail Haliza Othman,  Izamarlina Asshaari & Mohd Hanif Osman

Centre for Engineering Education Research & Unit of Fundamental Engineering Studies, Universiti Kebangsaan Malaysia, 43600 UKM Bangi, Selangor, Malaysia

 

Received: 25 May 2011 / Accepted: 21 May 2012

 

ABSTRACT

Students’ performance cannot be based solely on their ability to answer questions. The accuracy of the exam questions must also be considered when measuring the outcome of the course. The objective of this paper was to study the reliability of a question and its impact on students’ performance. A well-constructed question should be commensurate with the level of the intended knowledge. In this study, results from a linear algebra examination were analysed using the Rasch Model. The Rasch Model was used to analyse the reliability, non-redundancy and suitability of exam questions. The results showed that, in this particular case, the linear algebra questions were correctly constructed without any redundancy and suitable for the intended students.

 

Keywords: Bloom’s taxonomy; item redundant; misfit item; person-item distribution; Rasch model

 

ABSTRAK

Prestasi pelajar tidak hanya bergantung kepada keupayaan pelajar menjawab soalan peperiksaan. Prestasi pelajar juga bergantung kepada kesesuaian soalan peperiksaan dalam mengukur hasil kursus pembelajaran. Oleh yang demikian, objektif kertas kerja ini ialah untuk mengenal pasti keupayaan soalan dan impaknya kepada prestasi pelajar. Soalan yang baik seharusnya merangkumi aspek tahap pengetahuan yang dikehendaki. Di dalam kajian ini, keputusan peperiksaan algebra linear dianalisis menggunakan Model Rasch. Model Rasch digunakan untuk mengkaji keupayaan, pertindihan dan kesesuaian soalan. Bagi kajian ini, hasil keputusan menunjukkan soalan algebra linear yang digunakan adalah bersesuaian tanpa menghasilkan pertindihan soalan dan memenuhi objektif pengajaran kursus tersebut.

 

Kata kunci: Item berulang; item ketidakpadanan; model Rasch; taburan person-item; taksonomi bloom

REFERENCES

Azrilah, A.A., Azlinah, M., Noor Habibah, A., Hamzah, A. G., Sohaimi, Z. & Saidfudin, M. 2008. Application of Rasch Model in Validating the Construct of Measurement Instrument. International Journal of Education and Information Technologies 2: 105-112.

Azrilah, A.A., Azlinah, M., Azami, Z., Sohaimi, Z., Hamzah, A.G. & Saidfudin, M. 2008. Evaluation of Information Professional Competency Face Validity Test Using Rasch Model. 5th WSEAS/IASME International Conference on Engineering Education (EE’08), Heraklion, Greece: 396-403.

Azrilah, A.A., Azlinah, M., Noor Habibah, A., Sohaimi, Z. & Saidfudin, M. 2007. Appraisal of Course Learning Outcomes using Rasch Measurement: A Case Study in Information Technology Education. International Journal of System Applications, Engineering & Development 1: 164-172.

Draugalis, J.R. & Jackson, T.R. 2004. Objective Curricular Evaluation: Applying the Rasch Model to a Cumulative Examination. American Journal of Pharmaceutical Education 68 (2): 1-12. http://archive.ajpe.org/aj6802/aj680235/aj680235.pdf. [12 November 2011].

Felder, R.M. & Rebecca, B. 2004. The ABC’s of Engineering Education: ABET, Bloom’s Taxonomy, Cooperative Learning, and so on. Proceedings of the 2004 American Society for Engineering Education Annual Conference & Exposition. http://www4.ncsu.edu/unity/lockers/users/f/felder/public/Papers/ASEE04(ABCs).pdf. [12 November 2011].

Killen, R. 2000. Outcomes-Based education: Principles and Possibilities. Unpublished manuscript, University of Newcastle, Faculty of Education. http://drjj.uitm.edu.my/DRJJ/CONFERENCE/UPSI/OBEKillen.pdf. [12 November 2011].

Sun, Y. & Chen, W. 2009. The Relationship Between Teaching Comprehensibility and Instructional Time Vs Students’ Achievement in Rational Numbers. The Journal of Human Resource and Adult Learning 5(2): 99-107.

Zulkifli, M.N., Mohd Haniff, O., Noorhelyna, R., Fadiah Hirza, M.A. & Izamarlina, A. 2010. How good was the test set up? From Rasch Analysis Perspective. Regional Conference on Engineering Education & Research in Higher Education (RCEE & RHEd) Kuching, 7-9 June.

 

 

*Corresponding author; email: zmn@eng.ukm.my