Rasch Model Study on Mathematics Examination Test Using Item Response Theory Approach

Authors

  • Vegi Intan Futri Universitas Negeri Yogyakarta
  • Raden Rosnawati Universitas Negeri Yogyakarta
  • Abdul Rahim Universitas Negeri Yogyakarta http://orcid.org/0000-0002-6425-3600
  • Marlina Marlina Universitas Negeri Yogyakarta

DOI:

https://doi.org/10.12928/ijeme.v6i1.21761

Keywords:

Final Exam Test, Item Response Theory, Rasch Model

Abstract

This study was conducted to analyze the test instrument used to measure the ability of students in the odd final exam in mathematics. Sampling using purposive sampling technique. These students consist of 398 students. The questions given are in the form of multiple-choice questions with a total of 40 items. The data analysis technique used quantitative descriptive analysis. Data analysis was carried out using the Item Response Theory (IRT) Rasch model approach with the help of QUEST software. The results of the analysis show, from 40 items there are 39 items fit with the Rasch model. Judging from the level of difficulty, items with very difficult categories are 0%, difficult categories are 8 items or 21%, moderate item categories are 23 items or 59%, easy categories are 8 items or 21%, and very easy categories are 0 %. The reliability of the estimatedvalue of the item is 0.95 with a very good category so that it affects the items that fit the model. Thehigher reliability, the more items that fit the model. The reliability of the case estimate value is 0.00with a weak category. This value indicates an inconsistency in the answers of the test takers, whichmeans that the test takers are careless in answering the questions, thus affecting the reliability ofthe questions.

Author Biographies

Vegi Intan Futri, Universitas Negeri Yogyakarta

Penelitian dan Evaluasi Pendidikan

Raden Rosnawati, Universitas Negeri Yogyakarta

Penelitian dan Evaluasi Pendidikan

Abdul Rahim, Universitas Negeri Yogyakarta

Penelitian dan Evaluasi Pendidikan

Marlina Marlina, Universitas Negeri Yogyakarta

Penelitian dan Evaluasi Pendidikan

References

Abdullah, H., Arsad, N., Hashim, F. H., Aziz, N. A., Amin, N., & Ali, S. H. (2012). Evaluation of Students’ Achievement in the Final Exam Questions for Microelectronic (KKKL3054) using the Rasch Model. Procedia Social and Behavioral Sciences, 60(c), 119–123. https://doi.org/10.1016/j.sbspro.2012.09.356

Alkharusi, H. (2015). An evaluation of the measurement of perceived classroom assessment environment. International Journal of Instruction, 8(2), 45–54. https://doi.org/10.12973/iji.2015.824a

Anwar, M. S., Choirudin, C., Ningsih, E. F., Dewi, T., & Maseleno, A. (2019). Developing an Interactive Mathematics Multimedia Learning Based on Ispring Presenter in Increasing Students Interest in Learning Mathematics. Al-Jabar: Jurnal Pendidikan Matematika, 10(1), 135–150. https://doi.org/10.24042/ajpm.v10i1.4445

Ardiyanti, D. (2016). Aplikasi Model Rasch pada Pengembangan Skala Efikasi Diri dalam Pengambilan Keputusan Karir Siswa. Jurnal Psikologi, 43(3), 248–263.

Aricak, O. T., Avcu, A., Topcu, F., & Tutlu, M. G. (2020). Use of Item Response Theory to Validate Cyberbullying Sensibility Scale for University Students. International Journal of Assessment Tools in Education, 7(1), 18–29. https://doi.org/10.21449/ijate.629584

Camminatiello, I., Gallo, M., & Menini, T. (2010). The Rasch Model for Evaluating Italian Student Performance. Journal of Applied Quantitative Methods, 5(2), 331–349.

Clark, I. (2012). Formative Assessment: Assessment Is for Self-regulated Learning. JSTOR, 24(2), 205–249. https://doi.org/10.1007/S10648-01

Djemari, M. (2012). Pengukran Penilaian dan Evaluasi Pendidikan. Nuha Medika.

Fitriani, L., Ramalis, T. R., & Efendi, R. (2019). Karakterisasi Tes Keterampilan Proses Sains Materi Fluida Statis Berdasarkan Teori Respon Butir. Omega: Jurnal Fisika dan Pendidikan Fisika, 5(2), 27. https://doi.org/10.31758/omegajphysphyseduc.v5i2.27

Gipps, C., Hargreaves, E., & McCallum, B. (2015). What makes a good primary school teacher? Expert classroom strategies. Routledge.

Griffrin, P., & McGaw, B. (2014). Assesment and Teaching of 21st Century Skills. In Assessment and teaching of 21st century skills. https://doi.org/10.1007/978-94-007-2324-5_2

Hayati, S., & Lailatussaadah, L. (2016). Validitas Dan Reliabilitas Instrumen Pengetahuan Pembelajaran Aktif, Kreatif Dan Menyenangkan (Pakem) Menggunakan Model Rasch. Jurnal Ilmiah Didaktika, 16(2), 169. https://doi.org/10.22373/jid.v16i2.593

Imaroh, N., Susongko, P., & Isnani. (2017). Uji Validitas Tes Ulangan Akhir Semester Gasal Mata Pelajaran Matematika. E-Journal UPS, 1(1), 80–89.

Kadir, A. (2015). Menyusun dan Menganalisis Tes Hasil Belajar. Al-Ta’dib, 8(2), 70–81.

Kartianom, K., & Ndayizeye, O. (2017). What ‘s wrong with the Asian and African Students’ mathematics learning achievement? The multilevel PISA 2015 data analysis for Indonesia, Japan, and Algeria. Jurnal Riset Pendidikan Matematika, 4(2), 200. https://doi.org/10.21831/jrpm.v4i2.16931

Kartianom, & Mardapi, D. (2017). The utilization of junior high school mathematics national examination data: A conceptual error diagnosis. REiD (Research and Evaluation in Education), 3(2), 163–173. https://doi.org/10.1044/2018_AJSLP-17-0074

Marjiastuti, K., & Wahyuni, S. (2014). Analisis kemampuan peserta didik dengan model Rasch. In Seminar Nasional Evaluasi Pendidikan II.

Naqiyah, M., Rosana, D., Sukardiyono, & Ernasari. (2020). Developing Instruments to Measure Physics Problem Solving Ability and Nationalism of High School Student. 13(4), 921–936.

OECD. (2005). Formative Assessment: Improving Learning in Secondary Classrooms. 29(November), 282. http://new.sourceoecd.org/9264007393

Pey Tee, O., & Subramaniam, R. (2018). Comparative study of middle school students’ attitudes towards science: Rasch analysis of entire TIMSS 2011 attitudinal data for England, Singapore and the U.S.A. as well as psychometric properties of attitudes scale. International Journal of Science Education, 40(3), 268–290. https://doi.org/10.1080/09500693.2017.1413717

Pratama, D. (2020). Analisis Kualitas Tes Buatan Guru Melalui Pendekatan Item Response Theory (IRT) Model Rasch. Tarbawy: Jurnal Pendidikan Islam, 7(1), 61–70. https://doi.org/10.32923/tarbawy.v7i1.1187

Primi, C., Morsanyi, K., Chiesi, F., Donati, M. A., & Hamilton, J. (2016). The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT). Journal of Behavioral Decision Making, 29(5), 453–469. https://doi.org/10.1002/bdm.1883

Purwanto. (2009). Evaluasi Hasil Belajar. Pustaka Pelajar.

Rahayuningsih, S., & Jayanti, R. (2019). High Order Thinking Skills (HOTS) Students In Solving Group Problem Based Gender. Al-Jabar: Jurnal Pendidikan Matematika, 10(2), 243–250. https://doi.org/10.24042/ajpm.v10i2.4872

Retnawati, H. (2014). Teori respons butir dan penerapannya: Untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana. Nuha Mediak.

Retnawati, H., & Hadi, S. (2014). Sistem bank soal daerah terkalibrasi untuk menyongsong era desentralisasi. Jurnal Ilmu Pendidikan, 20(2), 183–193.

Retnawati, H., Hadi, S., & Nugraha, A. C. (2016). Vocational high school teachers’ difficulties in implementing the assessment in curriculum 2013 in Yogyakarta Province of Indonesia. International Journal of Instruction, 9(1), 33–48. https://doi.org/10.12973/iji.2016.914a

Rindermann, H., & Baumeister, A. E. E. (2015). Validating the Interpretations of PISA and TIMSS Tasks: A Rating Study. International Journal of Testing, 15(1), 1–22. https://doi.org/10.1080/15305058.2014.966911

Safihin, M. (2019). Pengembangan Tes Menggunakan Model Rasch Materi Gaya Untuk SMA. Jurnal Pendidikan dan Pembelajaran, 8(6), 1–11. http://jurnal.untan.ac.id/index.php/jpdpb/article/view/33424/75676581548

Santoso, A., Kartianom, K., & Kassymova, G. K. (2019). Kualitas butir bank soal statistika (Studi kasus: Instrumen ujian akhir mata kuliah statistika Universitas Terbuka). Jurnal Riset Pendidikan Matematika, 6(2), 165–176. https://doi.org/10.21831/jrpm.v6i2.28900

Shute, V. J., & Becker, B. J. (2010). Innovative Assessment for the 21st Century. Innovative Assessment for the 21st Century. https://doi.org/10.1007/978-1-4419-6530-1

Siti Aminah, N. (2013). Jurnal Materi dan Pembelajaran Fisika (JMPF). Jurnal Materi dan Pembelajaran Fisika (JMPF), 3(2), 33–39.

Sumintono, B. (2014). Model Rasch untuk Penelitian Sosial Kuantitatif. Institut Teknologi Sepuluh November (Nomor November 201). http://deceng3.wordpress.com

Susanto, H., Rinaldi, A., & Novalia. (2015). Analisis Validitas Reabilitas Tingkat Kesukaran dan Daya Beda pada Butir Soal Ujian Akhir Semester Ganjil Mata Pelajaran Matematika. Al-Jabar: Jurnal Pendidikan Matematika, 6(2), 203–217. https://doi.org/10.18907/jjsre.37.3_343_4

Susdelina, Perdana, S. A., & Febrian. (2018). Analisis Kualitas Instrumen Pengukuran Pemahaman Konsep Persamaan Kuadrat Melalui Teori Tes Klasik Dan Rasch Model. Jurnal Kiprah, 6(1), 41–48. https://doi.org/10.31629/kiprah.v6i1.574

Tri Wahyuningsih, E. (2015). Analisis Butir Soal Tes Objektif Buatan Guru Ulangan Semester Ganjil Mata Pelajaran Ekonomi Kelas X di Sma Negeri 1 Mlati Tahun Ajaran 2013/2014. Universitas Negeri Yogyakarta.

Wafubwa, R. N., & Csíkos, C. (2020). Formative Assessment as a Predictor of Mathematics Teachers’ Levels of Metacognitive Regulation. International Journal of Instruction, 14(1), 983–998. https://doi.org/10.29333/IJI.2021.14158A

Downloads

Published

2022-10-31

How to Cite

Futri, V. I., Rosnawati, R., Rahim, A., & Marlina, M. (2022). Rasch Model Study on Mathematics Examination Test Using Item Response Theory Approach. International Journal on Emerging Mathematics Education, 6(1), 29–40. https://doi.org/10.12928/ijeme.v6i1.21761

Issue

Section

Articles