Psychometric properties of the SE-Revised: A rasch model analysis
DOI:
https://doi.org/10.26555/humanitas.v16i1.10919Keywords:
Intelligenz Struktur Test (IST), Satz Ergaenzung (SE), rasch modelAbstract
Satz Ergaenzung (SE) is the first subtest in the Intelligenz Struktur Test (IST) that measures reasoning ability. Previous studies found that SE has suboptimum performance in measuring subject's ability. Therefore, this study intended to revise the SE items that were found to have poor psychometric properties, either by changing the questions and answer choices, the answer choices only, or changing the order of the questions. This study used the rasch model to determine the psychometric property of SE-revised. A total of 159 undergraduate students of a university in Riau participated in this study. The results showed that the revised SE had fulfilled the pre-requisites of unidimensionality. The instrument reliability increased after being revised, where the items of SE-revised correctly measure respondents' abilities. The revised version may be used as an improvement of the original SE, with better psychometric properties. However, there were four items with low difficulty index and two items that have DIF. Even though SE-revised is better than the original SE, further research is needed to revise the six items of SE-revised subtest.
References
Adinugroho, I. (2016). Pengujian properti psikometrik Intelligenz Struktur Test subtes kemampuan spasial dua dimensi (form AUSWAHL): Studi pada dua SMA swasta di Jakarta (Psychometric properties of Intelligenz Structure Test two dimensions spatial ability subtest (form AUSWAHL): Study in two senior high schools in Jakarta). Jurnal Ilmiah Psikologi MANASA, 5(2), 165-180.
Agung, I. M., & Fitri, A. R. (2016). Analisis Psikometri dan Standardisasi Norma pada Tes Inteligensi Struktur Test (IST) pada Mahasiswa UIN Sultan Syarif Kasim Riau (Psychometric analysis and norm standardization on Intelligent Structure Test (IST) aming UIN Sultan Syarif Kasim undergraduate students). Research report. Pekanbaru: LP2M UIN Suska Riau.
Aiken, L. R., & Marnat, G. G. (2008). Pengetesan dan pemeriksaan psikologi (Psychological testing and assessment). (B. Sarwiji, Ed.) (12th ed.). Jakarta: Indeks.
Anastasi, A., Urbina, S. (2007). Tes psikologi (Psychological testing). (R. H. S. Imam, Ed.) (7th ed.). Jakarta: Indeks.
Ariffin, S. R., Omar, B., Isa, A., & Sharif, S. (2010). Validity and reliability Multiple Intelligent item using Rasch measurement model. Procedia - Social and Behavioral Sciences, 9, 729-733. https://doi.org/10.1016/j.sbspro.2010.12.225
Azwar, S. (2009). Reliabilitas dan validitas (Reliability and validity). Yogyakarta: Pustaka Pelajar.
Azwar, S. (2014). Dasar-dasar psikometri (Basic psychometry). Yogyakarta: Pustaka Pelajar.
Azwar, S. (2016). Konstruksi tes kemampuan kognitif (Construction of cognitive ability test). Yogyakarta: Pustaka Pelajar.
Bawono, B. A. (2008). Uji Aspek-Aspek Psikometrik Subtes Merkaufgaben dari Baterai Intelligenz Struktur Test (Psychometric analysis of Intelligent Structure Test Merkaufgaben Subtest). (Master Thesis), Universitas Katolik Atma Jaya, Jakarta.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model:Fundamental Measurement in the Human Sciences. International Journal of Testing. https://doi.org/10.1207/S15327574IJT013&4_10
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. London: Springer. https://doi.org/10.1007/978-94-007-6857-4
Curtis, D., & Boman, P. (2007). X-ray your data with rasch. International Education Journal, 8(2), 249-259. https://doi.org/10.1080/00986440902900295
Elvira, R. (2011). Karakteristik Psikometri Subtes Santzerganzung (SE) Pada Intelligenz Struktur Test (IST) (Psychometric characteristics of Intelligenz Structure Test (IST)). (Undergraduate Thesis), Universitas Sumatera Utara, Medan.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for Psychologists multivariate applications book series. New Jersey: Lawrence Erlbaum Associates, Inc. https://doi.org/10.1016/j.ica.2011.03.035
Fan, X. (1998). Item response theory and classical test theory: An empirical comparison of their item/person statistics. Educational and Psychological Measurement, 58(3), 357-374.
Hagell, P. (2014). Testing rating scale unidimensionality using the principal component analysis (PCA)/t-test protocol with the rasch model: The primacy of theory over statistics. Open Journal of Statistics, 4(6), 456-465. https://doi.org/10.4236/ojs.2014.46044
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory principles and applications. (G. F. Madaus & D. L. Stufflebeam, Eds.) (1st ed.). New York: Springer Science+Business Media, LLC. https://doi.org/10.1007/978-94-017-1988-9
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1992). Fundamentals of item response theory. Contemporary Sociology (Vol. 21). Contemporary Sociology (Vol. 21). London: Sage Publications. https://doi.org/10.2307/2075521
Hamidah. (2001). Uji Validitas dan Reliabilitas Item Tes IST (Intelligenz Structure Test) (Validity and reliability of IST). Research Report. Surabaya: Universitas Airlangga.
Ireland, M. J., Goh, H. E., & Ida, M. (2018). A rasch model analysis of the emotion regulation questionnaire. Journal of Applied Measurement, 19(3), 258-270.
Ishak, A. H., Osman, M. R., Mahaiyadin, M. H., Tumiran, M. A., & Anas, N. (2018). Examining unidimensionality of psychometric properties via rasch model. International Journal of Civil Engineering and Technology (IJCIET), 9(9), 1462-1467.
Kipman, U., Kohlböck, G., & Weilguny, W. (2012). Psychologische testverfahrenzur messung intellektueller begabung. (C. Rech & A. Fritz, Eds.). Salzburg: Österreichisches Zentrum für Begabtenförderung und Begabungsforschung (ÖZBF).
Kubinger, K. D., Rasch, D., & Yanagida, T. (2011). A New Approach for Testing the Rasch Model. Educational Reserach and Evaluation, 17(5), 321-333. https://doi.org/10.1080/13803611.2011.630529
Magno, C. (2009). Demonstrating the difference between classical test theory and item response theory using derived test data. The International Journal of Educational and Psychological Assessment, 1(1), 1-11.
Maseko, J. (2008). Applying the rasch model to validate a test instrument of students' rational number cognition. Mpumalanga: Paper presented in the 9th Annual Unisa Iste Conference On Mathematics, Science And Technology Education.
Murphy, K. R., & Davidshofer, C. O. (2003). Psychological testing: Principles and application. New Jersey: Prentice-Hall, Inc.
Nur'aeni. (2012). Tes psikologi: Tes inteligensi dan tes bakat (Psychological test: Intelligence and aptitude test). (T. Trianton, Ed.). Yogyakarta: Universitas Muhammadiyah (UM) Purwokerto Press.
Osman, S. A., Naam, S. I. N., Jaafar, O., Badaruzzaman, W. H. W., & Rahmat, R. A. A. O. K. (2012). Application of Rasch Model in Measuring Students' Performance in Civil Engineering Design II Course. Procedia - Social and Behavioral Sciences, 56(Ictlhe), 59-66. https://doi.org/10.1016/j.sbspro.2012.09.632
Pallant, J. F., & Tennant, A. (2007). An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology, 46(1), 1-18. https://doi.org/10.1348/014466506X96931
Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using Classical Test Theory, Item Response Theory, and Rasch Measurement Theory to Evaluate Patient-Reported Outcome Measures: A Comparison of Worked Examples. Value in Health, 18(1), 25-34. https://doi.org/10.1016/j.jval.2014.10.005
Prieto, L., Alonso, J., & Lamarca, R. (2003). Classical Test Theory Versus Rasch Analysis for Quality of Life Questionnaire Reduction. Health and Quality of Life Outcomes, 1(27), 1-13.
Princen. (2011). Karakteristik Psikometri Subtes Zahlenreihen (ZR) pada Intelligenz Struktur Test (IST) (Psychometric characteristics of the Intelligenz Structure Test Zehlenreihen Subtest). (Undergraduate Thesis), Universitas Sumatera Utara, Medan.
Rahmawati, E. (2014). Evaluasi karakteristik psikometri intelligenz struktur test (IST) Psychometric characteristics evaluation of the Intelligenz Structure Test). Surakarta: Paper presented in the Seminar Nasional Psikometri (National psychometric conference).
Rashid, R. A., Abdullah, R., Ghulman, H. A., & Masodi, M. S. (2008). Application of rasch-based ESPEGS model in measuring generic skills of engineering students' : A new paradigm. Engineering Education, 5(8), 591-602. https://doi.org/10.1016/j.jclinepi.2012.08.003
Sumintono, B., & Widhiarso, W. (2014). Aplikasi model rasch untuk penelitian ilmu-ilmu sosial (Application of rasch model in social sciences research). Cimahi: Trim Komunikata.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan (Rasch model application in educational assessment). Cimahi: Trim Komunikata.
Suryani, Y. E. (2018). Aplikasi rasch model dalam mengevaluasi Intelligenz Structure Test (IST). Psikohumaniora: Jurnal Penelitian Psikologi, 3(1), 73-100. https://doi.org/10.21580/pjpp.v3i1.2052
Wahyuni, S., Widyastuti, A., & Fitriyani, E. (2015). Metode pengukuran bakat dan inteligensi (Method of measuring aptitude and intelligence). Pekanbaru: Al-Mujtahadah Press.
Wibisono, S. (2016). Aplikasi model rasch untuk validasi instrumen pengukuran fundamentalisme agama bagi responden muslim (Rasch model applicaton for validating a measurement on religious fundamentalism among Muslims). Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, V(1), 1-29.
Widianti, P. (2008). Pengujian aspek-aspek psikometris subtes Satzergänzung (SE) dari Baterai Tes Intelligenz-Struktur-Test (IST) (Psychometric aspects of Intelligenz Structure Test Satzergänzung (SE) subtest). (Master Thesis), Universitas Katolik Indonesia Atma Jaya, Jakarta.
Wiratna, A. (1993). Intelligenz Struktur Tes (Intelligenz Structure Test). Surabaya: P.T. Locita Mandayaguna.
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
This work is licensed under a Creative Commons Attribution-ShareAlike 2.0 Generic License.
