Psychometric properties of the SE-Revised: A rasch model analysis

Siti Juniawati Rosa, Ahyani Radhiani Fitri, Ivan Muhammad Agung

Abstract



Satz Ergaenzung (SE) is the first subtest in the Intelligenz Struktur Test (IST) that measures reasoning ability. Previous studies found that SE has suboptimum performance in measuring subject's ability. Therefore, this study intended to revise the SE items that were found to have poor psychometric properties, either by changing the questions and answer choices, the answer choices only, or changing the order of the questions. This study used the rasch model to determine the psychometric property of SE-revised. A total of 159 undergraduate students of a university in Riau participated in this study. The results showed that the revised SE had fulfilled the pre-requisites of unidimensionality. The instrument reliability increased after being revised, where the items of SE-revised correctly measure respondents' abilities. The revised version may be used as an improvement of the original SE, with better psychometric properties. However, there were four items with low difficulty index and two items that have DIF. Even though SE-revised is better than the original SE, further research is needed to revise the six items of SE-revised subtest.


Keywords


Intelligenz Struktur Test (IST), Satz Ergaenzung (SE), rasch model

Full Text:

PDF

References


Adinugroho, I. (2016). Pengujian properti psikometrik Intelligenz Struktur Test subtes kemampuan spasial dua dimensi (form AUSWAHL): Studi pada dua SMA swasta di Jakarta (Psychometric properties of Intelligenz Structure Test two dimensions spatial ability subtest (form AUSWAHL): Study in two senior high schools in Jakarta). Jurnal Ilmiah Psikologi MANASA, 5(2), 165-180.

Agung, I. M., & Fitri, A. R. (2016). Analisis Psikometri dan Standardisasi Norma pada Tes Inteligensi Struktur Test (IST) pada Mahasiswa UIN Sultan Syarif Kasim Riau (Psychometric analysis and norm standardization on Intelligent Structure Test (IST) aming UIN Sultan Syarif Kasim undergraduate students). Research report. Pekanbaru: LP2M UIN Suska Riau.

Aiken, L. R., & Marnat, G. G. (2008). Pengetesan dan pemeriksaan psikologi (Psychological testing and assessment). (B. Sarwiji, Ed.) (12th ed.). Jakarta: Indeks.

Anastasi, A., Urbina, S. (2007). Tes psikologi (Psychological testing). (R. H. S. Imam, Ed.) (7th ed.). Jakarta: Indeks.

Ariffin, S. R., Omar, B., Isa, A., & Sharif, S. (2010). Validity and reliability Multiple Intelligent item using Rasch measurement model. Procedia - Social and Behavioral Sciences, 9, 729-733. https://doi.org/10.1016/j.sbspro.2010.12.225

Azwar, S. (2009). Reliabilitas dan validitas (Reliability and validity). Yogyakarta: Pustaka Pelajar.

Azwar, S. (2014). Dasar-dasar psikometri (Basic psychometry). Yogyakarta: Pustaka Pelajar.

Azwar, S. (2016). Konstruksi tes kemampuan kognitif (Construction of cognitive ability test). Yogyakarta: Pustaka Pelajar.

Bawono, B. A. (2008). Uji Aspek-Aspek Psikometrik Subtes Merkaufgaben dari Baterai Intelligenz Struktur Test (Psychometric analysis of Intelligent Structure Test Merkaufgaben Subtest). (Master Thesis), Universitas Katolik Atma Jaya, Jakarta.

Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model:Fundamental Measurement in the Human Sciences. International Journal of Testing. https://doi.org/10.1207/S15327574IJT013&4_10

Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. London: Springer. https://doi.org/10.1007/978-94-007-6857-4

Curtis, D., & Boman, P. (2007). X-ray your data with rasch. International Education Journal, 8(2), 249-259. https://doi.org/10.1080/00986440902900295

Elvira, R. (2011). Karakteristik Psikometri Subtes Santzerganzung (SE) Pada Intelligenz Struktur Test (IST) (Psychometric characteristics of Intelligenz Structure Test (IST)). (Undergraduate Thesis), Universitas Sumatera Utara, Medan.

Embretson, S. E., & Reise, S. P. (2000). Item response theory for Psychologists multivariate applications book series. New Jersey: Lawrence Erlbaum Associates, Inc. https://doi.org/10.1016/j.ica.2011.03.035

Fan, X. (1998). Item response theory and classical test theory: An empirical comparison of their item/person statistics. Educational and Psychological Measurement, 58(3), 357-374.

Hagell, P. (2014). Testing rating scale unidimensionality using the principal component analysis (PCA)/t-test protocol with the rasch model: The primacy of theory over statistics. Open Journal of Statistics, 4(6), 456-465. https://doi.org/10.4236/ojs.2014.46044

Hambleton, R. K., & Swaminathan, H. (1985). Item response theory principles and applications. (G. F. Madaus & D. L. Stufflebeam, Eds.) (1st ed.). New York: Springer Science+Business Media, LLC. https://doi.org/10.1007/978-94-017-1988-9

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1992). Fundamentals of item response theory. Contemporary Sociology (Vol. 21). Contemporary Sociology (Vol. 21). London: Sage Publications. https://doi.org/10.2307/2075521

Hamidah. (2001). Uji Validitas dan Reliabilitas Item Tes IST (Intelligenz Structure Test) (Validity and reliability of IST). Research Report. Surabaya: Universitas Airlangga.

Ireland, M. J., Goh, H. E., & Ida, M. (2018). A rasch model analysis of the emotion regulation questionnaire. Journal of Applied Measurement, 19(3), 258-270.

Ishak, A. H., Osman, M. R., Mahaiyadin, M. H., Tumiran, M. A., & Anas, N. (2018). Examining unidimensionality of psychometric properties via rasch model. International Journal of Civil Engineering and Technology (IJCIET), 9(9), 1462-1467.

Kipman, U., Kohlböck, G., & Weilguny, W. (2012). Psychologische testverfahrenzur messung intellektueller begabung. (C. Rech & A. Fritz, Eds.). Salzburg: Österreichisches Zentrum für Begabtenförderung und Begabungsforschung (ÖZBF).

Kubinger, K. D., Rasch, D., & Yanagida, T. (2011). A New Approach for Testing the Rasch Model. Educational Reserach and Evaluation, 17(5), 321-333. https://doi.org/10.1080/13803611.2011.630529

Magno, C. (2009). Demonstrating the difference between classical test theory and item response theory using derived test data. The International Journal of Educational and Psychological Assessment, 1(1), 1-11.

Maseko, J. (2008). Applying the rasch model to validate a test instrument of students' rational number cognition. Mpumalanga: Paper presented in the 9th Annual Unisa Iste Conference On Mathematics, Science And Technology Education.

Murphy, K. R., & Davidshofer, C. O. (2003). Psychological testing: Principles and application. New Jersey: Prentice-Hall, Inc.

Nur'aeni. (2012). Tes psikologi: Tes inteligensi dan tes bakat (Psychological test: Intelligence and aptitude test). (T. Trianton, Ed.). Yogyakarta: Universitas Muhammadiyah (UM) Purwokerto Press.

Osman, S. A., Naam, S. I. N., Jaafar, O., Badaruzzaman, W. H. W., & Rahmat, R. A. A. O. K. (2012). Application of Rasch Model in Measuring Students' Performance in Civil Engineering Design II Course. Procedia - Social and Behavioral Sciences, 56(Ictlhe), 59-66. https://doi.org/10.1016/j.sbspro.2012.09.632

Pallant, J. F., & Tennant, A. (2007). An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology, 46(1), 1-18. https://doi.org/10.1348/014466506X96931

Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using Classical Test Theory, Item Response Theory, and Rasch Measurement Theory to Evaluate Patient-Reported Outcome Measures: A Comparison of Worked Examples. Value in Health, 18(1), 25-34. https://doi.org/10.1016/j.jval.2014.10.005

Prieto, L., Alonso, J., & Lamarca, R. (2003). Classical Test Theory Versus Rasch Analysis for Quality of Life Questionnaire Reduction. Health and Quality of Life Outcomes, 1(27), 1-13.

Princen. (2011). Karakteristik Psikometri Subtes Zahlenreihen (ZR) pada Intelligenz Struktur Test (IST) (Psychometric characteristics of the Intelligenz Structure Test Zehlenreihen Subtest). (Undergraduate Thesis), Universitas Sumatera Utara, Medan.

Rahmawati, E. (2014). Evaluasi karakteristik psikometri intelligenz struktur test (IST) Psychometric characteristics evaluation of the Intelligenz Structure Test). Surakarta: Paper presented in the Seminar Nasional Psikometri (National psychometric conference).

Rashid, R. A., Abdullah, R., Ghulman, H. A., & Masodi, M. S. (2008). Application of rasch-based ESPEGS model in measuring generic skills of engineering students' : A new paradigm. Engineering Education, 5(8), 591-602. https://doi.org/10.1016/j.jclinepi.2012.08.003

Sumintono, B., & Widhiarso, W. (2014). Aplikasi model rasch untuk penelitian ilmu-ilmu sosial (Application of rasch model in social sciences research). Cimahi: Trim Komunikata.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan (Rasch model application in educational assessment). Cimahi: Trim Komunikata.

Suryani, Y. E. (2018). Aplikasi rasch model dalam mengevaluasi Intelligenz Structure Test (IST). Psikohumaniora: Jurnal Penelitian Psikologi, 3(1), 73-100. https://doi.org/10.21580/pjpp.v3i1.2052

Wahyuni, S., Widyastuti, A., & Fitriyani, E. (2015). Metode pengukuran bakat dan inteligensi (Method of measuring aptitude and intelligence). Pekanbaru: Al-Mujtahadah Press.

Wibisono, S. (2016). Aplikasi model rasch untuk validasi instrumen pengukuran fundamentalisme agama bagi responden muslim (Rasch model applicaton for validating a measurement on religious fundamentalism among Muslims). Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, V(1), 1-29.

Widianti, P. (2008). Pengujian aspek-aspek psikometris subtes Satzergänzung (SE) dari Baterai Tes Intelligenz-Struktur-Test (IST) (Psychometric aspects of Intelligenz Structure Test Satzergänzung (SE) subtest). (Master Thesis), Universitas Katolik Indonesia Atma Jaya, Jakarta.

Wiratna, A. (1993). Intelligenz Struktur Tes (Intelligenz Structure Test). Surabaya: P.T. Locita Mandayaguna.




DOI: http://dx.doi.org/10.26555/humanitas.v16i1.10919

Refbacks

  • There are currently no refbacks.



HUMANITAS: Indonesian Psychological Journal
ISSN 1693-7236 (print), 2598-6368 (online)
Email : humanitas@psy.uad.ac.id

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

View My Stats
 

View My Stats