The Architectural Creativity Test Development: A Many Facet Rasch Model Analysis to Establish Inter-Rater Reliability
DOI:
https://doi.org/10.12928/jehcp.v7i3.11698Abstract
This main purpose of this study is to validate the structure of creativity test’s internal consistency in the field of architecture. Method of analysis’s done by Many Facet Rasch Model (MFRM) approach using Facet Program. There were 44 High School students of Public, Private, and Vocational School, also 2nd and 8th semester Architecture College students involved as participants. Three person become raters, and assessed the participants, which consist of two academicians (Architecture lecturers) and one professional Architect. Analysis of Facet Program’s indicates the comparison between exact agreements value and expected agreements value is very small. So that it produce a very high reliability coefficient (> 0.8). The result shows that rater’s interpretation is very good that it can provide stable and consistent evaluation. It also indicates the agreement for evaluation’s score given. Rater’s agreement also strengthen the evidence that constructed items are relevant with measuring attributes and represent overall measurable domains.
Keyword : Inter Rater Reliability, Creativity, Architecture
References
Appulembang Y.A., Suyasa, P.T.Y.S. (2014). Pengembangan Alat Ukur Kreativitas Pada Mahasiswa Jurusan Teknik Arsitektur. Jurnal Provitae. 6 (1). 1-18. ISSN : 0216-4485
AERA-APA and NCME. (1999, 2004). Standard for Educational and Psy-chological Testing. ISBN : 0-935302-25-5
Azwar, S. (2012). Tehnik Penyusunan Skala Pengukuran. Yogyakarta: Univer-sitas Gajah Mada.
Buzan, T., & Buzan, B. (2004). The Mind Map Book. Milineum Edition. Batam : Interaksara
Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. Ohio, USA : Cengage Learning. ISBN-13: 978-0-495-39591-1.
Demirkan, H. & Afacan, Y. (2012). Assessing Creativity in Design Education : Analysis of Creativity Factors in the First-Year Design Studio. Design Studies Journal. Vol. 33 (262-278). DOI : 10.1016/j.destud.2011.11.005
Demirkan, H., & Hasirci, D. (2009). Hidden dimensions of creativity elements in design process. Creativity Research Journal. 21 (2-3). 294-301
Drabkin, S. (1996). Enhanching Creativity When Solving Contradictionary Technical Problems. Journal of Professinal Issues in Engineering Education and Practice. 78-82.
Ebel, R. L., & Frisbie, D. A. (1991). Essentials of Educational Measure-ment. Fifth Edition. New Delhi : Prentice Hall of India. ISBN : 087692-700-2
Eguiluz, L.I., Cavia, M.A., Lavandero, J.C. (2003). Creativity Test Applied in Engineering. International Conference on Engineering Education. July 21-25. Valencia, Spain
Fisher, W.P.Jr. (2007). Rating Scale Instrument Quality Criteria. Rasch Measurement Transaction. Vo. 21(1). 1095. Diakses dari http://www.rasch.org/rmt/rmt211m. htm
Fleenor, J.W., Fleenor, J.B., & Grossnickle, W.F. (1996). Interrater Reliability and Agreement of Performance Ratings: A Methodological Comparison. Journal of Business and Psychology. Vol. 10. Issue 3 (367–380).
Guilford, J.P. (1967). The Nature of Human Intelligence. New York : McGraw Hill
Guilford. JP. (1974). Characteristic of Creativity. Springfield, 11: Illinois State Office of the Sperintcndent of Public Instruction, Children Section.
Guilford. J.P. (1975). Creativity : A Quarter Century of Progress. in Taylor, I.A. dan Getzcls, J. W. (cd), Persprctives in Creativity. Chicago: Aldine
Haik, Y. (2003). Engineering Design Process. Pasific Grove. CA : Thomson Learning.
Hair, et al. (2010). Multivariat Data Analysis. Sevent Edition. USA : Prentice Hall
Hasirci, D., & Demirkan, H. (2003). Creativity in learning environments: the case of two sixth grade art-rooms. Journal of Creative Behavior. 37 (1). 17-42.
Hasirci, D., & Demirkan, H. (2007). Understanding the effects of cognition in creative decision-making: a creativity model for enhancing creativity in the design studio process. Creativity Research Journal. 19 (2e3). 259-271
Ibrahim, B. (2012). Exploring the Relationships among Creativity, Engineering Knowledge anda Design Team Interaction on Senior Engineering Design Projects. Disertation. Fulfillment of the Requirements for the Degree of Doctor of Philosophy Colorado State University.
Joseph, E.J. (2009). Effectiveness of Khatena Training Method on the Creativity of Form Four Students in a Selected School. Thesis. Faculty of Education. University of Malaya. Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Education.
Kaplan, R.M., Saccuzzo, D.P. (2012). Pengukuran Psikologi, Prinsip, Penerapan dan Isu. Edisi 7. Jakarta : Penerbit Salemba Humanika
Laurens, J.M dan Tanuwidjaja, G. (2012) Melalui Pendekatan Desain Inklusi Menuju Arsitektur yang Humanis. Seminar Nasional Menuju Arsitektur yang Berempati. 04-05-2012 - 05-05-2012. Diakses dari http://repository.petra.ac.id/id/eprint/ 15803
Laseau, P. (2001). Graphic Thinking for Architects and Designers. Third Edition. Canada : John Willey & Sons, Inc. ISBN : 0-471-35292-6
Mardapi, Dj. (2012). Pengukuran Penilaian dan Evaluasi Pendidikan. Yogyakarta : Nuha Medika.
Marlinda, E.S., Barliana, M.S., Krisnanto, E. (2013). Hubungan Pengalaman Berarsitektur dengan Kreativitas Desain Mahasiswa. Jurnal Invotec. IX (1) Februari. 1-16
Mednick, S.A. (1962). The Associative Basis of The Creative Process. Psychological Review. 69. 201-232.
Mednick, M.T. and Andreas, F.M. (1967). Creative Thinking and Level Intelligence. Journal Creative Behavior. 1 (4). 428-431.
Musta’ama, AH., Norman, E., Jabor, MK., dan Buntat, Y. (2012). Does CAD Really Encourage Creative Behaviors among its Users : A Case Study. International Conference on Teaching and Learning in Higher
Education (ICTLHE 2012) in conjucyion with RCEE & RHED 2012. Procedia - Social and Behavioral Sciences. 56 (602-608). Diunduh dari http://www.sciencedirect.com, 2 February 2014
Sumintono, B. (2014). Model Rasch untuk Penelitian Sosial Kuantitatif. Conference Paper. Diakses dari : https://www.researchgate.net/publication/268688670_ Model_Rasch_untuk_Penelitian_Sosial_Kuantitatif, 12 Januari 2018
Sumintono, B., Widhiarso, W. (2014). Aplikasi Model RASCH untuk Penelitian Ilmu-Ilmu Sosial. Edisi Revisi. Cimahi : Trim Komunikata Publishing House
Widhiarso, W. (2010). Melibatkan Rater dalam Pengembangan Alat Ukur. Fakultas Psikologi Universitas Gadjah Mada, diakses dari : http://widhiarso.staff. ugm.ac.id/files/Melibatkan%20Rater%20dalam%20Pengembangan%20Alat%20Ukur.pdf , tanggal 22 Juni 2017
Yamin, S. (2014). Rahasia Olah Data Lisrel. Seri Buku Statistik : Structural Equation Modeling untuk Pemula. Jakarta : Mitra Wacana Media
