The Characteristics of Four-Tier Diagnostic Test: Classical Test Theory Perspective

Authors

DOI:

https://doi.org/10.12928/ijeme.v7i1.22677

Keywords:

diagnostic test, four-tier, CTT

Abstract

This study is part of developing a four-tier online diagnostic test for geometry in junior high schools in Indonesia. After wrote the items and validated by experts, items were tested on 249 students in Yogyakarta, one of the Special Regions in Indonesia.  This study aims to identify the characteristics of a four-tier online diagnostic test, from a classical test theory (CTT) perspective. This test contains 20 items of four-tier multiple choice with four options. The students’ responses were analyzed using Item and Test Analysis (ITEMAN) package. Item difficulty index, discriminant index, and reliability coefficient were three attributes analyzed. The average of item difficulty index is 0.384 (moderate category). The average item discriminant index is 0.513 (good category). The estimation of the reliability coefficient using the Cronbach-Alpha formula is 0.706 (good category).

References

Aliustaoglu, F., Tuna, A., & Biber, A. C. (2018). Misconceptions of sixth grade secondary school students on fractions. International Electronic Journal of Elementary Education, 10(5), 591–599. https://doi.org/10.26822/iejee.2018541308

Anggrayni, S., & Ermawati, F. U. (2019). The validity of Four-Tier’s misconception diagnostic test for Work and Energy concepts. Journal of Physics: Conference Series, 1171(1). https://doi.org/10.1088/1742-6596/1171/1/012037

Aydin, S., Keles, U., & Hasiloglu, A. (2012). Establishment for misconceptions that science teacher candidates have about geometric optics. The Online Journal of New Horizons in Education, 2(3), 7–15.

Caleon, I., & Subramaniam, R. (2010). Development and application of a three-tier diagnostic test to assess secondary students’ understanding of waves. International Journal of Science Education, 32(7), 939–961. https://doi.org/10.1080/09500690902890130

Dhakne-Palwe, S., Gujarathi, A., & Almale, B. (2015). Item Analysis of MCQs and Correlation between Difficulty Index, Discrimination Index and Distractor Efficiency in a Formative Examination in Community Medicine. Journal of Research in Medical Education & Ethics, 5(3), 254–259. https://doi.org/10.5958/2231-6728.2015.00052.9

Diani, R., Alfin, J., Anggraeni, Y. M., Mustari, M., & Fujiani, D. (2019). Four-Tier Diagnostic Test with Certainty of Response Index on the Concepts of Fluid. Journal of Physics: Conference Series, 1155(1). https://doi.org/10.1088/1742-6596/1155/1/012078

Fariyani, Q., Rusilowati, A., & Sugianto, S. (2017). Four-Tier Diagnostic Test To Identify Misconceptions in Geometrical Optics. Unnes Science Education Journal, 6(3), 1724–1729. https://doi.org/10.15294/usej.v6i3.20396

Fernandes, H. J. X. (1984). Testing and Measurement. Jakarta: Planning, Evaluation, and Development.

Flevares, L. M., & Schiff, J. R. (2014). Learning mathematics in two dimensions: A review and look ahead at teaching and learning early childhood mathematics with children’s literature. Frontiers in Psychology, 5(May), 1–13. https://doi.org/10.3389/fpsyg.2014.00459

Gooding, J., & Metz, B. (2011). From Misconceptions to Conceptual Change: Tips for identifying and overcoming students’ misconceptions. The Science Teacher, (April/May), 34–37.

Kula, S., & Güzel, E. B. (2014). Misconceptions emerging in mathematics student teachers’ limit instruction and their reflections. Quality and Quantity, 48(6), 3355–3372. https://doi.org/10.1007/s11135-013-9961-y

Kusmaryono, I., Basir, M. A., & Saputro, B. A. (2020). Ontological Misconception in Mathematics. Infinity, 9(1), 15–30.

Mohyuddin, R. G., & Khalil, U. (2016). Misconceptions of students in learning mathematics at primary level. Bulletin of Education and Research, 38(1), 133–162.

Muijs, R. D., & Reynolds, D. (2005). Effective Teaching. Evidence and Practice. (2nd ed.). Paul Chapman Publishing Ltd.

Musa, A., Shaheen, S., & Elmardi, A. (2018). Item difficulty & item discrimination as quality indicators of physiology MCQ examinations at the Faculty of Medicine Khartoum University. Khartoum Medical Journal, 11(2), 1477–1468.

Ojose, B. (2015). Students’ Misconceptions in Mathematics: Analysis of Remedies and What Research Says. Ohio Journal of School Mathematics, 72(Fall), 30–34.

Özerem, A. (2012). Misconceptions In Geometry And Suggested Solutions For Seventh Grade Students. Procedia - Social and Behavioral Sciences, 55, 720–729. https://doi.org/10.1016/j.sbspro.2012.09.557

Prabowo, A., Anggoro, R. P., Rahmawati, U., & Rokhima, N. (2019). Android-based teaching material for straight-sides solid. Journal of Physics: Conference Series, 1321(3). https://doi.org/10.1088/1742-6596/1321/3/032097

Ravand, H., & Baghaei, P. (2020). Diagnostic Classification Models: Recent Developments, Practical Issues, and Prospects. International Journal of Testing, 20(1), 24–56. https://doi.org/10.1080/15305058.2019.1588278

Retnawati, H., Arlinwibowo, J., & Sulistyaningsih, E. (2017). The Students’ Difficulties in Completing Geometry Items of National Examination. International Journal on New Trends in Education and Their Implications, 8(4), 28–41. Retrieved from https://ci.nii.ac.jp/naid/40021243259/

Reynolds, C. R., Livingston, R. B., & Willson, V. (2010). Measurement and assessment in education (2nd ed.). New Jersey: Pearson Education.

Roselizawati, Sarwadi, & Shahril, M. (2014). Understanding Students’ Mathematical Errors and Misconceptions: The Case of Year 11 Repeating Students. Mathematics Education Trends and Research, 2014(June), 1–10. https://doi.org/10.5899/2014/metr-00051

Shim, G. T. G., Shakawi, A. M. H. A., & Azizan, F. L. (2017). Relationship between Students’ Diagnostic Assessment and Achievement in a Pre-University Mathematics Course. Journal of Education and Learning, 6(4), 364–371. https://doi.org/10.5539/jel.v6n4p364

Sundaygara, C., Gusi, L. A. R. P., Pratiwi, H. Y., Ayu, H. D., Jufriadi, A., & Hudha, M. N. (2021). Identification students’ misconception using four-tier diagnostic test on Newton Law subject. Journal of Physics: Conference Series, 1869(1). https://doi.org/10.1088/1742-6596/1869/1/012157

Traub, R. E. (1997). Classical test theory in historical perspective. Educational Measurement: Issues and Practice, 16(4), 8–14. https://doi.org/10.1111/j.1745-3992.1997.tb00603.x

Downloads

Published

2023-07-26

How to Cite

Prabowo, A., Herman, T., & Fatimah, S. (2023). The Characteristics of Four-Tier Diagnostic Test: Classical Test Theory Perspective. International Journal on Emerging Mathematics Education, 7(1), 12–19. https://doi.org/10.12928/ijeme.v7i1.22677

Issue

IJEME, Vol. 7 No. 1, March 2023

Section

Articles

License

License and Copyright Agreement

In submitting the manuscript to the journal, the authors certify that:

  • They are authorized by their co-authors to enter into these arrangements.
  • The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal. Please also carefully read the International Journal on Emerging Mathematics Education (IJEME) Author Guidelines at http://journal.uad.ac.id/index.php/IJEME/about/submissions#authorGuidelines
  • That it is not under consideration for publication elsewhere,
  • That its publication has been approved by all the author(s) and by the responsible authorities, tacitly or explicitly, of the institutes where the work has been carried out.
  • They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  • They agree to the following license and copyright agreement.

Copyright

Authors who publish with the International Journal on Emerging Mathematics Education (IJEME) agree to the following terms:

  1. Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

 


Ciptaan disebarluaskan di bawah Lisensi Creative Commons Atribusi-BerbagiSerupa 4.0 Internasional.