Development of a four-tier diagnostic test for misconceptions in natural science of primary school pupils
DOI:
https://doi.org/10.36681/tused.2025.017Keywords:
Misconceptions, science, diagnostic test, aiken’s V, 4-D modelAbstract
This study aimed to develop a standardised instrument for diagnosing science misconceptions in primary school children. Following a developmental research approach using the 4-D model (Define, Design, Develop, Disseminate), 100 four-tier multiple choice items were constructed. Content validity was established through expert evaluation by six science specialists. The study was conducted using stratified purposive sampling on 140 pupils from public and private primary schools with ‘very good’ and ‘good’ ratings in Surakarta, Indonesia. The instrument's construct validity, reliability, and empirical validity were assessed using Aiken's V, Pearson's Correlation Coefficient, and Cronbach's alpha, respectively. Difficulty index was also calculated. The final version comprised 61 valid and reliable items with Aiken's V ranging from 0.79 to 0.92, Pearson's Correlation ranging from 0.17 to 0.58, and a Cronbach's alpha coefficient of 0.86. Item difficulty ranged from 0.014 to 0.62, with 27 and 34 items falling into the moderate and difficult categories, respectively. This instrument demonstrates potential for effectively detecting science misconceptions in primary school learners. Based on these findings, teachers, policymakers and parents can take targeted action to address misconceptions. This may involve evaluating science textbooks, enhancing teacher training, and fostering discussions with science experts. Additionally, parental involvement in reinforcing science concepts is crucial.
Downloads
References
Abell, S. K., & Lederman, N. G. (2007). Handbook of research on science education. in measurement (Issue 801). Routledge & Francis Group. https://doi.org/10.4324/9780203097267.ch3
Agustin, U. (2020). Development of a four-tier multiple-choice diagnostic test instrument for identifying student misconceptions in the topic of chemical equilibrium. Semarang State University. https://doi.org/10.15294/chemined.v11i1.40935
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/00131644854 51012
Ajayi, V. O. (2017). Misconceptions. in trends, theory and practice in science education research (Issue October). https://www.researchgate.net/publication/320172303_Misconceptions#fullTextFileContent
Bahri, M. F., & S. (2019). Content validity and reliability analysis of integrated islamic-science test instrument to measure the student’s critical thinking ability. Islam Realitas: Journal of Islamic & Social Studies, 5(1), 45–51. https://doi.org/10.30983/islam_realitas.v5i1.894
Bar, V., Brosh, Y., & Sneider, C. (2016). Weight, mass, and gravity : threshold concepts in learning ccience. Science Educator, 25(1), 22–34. https://www.researchgate.net/publication/303523909_Weight_Mass_and_Gravity_Threshold_Concepts_in_Learning_Science/citations#fullTextFileContent
Bou-Jaoude, S. (1991). A study of the nature of students’ understandings about the concept of burning. Journal of Research in Science Teaching, 28, 689–704. http://dx.doi.org/10.1002/tea.3660280806
Berg, E. van D. (1991). Physics misconceptions and remediation. Satyawacana University. https://onesearch.id/Record/IOS4813.INLIS000000000006720
Caleon, I.S, & Subramanium, R. (2010). Development and application of a three‐tier diagnostic test to assess secondary students’ understanding of waves. International Journal of Science Education, 32(7), 939–961. https://doi.org/10.1080/09500690902890130
Caleon, I. S., & Subramaniam, R. (2017). Do students know what they know and what they don’t know? using a four-tier diagnostic test to assess the nature of students’ alternative conceptions. Res Sci Educ, 40(3), 313-337. https://link.springer.com/article/10.1007/s11165-009-9122-4#citeas
Canada et all. (2017). Change in elementary school students’ misconceptions on material systems after a theoretical-practical instruction. International Electronic Journal of Elementary Education, 9(3), 499–510. https://www.iejee.com/index.php/IEJEE/article/view/173/169
Celikkanlı, N.O, Kızılcık, H. S (2022). A review of studies about four-tier diagnostic tests in physics education. Journal of Turkish Science Education, 19(4), 1291-1311. https://doi.org/10.36681/tused.2022.175
Chang, C. Y., Yeh, T. K., & Barufaldi, J. P. (2010). The positive and negative effects of science concept tests on student conceptual understandig. International Journal of Science Education, 32(2), 265–282. https://doi.org/10.1080/09500690802650055
Cheung, D., Slavin, R. E., & Lake, C. (2017). Effective programs for elementary science: a best-evidence synthesis. Journal of Research in Science Teaching, 54(3), 295-304. https://doi.org/10.1002/tea.21360
Chiappeta, E. L., & Thomas R Koballa, J. (2010). Science instruction in the middle and second schools: developing fundamental knowledge and skill (K. V. Canton (ed.); 7th ed.). Allyn and Bacon. https://www.worldcat.org/title/science-instruction-in-the-middle-and-secondary-schools-developing-fundamental-knowledge-and-skills/oclc/862090622
Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge. https://doi.org/10.4324/9781315456539
Deringol. (2019). Misconceptions of primary school students about the subject of fractions. International Journal Ofs Evaluation and Research in Education (IJERE), 8(3), 29–38. http://doi.org/10.11591/ijere.v8i1.16290
Desstya, A; Sayekti, I. C. (2020). Elementary science learning. Muhammadiyah University Press. Surakarta.
Diani, R., Alfin, J., Anggraeni, Y. M., Mustari, M., & Fujiani, D. (2019). Four-tier diagnostic test with certainty of response index on the concepts of fluid. Journal of Physics: Conference Series, 1155(1). https://doi.org/10.1088/1742-6596/1155/1/012078
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2020). Scaffolding scientific understanding: the role of addressing misconceptions. Educational Researcher, 49(6), 398-407. https://doi.org/10.1080/09500693.2011.604684
Habiddin, & Page, E. M. (2019). Development and validation of a four-tier diagnostic instrument for chemical kinetics (FTDICK). Indonesian Journal of Chemistry, 19(3), 720–736. https://doi.org/10.22146/ijc.39218
Ihsan, H. (2015). Content Validity of research measuring tools: concepts and assessment guidelines. pedagogia: Jurnal Ilmu Pendidikan, 13(3), 173. https://doi.org/10.17509/pedagogia.v13i3.6004
Irawan et al. (2017). Instructional Materials development through 4d model. SHS Web of Conferences 42, 00086 (2018). https://doi.org/10.1051/shsconf/20184200086
Ishartono, N., Razak, R.A., Halili, S.H., Jufriansyah, A., (2024). Factors shaping Indonesian preservice math teachers’ digital media adoption in online mathematics teaching practice: an instrument development and validation study. Journal on Mathematics Education. 15(4). 1219-1250. https://doi.org/10.22342/jme.v15i4.pp1219-1250
Jandaghi, G. (2011). Assessment of validity, reliability and difficulty indices for teacher-built physics exam questions in first year high school. Arts and Social Sciences Journal, 16(1), 1–4. https://eric.ed.gov/?id=EJ911907
Jandaghi, G., & Shaterian, F. (2008). Validity, reliability and difficulty indices for instructor-built exam questions. Journal of Applied Quantitative, 3(2), 151–155. https://files.eric.ed.gov/fulltext/EJ803060.pdf
Mitkovska, S.J. (2010). The need of continuous professional teacher 283 development. Procedia Social and Behavioral Sciences, 2(2), 2921–2926. https://doi.org/https://doi.org/10.1016/j.sbspro.2010.03.441
Kaltakci-Gurel, D., Eryilmaz, A., & McDermott, L. C. (2016). Development and application of a four-tier test to assess pre-service physics teachers’ misconceptions about geometrical optics. Research in Science Education, 46(2), 239-261. https://doi.org/10.1007/s11165-014-9461-8
Kambouri, M. (2010). Teachers and children’s misconceptions in science’. British Educational Research Association Annual Conference, September, 1–22. https://doi.org/doi:10.13140/2.1.4012.3845
Kartimi et all. (2021). A Four-tier Diagnostic instrument: an analysis of elementary student misconceptions in science topic. Journal of Research in Science Education. 7 (Special Issue). https://doi.org/10.29303/jppipa.v7iSpecialIssue.1022
Kusumawati & Hadi. (2018). An analysis of multiple choice questions (mcqs): item and test statistics from mathematics assessments in senior high school. Research and Evaluation in Education, 4(1). https://doi.org/https://doi.org/10.21831/reid.v4i1.20202
Lestari, M. D, A. (2019). Science Misconceptions in biology in fifth grade elementary school teachers. Thesis. Faculty of Teacher Training and Education, Sanata Dharma University, Yogyakarta
Lin, Jing-wen; Yen, Miao-Hsuan; Lia, Jia-Chi; Chiu, Mei-Hung; Guo, C.-J. (2016). Examining the factors that influence students ’ science learning processes and their learning outcomes : 30 years of conceptual change research. Eurasia Journal of Mathematics, Science & Technology Education, 12(9), 2617–2646. https://doi.org/10.12973/eurasia.2016.000600a
Maharani et all. (2019). Diagnostic Test with four-tier in physics learning: case of misconception in newton’s law material. Journal of Physics: Conference Series, 155(012022), 1–8. https://doi.org/10.1088/1742-6596/1155/1/012022
Ministry of National Education Directorate General; Directorate of Middle School Development. (2007). Diagnostic_test. ministry of education. Jakarta.
Mubarokah, F.D, Mulyani, S, Indriyanti, N.M. (2018). Identifying students’ misconceptions of acid-base concepts using a three-tier diagnostic test: a case of Indonesia and Thailand. Journal of Turkish Science Education. 15 (special issue), 51-58. https://doi.org/10.36681/
Mutsvangwa, A. (2020). A study of student teachers misconceptions on uniform circular motion. Journal of Physics, 1512(1513), 1–6. https://doi.org/10.1088/1742-6596/1512/1/012029
Narjaikaew, P. (2013). Alternative Conceptions of primary school teachers of science about force and motion. Procedia - Social and Behavioral Sciences, 88, 250–257. https://doi.org/10.1016/j.sbspro.2013.08.503
Nasir, et all (2023). The development of a two-tier diagnostic test for student understanding of light. Journal of Turkish Science Education. 20(1), 150-172. https://doi.org/10.36681/tused.2023.009
Nugroho, C.Y.R., Hariyatmi, Supriyanto. (2021). Improving science learning outcomes using experimental methods for grade IV students in the even semester of SDN 01 Tawangmangu in 2020/2021. Journal of Education Researsch. 3(4). 37-44. https://doi.org/10.36654/educatif.v3i4.80
Nunnally, J. C. (1978). Psychometric Theory. Mc Graw Hill Book Company. https://www.scirp.org/(S(i43dyn45teexjx455qlt3d2q))/reference/ReferencesPapers.aspx?ReferenceID=1867797
Nurhasanah et al., (2023). Is sipoert an innovative learning? implementation and identification of students’ conception on simple harmonic motion. Indonesian Journal on Learning and Advanced Education. 5(1), 78-91. https://doi.org/10.23917/ijolae.v5i1.19567
Nurhidayatullah, N., & Prodjosantoso, A. K. (2018). Misconceptions about buffer solutions. Jurnal Inovasi Pendidikan IPA, 4(1), 41–51. https://doi.org/10.21831/jipi.v4i1.10029
Nurjani et al. (2020). Identifying the misconception of sound concepts among grade v students at SDN 192 Pekanbaru. Journal of Physics: Conference Series, 1–5. https://doi.org/doi:10.1088/1742-6596/1655/1/012074
Perinetti, G. (2019). Statips part vi: bivariate correlation. South European Journal of Orthodontics and Dentofacial Research, 6(1), 1–5. https://doi.org/10.5937/sejodr6-21664
Putica, K. B (2022). Development and validation of a four-tier test for the assessment of secondary school students’ conceptual understanding of amino acids, proteins, and enzymes. Research in Science Education. https://doi.org/10.1007/s11165-022-10075-5
Rintayati, P., Lukitasari, H., & Syawaludin, A. (2021). Development of two-tier multiple choice test to assess indonesian elementary students higher -order thinking skills. International Journal of Instruction, 14(1), 555–566. https://doi.org/https://doi.org/10.29333/iji.2021.14133a
Rohmanasari1 & Ermawati, F.U (2019) Using four-tier multiple choice diagnostic test to identify misconception profile of 12th grade students in optical instrument concepts. IOP Publishing Ltd Journal of Physics: Conference Series. 1491 012011. https://doi.org/10.1088/1742-6596/1491/1/012011
Sadevi, R.A & Sayekti, I.C. (2023). Identification of science misconceptions using two-tier multiple choice for elementary school grade iv students. Profesi Pendidikan Dasar. 10(1), 24-37. https://doi.org/10.23917/ppd.v10i1.4063
Sadler, P. M., Sonnert, G., Coyle, H. P., Cook-Smith, N., & Miller, J. L. (2019). The reliability and validity of diagnostic tests in science education. Journal of Research in Science Teaching, 56(3), 362-383.
Sahin, C., Ipek, H., & Ayas, A. (2008). Students’ understanding of light concepts primary school: A cross-age study. Asia-Pacific Forum on Science Learning and Teaching, 9(1), 1–19. http://www.ied.edu.hk/apfslt/download/v9_issue1_files/sahin.pdf
Salamah, U, et.all (2020). Development of a four-tier multiple choice diagnostic test to detect understanding of cognitive concepts on catabolism material in xii grade at senior high school students. Bioeduca: Jurnal Pendidikan Biologi 2(1). 30 – 41. https://doi.org/10.21580/bioeduca.v2i1.5997
Saputra, O., Setiawan, A., Rusdiana, D., & Muslim. (2020). Analysis of students’ misconception using four tier diagnostic test on fluid topics. International Journal of Advanced Science and Technology, 29(1), 1256–1266. Retrieved from http://sersc.org/journals/index.php/IJAST/article/view/3617
Setiabudi, A; Mulyadi; Puspita, H. (2019). An analysis of validity and reliability of a teacher-made test (case study at xi grade of sman 6 Bengkulu). Journal of English Education and Teaching (JEET), 3(4), 522–532. https://doi.org/10.33369/jeet.3.4.522-532
Sheftyawan, W. B., Prihandono, T., & Lesmono, A. D. (2018). Identifying student misconceptions using a four-tier diagnostic test on optical geometry material. Jurnal Pembelajaran Fisika, 7(2), 147–153. https://doi.org/10.19184/jpf.v7i2.7921
Smolleck, L., & Hershberger, V. (2011). Playing with science: an investigation of young children’s science conceptions and misconceptions. Current Issues in Education, 14(1), 1–32. https://www.semanticscholar.org/paper/Playing-With-Science%3A-An-Investigation-of-Young-and-Smolleck/6f38f2971c5dc7eb6b69f40a83b3483c0fc28429
Soeharto, Csapo, B., Sarimanah, E., Dewi, F. I., & Sabri, T. (2019). A review of students common misconception in science and their diagnostic assesment tools. Jurnal Pendidikan IPA Indonesia, 8(2), 247–266. https://doi.org/10.15294/jpii.v8i2.18649
Soeharto. (2021). Development of a diagnostic assessment test to evaluate science misconceptions in terms of school grades: a rasch measurement approach. Journal of Turkish Science Education. 18(3), 351-370. https://doi.org/10.36681/tused.2021.78
Stein, M., Larrabee;, T. G., & Charles R. Barman. (2008). A study of common beliefs and misconceptions in physical science. Journal of Elementary Science Education, 20(2), 1–11. https://files.eric.ed.gov/fulltext/EJ798575.pdf
Suwarna, I. (2014). Analysis of class x students' misconceptions on physics subject material through CRI (certainty of respone index) termodifikasi. Jurnal Lemit. http://library1.nida.ac.th/termpaper6/sd/2554/19755.pdf
Thiagarajin, S., Semmel, D., & Senmel, M. (1974). Instructional development for training teachers of exceptional children: a sourcebook. (Issue Indiana: Indiana University). https://files.eric.ed.gov/fulltext/ED090725.pdf
Treagust, D. F. (2018). The importance of developing diagnostic instruments for science misconceptions. International Journal of Science Education, 40(12), 1483-1503
Treagust, D. F., Duit, R., & Fischer, H. E. (2017). Multiple representations in physics education: models and modeling. Springer International Publishing. http://ndl.ethernet.edu.et/bitstream/123456789/23230/1/David%20F.%20Treagust_2017.pdf
Tumanggor, A. M. R., Supahar, Kuswanto, H., & Ringo, E. S. (2020). Using four-tier diagnostic test instruments to detect physics teacher candidates’ misconceptions: case of mechanical wave concepts. Journal of Physics: Conference Series, 1440(1), 1–8. https://doi.org/10.1088/1742-6596/1440/1/012059
Wulandari, D., Susanti, S., & Purwanti, E. (2021). Development of a four-tier diagnostic test to detect students' misconceptions in elementary school science. Jurnal Pendidikan Sains Indonesia, 9(3), 367-378. https://doi.org/10.15294/jpsi.v9i3.31900.
Yuberti, Y., Suryani, Y., & Kurniawati, I. (2020). Four-tier diagnostic test with certainty of response index to identify misconception in physics. Indonesian Journal of Science and Mathematics Education, 3(2), 245–253. https://doi.org/10.24042/ijsme.v3i2.6061
Yunus, F. W., & Ali, M. (2019). Using multiple-tier diagnostic tests to identify misconceptions in science education. Journal of Physics: Conference Series, 1157(2), 022032. https://doi.org/10.1088/1742-6596/1157/2/022032
Downloads
Issue
Section
Published
License
Copyright (c) 2025 Journal of Turkish Science Education
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
