Development of online science process skills test for 8th grade pupils: Research Article

Serhan Sarıoğlu

doi:10.36681/tused.2023.024

Authors

Serhan Sarıoğlu

DOI:

https://doi.org/10.36681/tused.2023.024

Keywords:

Assessment of scientific skills, science process skills, middle school students, test development

Abstract

Science process skills are an important part of scientific inquiry that need to be monitored so that pupils can improve their skills to do science. Although there are several science process skills tests mentioned in the literature, we decided to develop an online one in order to improve the usefulness of the test and enable autoscoring to reduce the efforts needed from the teacher. For this purpose, a 17-item test with 2 open-ended and 15 multiple-choice items was developed. After the pilot with 18 8th grade pupils, the study was conducted with 83 8th grade pupils from Bursa in Turkey. Content validity was ensured since all 14 science process skills in the selected theoretical framework were covered in the test. Item analysis showed that these items are valid and reliable as KR20 showed a 0.75 reliability rating, item difficulties were higher than 0.40 and discrimination indexes were higher than 0.30. To gain a deeper insight, distractor analysis showed that all distractors were found to be functional. The test provides a more comprehensive and efficient method of assessing pupils’ science process skills, while also enhancing pupil engagement and accessibility. It has the potential to inform instruction and support for pupils, as well as advance research in the field of science education.

Downloads

Download data is not yet available.

References

Ar, M. E., Sarıoğlu, S., Demir, B., & Yıldız, G. (2023). Examination of 2021 Turkish central exam science questions in terms of science process skills. Van Yüzüncü Yıl University Journal of Education 20(1), 332–351. https://doi.org/10.33711/yyuefd.1178620

Ariely, M., Nazaretsky, T., & Alexandron, G. (2022). Machine learning and Hebrew NLP for automated assessment of open-ended questions in biology. International Journal of Artificial Intelligence in Education, 33, 1–34. https://doi.org/10.1007/S40593-021-00283-X/

Aydoğdu, B. (2017). A study on basic process skills of Turkish primary school pupils. Eurasian Journal of Educational Research, 67(2017), 51–69. https://doi.org/10.14689/ejer.2017.67.4

Aydoğdu, B., Tatar, N., Yıldız, E., & Buldur, S. (2012). İlköğretim öğrencilerine yönelik bilimsel süreç becerileri ölçeğinin geliştirilmesi. Kuramsal Eğitimbilim Dergisi, 5(3), 292–311.

Azizah, K. N., Ibrahim, M., & Widodo, W. (2018). Process skill assessment instrument: Innovation to measure pupil’s learning result holistically. Journal of Physics: Conference Series, 947(1). https://doi.org/10.1088/1742-6596/947/1/012026

Bahşi̇, A., & Açıkgül Fırat, E. (2020). STEM etkinliklerinin 8. sınıf öğrencilerinin bilimsel süreç becerilerine, bilimsel epistemolojik inançlarına ve fen başarılarına etkisinin incelenmesi. OMÜ Eğitim Fakültesi Dergisi, 39(1), 1–22. https://doi.org/10.7822/omuefd.616509

Bearman, M., Boud, D., & Ajjawi, R. (2020). New directions for assessment in a digital world. In M. Bearman, P. Dawson, R. Ajjawi, J. Tai, & D. Boud (Eds.), Re-imagining university assessment in a digital world (pp. 7–23). http://www.springer.com/series/13204

Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.

Brotherton, P. N., & Preece, P. F. W. (1996). Teaching science process skills. International Journal of Science Education, 18(1), 65–74. https://doi.org/10.1080/0950069960180106

Büyüköztürk, Ş., Kılıç-Çakmak, E., Akgün, Ö. E., Karadeniz, Ş., & Demirel, F. (2008). Bilimsel araştırma yöntemleri. Pegem A. https://avesis.medeniyet.edu.tr/yayin/d93be4a3-e3bb-42ae-8635-96946af53ee9/bilimsel-arastirma-yontemleri

Bybee, R. W. (2006). Scientific inquiry and science teaching. In L. B. Flick & N. G. Lederman (Eds.), Scientific Inquiry and Nature of Science (Springer, Vol. 25, pp. 1–14). Springer. https://doi.org/10.1007/978-1-4020-5814-1_1

Carleton, R. H. (1964). Theory into science curriculum development. NSTA. https://files.eric.ed.gov/fulltext/ED011000.pdf

Chiappetta, E. L., Koballa, T. R., & Collete, A. T. (2015). Science instruction in the middle and secondary schools (4th ed.). Merrill Prentice Hall.

Chokchai, O., & Pimdee, P. (2019). Examining of secondary school pupils’ integrated science process skills. Journal for the Education of Gifted Young Scientists, 7(4), 1137–1157. https://doi.org/10.17478/jegys.597449

Creswell, J. W. & Plano Clark, V. L. (2013). Research Design: Qualitative, Quantitative, and Mixed Method Approaches (p. 273). SAGE.

Çataldere, K. (2022). Fen bilimleri öğretmenlerinin ve araştırmacıların bakış açılarıyla beceri temelli soruların bazı değişkenler açısından analizi [Unpublished Master's Thesis]. Bursa Uludağ University.

Çepni, S. (2004). Fen ve teknoloji öğretimi (kuramdan uygulamaya). Pegem https://doi.org/10.14527/9786053186496

Çepni, S., Ayas, A., Johnson, D., & Turgut, M. F. (1997). Fizik öğretimi. YÖK/dünya bankasi milli eğitimi geliştirme projesi, hizmet öncesi öğretmen eğitimi. YÖK/ Dünya Bankası.

Çepni, S., & Kara, Y. (2019). Problem solving procedure in terms of cognitive theories. In S. Çepni & Y. Kara (Eds.), Current studies in educational measurement and evaluation (pp. 1–25). Paradigma.

DeVellis, R. F. (2016). Scale development theory and applications (Fourth Ed.). SAGE.

Ergül, R., Şimşekli, Y., Çalış, S., Özdilek, Z., Göçmençelebi, S., & Şanlı, M. (2011). The effects of inquiry-based science teaching on elementary school pupils’ science process skills and science attitudes. Bulgarian Journal of Science and Education Policy (BJSEP), 5(1), 48–69.

Fathonah, N., Rahardjo, S., & Prayitno, B. (2018). Analysis of pupils’ science process skill of junior high school in Ngawi district in material classification and its changes. Advances in Social Science, Education and Humanities Research, 262(Ictte), 302–305. https://doi.org/10.2991/ictte-18.2018.55

Gabel, D. (1993). Introductory science skills. Waveland Press.

Gill, A. F. (2019). A Study of progression in science process skills during a midwestern public research university’s stem summer camps [Unpublished doctoral thesis]. Northern Illinois University.

Harlen, W. (1999). Purposes and procedures for assessing science process skills. International Journal of Phytoremediation, 21(1), 129–144. https://doi.org/10.1080/09695949993044

Hasançebi, B., Terzi, Y., & Küçük, Z. (2020). Madde güçlük indeksi ve madde ayırt edicilik indeksine dayalı çeldirici analizi. Gümüşhane Üniversitesi Fen Bilimleri Enstitüsü Dergisi, 10(1), 224–240. https://doi.org/10.17714/gumusfenbil.615465

Hernawati, D., Amin, M., Irawati, M., & Aziz, M. (2018). Integration of project activity to enhance the scientific process skill and self-efficacy in zoology of vertebrate teaching and learning. EURASIA Journal of Mathematics, Science and Technology Education, 14(6), 2475–2485. https://doi.org/10.29333/ejmste/89940

Indri, O. W., Sarwanto, & Nurosyid, F. (2020). Analysis of high school pupils’ science process skills. Journal of Physics: Conference Series, 1567(3). https://doi.org/10.1088/1742-6596/1567/3/032098

Kavak, Ş., & Deretarla Gül, E. (2021). Scientific process skills scale development for preschool children. KEFAD, 22(2), 1071–1099. https://toad.halileksi.net/sites/default/files/pdf/okul-oncesi-cocuklari-icin-bilimsel-surec-becerileri-olcegi-toad.pdf

Keskinkılıç Yumuşak, G. (2017). The effects of reflective thinking activities on science process skills. Necatibey Faculty of Education Electronic Journal of Science and Mathematics Education, 11(1), 222–251.

Leat, D., & Nichols, A. (2000). Brains on the table: Diagnostic and formative assessment through observation. Assessment in Education: Principles, Policy & Practice, 7, 103–121. https://doi.org/10.1080/713613327

Lederman, J. S., & Stefanich, G. P. (2007). Addressing disabilities in the context of inquiry and nature of science instruction. In Scientific Inquiry and Nature of Science. https://doi.org/10.1007/978-1-4020-5814-1_4

Mcgregor, D. (2007). Developing thinking: Developing learning A guide to thinking skills in education. McGraw Hill. http://vct.qums.ac.ir/portal/file/?180494/Developing-thinking_-developing-learning.pdf

Ministry of National Education (MoNE). (2018). Primary and middle school science curriculum. http://mufredat.meb.gov.tr/Dosyalar/201812312311937-FEN%20B%C4%B0L%C4%B0MLER%C4%B0%20%C3%96%C4%9ERET%C4%B0M%20PROGRAMI2018.pdf

Mutlu, N., & Özden, M. Y. (2017). Fen ve teknoloji öğretmenlerinin alternatif ölçme ve değerlendirme yöntemlerine yönelik ihtiyaç analizi. Mersin Üniversitesi Eğitim Fakültesi Dergisi, 13(3), 936–948. https://doi.org/10.17860/mersinefd.301633

Ostlund, K. (1992). Science process skills: Assessing hands-on pupil performance. https://www.semanticscholar.org/paper/ae53dd0a3b7015d76038412fab30f6886cd0d2fc

Ostlund, K. (1998). What the research says about science process skills. Electronic Journal of Science Education, 2(4). https://eric.ed.gov/?id=EJ649635

Özçelik, H. (2019). Kavram karikatürleri ile desteklenen tahmin et-gözle-açikla (tga) yönteminin ortaokul öğrencilerinin sorgulama becerileri, bilimsel süreç becerileri ve kavram öğrenmelerine etkisi [Unpublished master's thesis]. https://www.proquest.com/docview/2495427617

Özgelen, S. (2012). Pupils’ science process skills within a cognitive domain framework. Eurasia Journal of Mathematics, Science and Technology Education, 8(4), 283–292. https://doi.org/10.12973/eurasia.2012.846a

Padilla, M. J. (1990). The science process skills: Research matters. NARST. https://narst.org/research-matters/science-process-skills

Paine, A. R. (2020). Pupils’ use of science process skills in introductory level biology labs [Unpublished doctoral thesis]. University of Colorado.

Preece, P., & Brotherton, P. N. (1997). Teaching science process skills: long‐term effects on science achievement. International Journal of Science Education, 19, 895–901. https://doi.org/10.1080/0950069970190803

Ramesh, M. (2014). Acquisition of science process skills through experiential learning in pupils of standard VIII [Unpublished doctoral thesis]. Maharaja Sayajirao University of Baroda.

Rezba, R. J., Sprague, C., Fiel, R. L., & Funk, H. J. (1995). Learning and assessing science process skills. Kendall/Hunt.

Richardson, M., & Clesham, R. (2021). Rise of the machines? The evolving role of AI technologies in high-stakes assessment. London Review of Education, 19(1), 1–14. https://doi.org/10.14324/lre.19.1.09

Rillero, P. (1998). Process skills and content knowledge. Science Activities, 35(3), 3.

Secolsky, C., & Denison, D. B. (2012). Handbook on measurement, assessment, and evaluation in higher education. In Handbook on measurement, assessment, and evaluation in higher education. Taylor and Francis. https://doi.org/10.4324/9780203142189

Serevina, V., Sunaryo, S., Raihanati, R., Astra, I. M., & Sari, I. J. (2018). Development of e-module based on problem based learning (pbl) on heat and temperature to improve pupil’s science process skill. TOJET: The Turkish Online Journal of Educational Technology, 17(3), 26–36.

Şahin, F., Yıldırım, M., Sürmeli, H., & Güven, I. (2018). A test development study for evaluation of preschool children's scientific process skills. Science, Education, Art and Technology Journal (SEAT Journal), 2(2), 124- 138.

Şensoy, Ö., & Yıldırım, H. İ. (2017). Araştırma soruşturma tabanli öğrenme yaklaşiminin yaratici düşünme ve bilimsel süreç becerilerine etkisi. Cumhuriyet International Journal of Education-CIJE, 6(1), 34–46.

Şıvgın, C. (2019). Lise öğrencilerinin epistemolojik inançları, eleştirel düşünme Becerileri Ve bilimsel süreç becerileri arasındaki ilişkinin incelenmesi [Unpublished master's thesis]. Marmara University.

Smith, K. (1995). Science process assessments for elementary and middle school pupils. Science Process Assessments. http://scienceprocesstests.com/

Social environmental and scientific education [SESE]. (1999). Primary school curriculum. http://www.curriculumonline.ie/getmedia/346522bd-f9f6-49ce-9676-49b59fdb5505/PSEC03c_Science_Curriculum.pdf

Strong, M. G. (2013). Developing elementary math and science process skills through engineering design instruction [Unpublished master's thesis]. Hofstra University.

Tan, M., & Temiz, B. (2003). Fen öğretiminde bilimsel süreç becerilerinin yeri ve önemi. Pamukkale Üniversitesi Eğitim Fakültesi Dergisi, 1(13), 89–101.

Traynor, A., Li, T., & Zhou, S. (2020). Applied measurement in education gauging uncertainty in test-to-curriculum alignment indices. https://doi.org/10.1080/08957347.2020.1732387

Türkmen, H., & Kandemir, E. M. (2011). Öğretmenlerin bilimsel süreç becerileri öğrenme alanı algıları üzerine bir durum çalışması. Journal of European Education, 1(1), 15–24. http://eu-journal.org/index.php/JEE/article/view/171/157

Ülger, B. B. (2021). An adaptation study for the measurement of scientific process skills for gifted pupils in science: The diet cola test. Journal of Turkish Science Education, 18(3), 542–554. https://doi.org/10.36681/tused.2021.89

Ülger, B. B., Ar, M. E., & Sarıoğlu, S. (2022). Bağlam temelli soru yazma eğitimine katılan fen bilimleri öğretmenlerinin yazılı sınavlarda sordukları soruların incelenmesi. The Western Anatolia Journal of Educational Sciences (WAJES), 13(1), 335–353. https://doi.org/10.51460/BAEBD.804810

Ülger, B. B., & Çepni, S. (2021). Evaluating the effect of differentiated inquiry-based science lesson modules on gifted students’ scientific process skills. Pegem Eğitim ve Öğretim Dergisi, 10(4), 1289–1324. https://doi.org/http://dx.doi.org/10.14527/pegegog.2020.039

Uysal, E., & Cebesoy, Ü. B. (2020). Investigating the effectiveness of design-based stem activities on pre-service science teachers’ science process skills, attitudes and knowledge. SDU International Journal of Educational Studies, 7(1), 60–81. https://doi.org/10.33710/sduijes.614799

Vincent-Lancrin, S., & Van Der Vlies, R. (2020). Trustworthy artificial intelligence (AI) in education: Promises and challenges. OECD Education Working Papers https://doi.org/10.1787/a6c90fa9-en

Watts, M., & Dillon, J. (2022). Debates in science education. Routledge. https://doi.org/10.4324/9781003137894

Webb, N. (2007). Issues related to judging the alignment of curriculum standards and assessments. Applied Measurement in Education, 20(1), 1–20. papers3://publication/uuid/E9DC4B5A-EC59-42D2-9029-08CA97172A48

Wellington, J. J. (1989). Skills and processes in science education: A critical analysis. Routledge.

Wu, J. (1994). Understanding the nature of science, science process skills, and attitudes toward science of pupils exposed to different science curricula in Taiwan, Republic of China [Unpublished master's thesis]. The University of Iowa.