Development of Diagnostic Instruments for Critical Thinking Skills of Students in Physics Learning on Socio-Scientific Issues (SSI)
Abstract views: 14
PDF downloads: 10
Keywords:
critical thinking, diagnostic instruments, socio-scientific issues, ; physics learningAbstract
This study aimed to develop and test the feasibility of a diagnostic instrument for assessing students' critical thinking skills on socio-scientific issues (SSI) in physics education with the topic of global warming. This objective is motivated by the lack of valid, reliable, and contextually appropriate assessment instruments based on Socio-Scientific Issues (SSI) in physics education at the secondary school level, amid the low critical thinking competencies of Indonesian students as indicated by the 2018 PISA survey, and the need for an SSI approach as an effective strategy. The research method employs a research and development (R&D) design using the ADDIE model. The instrument was developed in the form of 20 essay questions based on SSI contexts and its validity was reviewed by experts and tested on 75 students from two high schools in rural and urban areas. Data were analyzed using Rasch modeling with the assistance of WINSTEPS software. Expert validation results showed that the instrument was categorized as “Highly Suitable.” Rasch model analysis confirmed the instrument's unidimensionality (raw variance explained by observed measures: 30.9%). The analysis results showed that all items were deemed fit (Outfit MNSQ: 0.78–1.28; ZSTD:–1.51 to 1.81; and PTMEA Corr: 0.26–0.68). The instrument's reliability is high, with a Cronbach's alpha of 0.81, person reliability of 0.80, and item reliability of 0.91, using a structurally valid rating scale. However, significant DIF based on gender and region was found, indicating the need for further revision to ensure measurement fairness. This instrument is deemed valid and reliable for use as a diagnostic tool for critical thinking skills in SSI-based physics learning.
Downloads
References
Adams, D., Sumintono, B., Mohamed, A., & Noor, N. S. M. (2018). E-learning readiness among students of diverse backgrounds in a leading Malaysian higher education institution. Malaysian Journal of Learning and Instruction, 15(2), 227–256. https://doi.org/10.32890/mjli2018.15.2.9
Agustihana, S., & Suparno, S. (2019). Development of HOTS Oriented Cognitive Problems in Thermodynamics for Senior High Schools. Jurnal Penelitian Fisika Dan Aplikasinya (JPFA), 9(1), 44–54. https://doi.org/10.26740/jpfa.v9n1.p44-54
Albano, G., & Umberto Dello Iacono. (2019). Sebuah alat perancah untuk mendorong argumentasi dan bukti dalam matematika : beberapa studi kasus. Educational Technology in Higher, 16(1), 1-12. https://doi.org/10.1186/s41239-019-0134-5
Avinç, E., & Doğan, F. (2024). Digital literacy scale: Validity and reliability study with the rasch model. Education and Information Technologies, 29(17), 22895–22941. https://doi.org/10.1007/s10639-024-12662-7
Barbera, J., Naibert, N., Komperda, R., & Pentecost, T. C. (2020). Clarity on Cronbach’s alpha use. Journal of Chemical Education, 98(2), 257–258. https://doi.org/10.1021/acs.jchemed.0c00183
Bhakti, Y. B., Arthur, R., & Supriyati, Y. (2023). Development of an assessment instrument for critical thinking skills in Physics: a systematic literature review. Journal of Physics: Conference Series, 2596(1), 1-8. https://doi.org/10.1088/1742-6596/2596/1/012067
Boone, C. (2014). Property and political order in Africa: Land rights and the structure of politics. Cambridge University Press.
Branch, R. M., & Varank, İ. (2009). Instructional design: The ADDIE approach (Vol. 722). Springer.
Cantó-Cerdán, M., Cacho-Martínez, P., Lara-Lacárcel, F., & García-Muñoz, Á. (2021). Rasch analysis for development and reduction of Symptom Questionnaire for Visual Dysfunctions (SQVD). Scientific Reports, 11(1), 1-10. https://doi.org/10.1038/s41598-021-94166-9
David, D., & Budianto, A. (2021). Legal policy in the sky of higher education as a strategy for empowering Indonesia society. Proceedings of the 1st International Conference on Law, Social Science, Economics, and Education, ICLSSEE 2021, March 6th 2021, Jakarta, Indonesia.
Dewi, A. I. K., Suyono, S., & Erman, E. (2023). Effectiveness of Socioscientific Issues (SSI) Based Learning to Improve Argumentation Skills. Jurnal Penelitian Pendidikan IPA, 9(1), 279–283. https://doi.org/10.29303/jppipa.v9i1.2866
Ekawati, E. Y., Sabrilla Almas Azzahra, & Hanun Fithriyah. (2024). Construction of Critical Reasoning Skills Assessment Instruments as Diagnostic Assessments in Physics Learning with Polytomus Scoring. Journal of Education Research and Evaluation, 8(2), 338–349. https://doi.org/10.23887/jere.v8i2.69259
Farida, R., Alba, A., Kurniawan, R., & Zainuddin, Z. (2019). Pengembangan Model Pembelajaran Flipped Classroom Dengan Taksonomi Bloom Pada Mata Kuliah Sistem Politik Indonesia. Kwangsan: Jurnal Teknologi Pendidikan, 7(2), 104-122. https://doi.org/10.31800/jtp.kw.v7n2.p104--122
Febriani, Jumadi, J., & Dwandaru, W. S. B. (2023). Socio-scientific issues in physics learning to improve students’ critical thinking skills. Revista Mexicana de Física E, 20(1), 1–6. https://doi.org/10.31349/RevMexFisE.20.010202
Fihani, N., Hikmawati, V. Y., & Mu’minah, I. H. (2021). Pendekatan Socio-Scientific Issue (SSI) untuk Meningkatkan Keterampilan Berpikir Kritis Siswa SMA pada Konsep Virus. Prosiding Seminar Nasional Pendidikan, 3, 186–192.
Fita, M. N., Jatmiko, B., & Sudibyo, E. (2021). The Effectiveness of Problem Based Learning (PBL) Based Socioscientific Issue (SSI) to Improve Critical Thinking Skills. Studies in Learning and Teaching, 2(3), 1–9. https://doi.org/10.46627/silet.v2i3.71
Fithriyah, I., & Sa’dijah, C. (2016). Analisis kemampuan berpikir kritis siswa kelas IX-D SMPN 17 Malang.
Fitriani, E., & Festiyed, F. (2023). The effect of STEM integrated physics E-Modules to improve critical thinking ability of class XI studentd of SMAN 2 Lubuk Sikaping. Physics Learning and Education, 1(2), 124–129. https://doi.org/10.24036/ple.v1i2.57
Fitriyani, F., Atmojo, I. R. W., & Yamtinah, S. (2025). Socio Scientific Issue Approach to Enhance Critical Thinking Skills: A Prisma Systematic Literature Review. Multidisciplinar (Montevideo), 3(3), 1-10. https://doi.org/10.62486/agmu2025212
González-Pérez, L. I., & Ramírez-Montoya, M. S. (2022). Components of Education 4.0 in 21st century skills frameworks: systematic review. Sustainability, 14(3), 1-31. https://doi.org/10.3390/su14031493
Jamil, M., Hafeez, F. A., & Muhammad, N. (2024). Critical thinking development for 21st century: Analysis of Physics curriculum. Journal of Social & Organizational Matters, 3(1), 1–10.
Jusup, M., Holme, P., Kanazawa, K., Takayasu, M., Romić, I., Wang, Z., Geček, S., Lipić, T., Podobnik, B., & Wang, L. (2022). Social physics. Physics Reports, 948, 1–148. https://doi.org/10.1016/j.physrep.2021.10.005
Kalkbrenner, M. T. (2021). A Practical Guide to Instrument Development and Score Validation in the Social Sciences: The MEASURE Approach. Practical Assessment, Research & Evaluation, 26, 1.
Khoiri, Affandi, A. (2023). Model ILESSI-DCF “Inquiry Lesson based Ethno Socioscientific Issues-Dieng Culture Festival.” Perkumpulan Rumah Cemerlang Indonesia.
Kleemola, K., Hyytinen, H., & Toom, A. (2022). Exploring internal structure of a performance-based critical thinking assessment for new students in higher education. Assessment & Evaluation in Higher Education, 47(4), 556–569. https://doi.org/10.1080/02602938.2021.1946482
Linacre, J. M. (2009). Unidimensional models in a multidimensional world. Rasch Measurement Transactions, 23(2), 1209.
Linacre, J. M. (2012). Winsteps® Rasch measurement computer program user’s guide. Beaverton, Oregon: Winsteps. Com.
López-Fernández, M. del M., Gonzalez-Garcia, F., & Franco-Mariscal, A. J. (2022). How can socio-scientific issues help develop critical thinking in chemistry education? A reflection on the problem of plastics. Journal of Chemical Education, 99(10), 3435–3442. https://doi.org/10.1021/acs.jchemed.2c00223
Mardianto. (2019). Peran Guru Di Era Digital Dalam Mengembangkan Self Regulated Learning Siswa Generasi Z Untuk Pencapaian Hasil Pembelajaran Optimal. Prosiding Seminar Nasional & Call Paper , 1, 150–158.
Noperi, H., Wiliyanti, V., Yanti, F. A., Syamsuri, M. M. F., & Yusandika, A. D. (2024). Validasi Instrumen Literasi Sains dengan Model Rasch untuk Socio-Scientific Issues. Natural: Jurnal Ilmiah Pendidikan IPA, 11(2), 63–75.
Oktoviani, V., Widoyani, W. L., & Ferdianto, F. (2019). Analisis kemampuan pemahaman matematis siswa SMP pada materi sistem persamaan linear dua variabel. Edumatica : Jurnal Pendidikan Matematika, 9(1), 39–46. https://doi.org/10.22437/edumatica.v9i1.6346
Paul, R., & Elder, L. (2019). The miniature guide to critical thinking concepts and tools. Rowman & Littlefield.
Payan-Carreira, R., Sacau-Fontenla, A., Rebelo, H., Sebastião, L., & Pnevmatikos, D. (2022). Development and validation of a critical thinking assessment-scale short form. Education Sciences, 12(12), 1-19. https://doi.org/10.3390/educsci12120938
Pirinen, P., Lehtinen, A., & Holmes, N. G. (2023). Impact of traditional physics lab instruction on students’ critical thinking skills in a Finnish context. European Journal of Physics, 44(3), 35702.
Prayogi, R. D. (2020). Kecakapan Abad 21: Kompetensi Digital Pendidik Masa Depan. Manajemen Pendidikan, 14(2), 144–151. https://doi.org/10.23917/jmp.v14i2.9486
Putra, P. D. A., Sulaeman, N. F., Supeno, & Wahyuni, S. (2023). Exploring students’ critical thinking skills using the engineering design process in a physics classroom. The Asia-Pacific Education Researcher, 32(1), 141–149. https://doi.org/10.1007/s40299-021-00640-3
Putri, J. K., Gunawan, C. W., & Wiyatmo, Y. (2024). Implementation of guided inquiry to increase students’ interest in learning physics and critical thinking skills. Jurnal Pendidikan Fisika Dan Teknologi, 10(2), 257–263. https://doi.org/10.29303/jpft.v10i2.7091
Quinn, S., Hogan, M., Dwyer, C., Finn, P., & Fogarty, E. (2020). Development and validation of the student-educator negotiated critical thinking dispositions scale (SENCTDS). Thinking Skills and Creativity, 38(1), 1-17. https://doi.org/10.1016/j.tsc.2020.100710
Rahayu, S., & Rosawati, E. E. (2023). The development of higher-order thinking skills (HOTS) assessment instrument in chemistry using socioscientific issues context: A preliminary trial. AIP Conference Proceedings, 3(1), 1-10.
Rapi, N. K., Suastra, I. W., Widiarini, P., & Widiana, I. W. (2022). The influence of flipped classroom-based project assessment on concept understanding and critical thinking skills in physics learning. Jurnal Pendidikan IPA Indonesia, 11(3), 351–362. https://doi.org/10.15294/jpii.v11i3.38275
Sadler, T. D. (2004). Informal reasoning regarding socioscientific issues: A critical review of research. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching, 41(5), 513–536. https://doi.org/10.1002/tea.20009
Sahin Kursad, M., & Yalcin, S. (2024). Effect of Differential Item Functioning on Computer Adaptive Testing Under Different Conditions. Applied Psychological Measurement, 48(7–8), 303–322. https://doi.org/10.1177/01466216241284295
Sari, E., Suryawati, E., & Mahadi, I. (2024). Diagnostic assessment to identify learning styles and critical thinking in independent learning Abstract : 10(3), 860–873. https://doi.org/10.22219/jpbi.v10i3.36557
Scott, I. A., Hubbard, R. E., Crock, C., Campbell, T., & Perera, M. (2021). Developing critical thinking skills for delivering optimal care. Internal Medicine Journal, 51(4), 488–493. https://doi.org/10.1111/imj.15272
Silber‐Varod, V., Eshet‐Alkalai, Y., & Geri, N. (2019). Tracing research trends of 21st‐century learning skills. British Journal of Educational Technology, 50(6), 3099–3118. https://doi.org/10.1111/bjet.12753
Solihin, R. R., Susanto, T. T. D., Fauziyah, E. P., Yanti, N. V. I., & Ramadhania, A. P. (2024). The Efforts of Indonesian Government In Increasing Teacher Quality Based On PISA Result In 2022: A Literature Review. Perspektif Ilmu Pendidikan, 38(1), 57–65. https://doi.org/10.21009/PIP.381.6
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan. Trim komunikata.
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J.-M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., & Mourey, F. (2023). Creativity, critical thinking, communication, and collaboration: Assessment, certification, and promotion of 21st century skills for the future of work and education. Journal of Intelligence, 11(3), 1-32. https://doi.org/10.3390/jintelligence11030054
Umami, R., Rusdi, M., & Kamid, K. (2021). Pengembangan instrumen tes untuk mengukur higher order thinking skills (HOTS) berorientasi programme for international student asessment (PISA) pada peserta didik. JP3M (Jurnal Penelitian Pendidikan Dan Pengajaran Matematika), 7(1), 57–68. https://doi.org/10.37058/jp3m.v7i1.2069
Viehmann, C., Fernández Cárdenas, J. M., & Reynaga Peña, C. G. (2024). The Use of Socioscientific Issues in Science Lessons: A Scoping Review. Sustainability (Switzerland), 16(14), 1-29. https://doi.org/10.3390/su16145827
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Dewi Tri Wulandari, Rahma Diani , Hendri Noperi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All articles published in the Journal Corner of Education, Linguistics, and Literature are licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA).
