Analysis of Multiple Choice HOTS Test Questions on the Final Semester Assessment
Abstract
Assessment is essential in the education system to monitor educational development and make appropriate instructional decisions. This study aims to analyze the quality of multiple choice questions based on high-level thinking skills (HOTS) in the Geography subject using Anates Windows Version 4.0.9 software. This evaluative research involves analysis of final semester exam questions for class X Geography at SMA Islam Al Azhar 14 Semarang. Data consisting of questions, answer keys and exam results were collected from 32 students. The analysis was carried out descriptively and quantitatively to assess the level of difficulty, discriminating power, reliability, effectiveness of distractors, and validity of the questions. The analysis results show that the difficulty level of most of the questions is in the medium category (50%). The discriminating power is mostly good, although several questions are wrong or bad. Most of the distractors worked well, but some questions had ineffective distractors. Regarding validity, 17 questions were valid, while 11 questions were invalid. The reliability of the test is in the high category, with a reliability coefficient of 0.71. Anates Windows Version 4.0.9 software effectively analysed the quality of HOTS questions. These findings indicate that although most of the questions are of good quality, some require revision to increase their validity and effectiveness. This research emphasizes the importance of using technology in educational assessment to ensure the quality and fairness of exam questions. It contributes to developing assessment tools to improve students' higher-order thinking skills.
Keywords: Item Analysis; Multiple Choice; HOTS; SMA Islam Al-Azhar
Full Text:
PDFReferences
Am, Z. (2018). Teknik penilaian hasil pembelajaran. Rausyan Fikr: Jurnal Pemikiran Dan Pencerahan, 14(02). https://doi.org/10.31000/rf.v14i02.901
Anderson, L. W., & Krathwohl, D. R. (2021). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman.
Arafah, K., Amin, B. D., Sari, S. S., & Hakim, A. (2021). The development of higher order-thinking skills (HOTS) instrument assessment in physics study. Journal of Physics: Conference Series, 1899(1), 012140. https://doi.org/10.1088/1742-6596/1899/1/012140
Arif, M. (2014). Penerapan aplikasi anates bentuk soal pilihan ganda. Jurnal Ilmiah Edutic: Pendidikan Dan Informatika, 1(1). https://doi.org/10.21107/edutic.v1i1.398
Arifin, Z., & Retnawati, H. (2015). Analisis Instrumen Pengukur Higher Order Thinking Skills (HOTS) Matematika Siswa SMA. Seminar Nasional Matematika Dan Pendidikan Matematika Uny, 20, 783–790.
Balitbang-Depdiknas, P. P. P. (2007). Panduan Penulisan Soal Pilihan Ganda. Depdiknas. Jakarta.
Brown, G. T. L. (2022). The past, present and future of educational assessment: A transdisciplinary perspective. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.1060633
Brown, G. T. L., & Abdulnabi, H. H. A. (2017). Evaluating the quality of higher education instructor-constructed multiple-choice tests: Impact on student grades. Frontiers in Education, 2, 24. https://doi.org/10.3389/feduc.2017.00024
Butler, A. C. (2018). Multiple-choice testing in education: Are the best practices for assessment also good for learning? Journal of Applied Research in Memory and Cognition, 7(3), 323–331. https://doi.org/10.1016/j.jarmac.2018.07.002
Fink, A. (2010). Survey Research Methods. In International Encyclopedia of Education (pp. 152–160). Elsevier. https://doi.org/10.1016/B978-0-08-044894-7.00296-7
Gusmizain, A. (2022). KARAKTERISTIK BUTIR SOAL TES MATA KULIAH MATRIKS & RUANG VEKTOR MAHASISWA MATEMATIKA. Jurnal Evaluasi Pendidikan, 13(2), 127–130. https://doi.org/10.21009/jep.v13i2.28328
Himmah, E. F., Yuliarti, Y., Elmayantie, C., & Rusdiana, L. (2021). Peningkatan Profesionalisme Guru Smk Negeri-1 Palangka Raya Melalui Bimbingan Penelitian Tindakan Kelas. RESWARA: Jurnal Pengabdian Kepada Masyarakat, 2(2), 155–161. https://doi.org/10.46576/rjpkm.v2i2.883
Jaenudin, R., Chotimah, U., Farida, F., & Syarifuddin, S. (2020). Student development zone: higher order thinking skills (HOTS) in critical thinking orientation. International Journal of Multicultural and Multireligious Understanding, 7(9), 11–19. https://doi.org/10.18415/ijmmu.v7i9.1884
Jati, P., Alawiati, A., Jibril, A., Mudin, A., & Prisma, C. (2023). ANALISIS KUALITAS BUTIR SOAL GEOGRAFI. Jurnal Pendidikan Geosfer, VIII. https://doi.org/10.24815/jpg.v%vi%i.32500
Javaeed, A. (2018). Assessment of higher ordered thinking in medical education: multiple choice questions and modified essay questions. MedEdPublish, 7. https://doi.org/10.15694/mep.2018.0000128.1
Jihad, A., & Haris, A. (2008). Evaluasi Pembelajaran. PT Raja Grafindo Pustaka.
Karno To. (1996). Mengenal Analisis Tes. Fakultas Ilmu Pendidikan IKIP Bandung.
Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and reliability of measurement instruments used in research. American Journal of Health-System Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364
Kusainun, N. (2020). Analisis Standar Penilaian Pendidikan di Indonesia. JP (Jurnal Pendidikan): Teori Dan Praktik, 5(1). https://doi.org/10.26740/jp.v5n1.p%25p
Larasati, D. A. (2017). Pengaruh Model Problem-Based Learning Terhadap Kemampuan Pemecahan Masalah Geografi Sma. Jurnal Geografi. https://doi.org/10.24114/jg.v9i1.6045
Magdalena, I., Fauziah, S. N., Faziah, S. N., & Nupus, F. S. (2021). Analisis Validitas, Reliabilitas, Tingkat Kesulitan dan Daya Beda Butir Soal Ujian Akhir Semester Tema 7 Kelas III SDN Karet 1 Sepatan. ://ejournal.stitpn.ac.id/index.php/bintang/article/view/1291
Muharromah, M. M., & Humaisi, S. (2020). Analisis Butir Soal Penilaian Ujian Semester Gasal Mata Pelajaran IPS di MTs Darul Muna Ponorogo. ASANKA: Journal of Social Science And Education, 1(2), 102–114. https://doi.org/10.21154/asanka.v1i2.2250
Purwati, L. M., Arianty, R., Syakilah, D. M., Ridlo, S., & Susilaningsih, E. (2021). Analisis Soal Tes Pilihan Ganda Berbasis Higher Order Thinking Skill Menggunakan Aplikasi Anates Windows Versi 4.0. 9 For Windows. Jurnal Pendidikan UNIGA, 15(2), 460–473. https://doi.org/10.52434/jp.v15i2.1287
Rachman, F. J., & Nofrion. (2023). Analisis Kualitas Soal UAS Geografi Kelas XI di SMA Negeri 12 Padang. Journal Of Social Science Research, 3(5). https://doi.org/10.31004/innovative.v3i5.5530
Rahayu, R., & Djazari, M. (2016). Analisis kualitas soal pra ujian nasional mata pelajaran ekonomi akuntansi. Jurnal Pendidikan Akuntansi Indonesia, 14(1). https://doi.org/10.21831/jpai.v14i1.11370
Richard, D. C. S., & Haynes, S. N. (2002). Behavioral Assessment. In Encyclopedia of Psychotherapy (pp. 165–183). Elsevier. https://doi.org/10.1016/B0-12-343010-0/00022-2
Rosyida, F., Zubaidah, S., & Mahanal, S. (2016). Memberdayakan Keterampilan Berpikir Kritis dengan Model Pembelajaran Remap TmPS (Reading Concept Map Timed Pair Share). Biologi, Sains, Lingkungan, Dan Pembelajarannya Dalam Upaya Peningkatan Daya Saing Bangsa, 13(1), 209–214.
Santoso, B. (2007). Penilaian Portofolio Dalam Matematika. Jurnal Pendidikan Matematika, 1(2), 31–38.
Santyadiputra, G. S., Pradnyana, I. M. A., & Juniantari, M. (2019). Efektivitas Pengelolaan Bank Soal Berbasis Examview Bagi Guru-Guru Di SMK Negeri 1 Nusa Penida. WIDYA LAKSANA, 8(1), 51–58. https://doi.org/10.23887/jwl.v8i1.15720
Saraswati, P. M. S., & Agustika, G. N. S. (2020). Kemampuan berpikir tingkat tinggi dalam menyelesaikan soal HOTS mata pelajaran matematika. Jurnal Ilmiah Sekolah Dasar, 4(2), 257–269.
Setiawan, F. (2013). Kemampuan Guru Melakukan Penilaian Dalam Pembelajaran Melalui Internalisasi Nilai Kejujuran Pada Pembelajaran Pendidikan Kewarganegaraan. Jupiis: Jurnal Pendidikan Ilmu-Ilmu Sosial, 5(2), 73–81.
Suciani, A., Irafadillah Effendi, D., & Zulida, E. (2021). Geography Learning Media Based On Character Education In The Digital Revolution Era. Jurnal Geografi. https://doi.org/10.24114/jg.v13i2.20305
Sürücü, L., & Maslakçi, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694–2726. https://doi.org/10.15295/bmij.v8i3.1540
Tangianu, F., Mazzone, A., Berti, F., Pinna, G., Bortolotti, I., Colombo, F., Nozzoli, C., La Regina, M., Greco, A., & Filannino, C. (2018). Are multiple-choice questions a good tool for the assessment of clinical competence in Internal Medicine? Italian Journal of Medicine, 12(2), 88–96.
Warju, W., Ariyanto, S. R., Soeryanto, S., & Trisna, R. A. (2020). Analisis kualitas butir soal tipe HOTS pada kompetensi sistem REM di sekolah menengah kejuruan. Jurnal Pendidikan Teknologi Dan Kejuruan, 17(1), 95–104. https://doi.org/10.23887/jptk-undiksha.v17i1.22914
Wijayanto, B., Wilis, R., Novio, R., Hamka, J., Tawar Padang, A., & Barat, S. (2018). Analisis Technological Pedagogical and Content Knowledge (TPACK) Guru Geografi Di Kabupaten Solok, Sumatera Barat. Jurnal Geografi. 10(2), 105–116. https://doi.org/10.24114/jg.v10i2.9070
Wulandari, A. R., & Pramusinto, H. (2020). Analisis Kualitas Butir Soal Ujian Akhir Semester Ganjil Mata Pelajaran Otomatisasi Tata Kelola Sarana dan Prasarana Kelas XI Otomatisasi dan Tata Kelola Perkantoran. Economic Education Analysis Journal, 9(2), 366–378.
DOI: https://doi.org/10.24114/jg.v16i2.55504
Article Metrics
Abstract view : 159 timesPDF - 26 times
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Accredited Journal, Based on Decree of the Minister of Research, Technology and Higher Education, Republic of Indonesia Number 36/E/KPT/2019
Copyright ©2020 Jurusan Pendidikan Geografi Fakultas Ilmu Sosial Universitas Negeri Medan dan Ikatan Geograf Indonesia (IGI)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.