OPTIMALISASI PENILAIAN KARYA ILMIAH MAHASISWA MELALUI SISTEM EVALUASI DIGITAL UNTUK PENINGKATAN KOMPETENSI MENULIS AKADEMIK PADA PENDIDIKAN TINGGI VOKASI
DOI:
https://doi.org/10.24114/ajs.v15i1.72640Keywords:
Automated Writing Evaluation, Rubrik Penilaian, Pembelajaran Berbasis TeknologiAbstract
Kemampuan menulis akademik merupakan kompetensi penting bagi mahasiswa pendidikan tinggi vokasi karena berkaitan dengan pengembangan berpikir kritis, kejelasan argumentasi ilmiah, dan kesiapan lulusan menghadapi dunia kerja berbasis pengetahuan. Penelitian ini bertujuan untuk menguji validitas dan efektivitas sistem evaluasi digital berbasis rubrik akademik dalam meningkatkan kualitas karya ilmiah mahasiswa vokasi. Penelitian menggunakan pendekatan Research and Development (R&D) dengan model ADDIE. Uji validitas dilakukan oleh ahli materi dan ahli media menggunakan instrumen skala Likert empat tingkat. Hasil validasi menunjukkan tingkat kelayakan sistem sebesar 88,6% dari ahli materi dan 91,2% dari ahli media, yang berada pada kategori sangat valid. Uji efektivitas dilakukan menggunakan desain pre-test dan post-test terhadap 32 mahasiswa vokasi. Analisis kuantitatif menunjukkan adanya peningkatan skor rata-rata kemampuan menulis akademik dari 64,3 pada pre-test menjadi 81,7 pada post-test, dengan nilai N-gain sebesar 0,49 (kategori sedang). Uji statistik menggunakan paired sample t-test menunjukkan perbedaan yang signifikan antara skor pre-test dan post-test (p < 0,05). Peningkatan paling menonjol terjadi pada aspek organisasi teks, koherensi argumentasi, dan ketepatan sitasi. Selain itu, hasil angket persepsi pengguna menunjukkan tingkat respons positif sebesar 89,4%, terutama pada aspek kejelasan umpan balik, objektivitas penilaian, dan efisiensi waktu evaluasi. Temuan ini menunjukkan bahwa sistem evaluasi digital berbasis rubrik akademik valid, efektif, dan layak digunakan sebagai instrumen penilaian dalam pembelajaran menulis akademik di pendidikan tinggi vokasi.References
Azwar, S. (2022). Reliabilitas dan validitas instrumen penelitian pendidikan. Yogyakarta: Pustaka Pelajar.
Basturkmen, H., & von Randow, J. (2021). Students’ challenges in academic writing across disciplines. Journal of English for Academic Purposes, 52, 100978. https://doi.org/10.1016/j.jeap.2021.100978
Branch, R. M. (2023). Instructional design: The ADDIE approach (2nd ed.). Springer.
Cabrera, L., & de la Cruz, P. (2024). AI literacy and academic integrity in higher education: Challenges and implications. Computers & Education, 210, 105061. https://doi.org/10.1016/j.compedu.2024.105061
Cotos, E., Huffman, S., & Link, S. (2024). Automated writing evaluation and formative feedback in higher education. Computers and Composition, 70, 1–15. https://doi.org/10.1016/j.compcom.2023.102075
Din, R., Rahman, N., & Mansor, M. (2021). Academic writing as a disciplinary literacy practice in vocational education. International Journal of Education and Literacy Studies, 9(4), 42–49. https://doi.org/10.7575/aiac.ijels.v.9n.4p.42
Dwivedi, Y. K., Hughes, L., Kar, A. K., & Rana, N. P. (2023). Generative AI for academic writing: Benefits, risks, and implications. International Journal of Information Management, 71, 102665. https://doi.org/10.1016/j.ijinfomgt.2023.102665
Gee, J. P. (2020). Teaching, learning, literacy in our times: A digital world perspective. Routledge. https://doi.org/10.4324/9780429506679
Hasanudin, C., Arsyad, S., & Lestari, I. (2023). Learning materials and their prototypes for academic writing skills in post-COVID-19 era. European Journal of Educational Research, 12(3), 981–995. https://doi.org/10.12973/eu-jer.12.3.981
Huang, S., & Mao, C. (2022). Students’ interaction with automated writing feedback: Balancing form and meaning. Assessing Writing, 51, 100648. https://doi.org/10.1016/j.asw.2021.100648
Hyland, K. (2019). Academic discourse and global publishing: Disciplinary persuasion in changing times. Routledge. https://doi.org/10.4324/9780429439502
Kasneci, E., Sessler, K., & Kasneci, G. (2023). ChatGPT and large language models in education: Opportunities and challenges. Computers and Education: Artificial Intelligence, 4, 100114. https://doi.org/10.1016/j.caeai.2023.100114
Kemendikbudristek. (2022). Strategi transformasi pendidikan vokasi nasional. Direktorat Jenderal Pendidikan Vokasi.
Lea, M. R., & Street, B. (2018). The academic literacies model: Theory and applications. Studies in Higher Education, 43(4), 641–656.
Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking AWE feedback: How teachers and students engage with automated feedback. Language Learning & Technology, 19(2), 50–68.
Link, S., & Cotos, E. (2022). Hybrid feedback in academic writing: Integrating human and automated assessment. Assessing Writing, 51(2), 100657.
Liu, Y., Sun, H., & Wei, X. (2023). Integrating higher-order thinking assessment into automated writing evaluation using deep learning. Educational Technology Research and Development, 71(6), 2899–2916.
Marzuki, A., & Arsyad, S. (2020). Digital rubrics and student motivation in academic writing. Indonesian Journal of Applied Linguistics, 10(2), 371–382.
Miri, F., Azarshahr, H., & Eslami, Z. (2023). Assessing writing in higher education: Insights from Iranian EFL contexts. Assessing Writing, 56, 100667.
Navarro, A., van Dijk, T., & Zhao, H. (2022). Academic literacy in vocational higher education: A meta-analysis of global research. Teaching in Higher Education, 27(3), 305–322.
Pavlik, J. V. (2024). Collaborating with ChatGPT: The future of AI-assisted academic writing. Frontiers in Artificial Intelligence, 7, 156–173.
Perelman, L. (2014). Critique of automated essay scoring systems. Journal of Writing Assessment, 7(1).
Plomp, T., & Nieveen, N. (2019). Educational design research: An introduction. SLO Netherlands Institute for Curriculum Development.
Prihandoko, A. (2022). Academic writing apprehension among vocational students. OKARA Journal of Languages and Literature, 46(2), 213–232.
Rahardjo, A., Sari, R., & Nasution, F. (2022). Analyzing students’ argumentative writing in vocational higher education. Indonesian Journal of Language Education, 10(2), 123–140.
Rahmat, F., Wahyuni, R., & Pangestu, E. (2024). Digital assessment systems for vocational higher education: A pedagogical perspective. International Journal of Vocational Education and Training Research, 10(1), 44–58.
Rohim, M., & Sari, A. (2025). Vocational higher education and national productivity in Indonesia. Journal of Technical and Vocational Education, 15(1), 1–10.
Susanti, R., & Wardhani, E. (2024). Integrating AI tools in academic writing instruction for vocational students. Indonesian Journal of Language Education, 14(1), 22–34.
Wahyuni, R. (2023). Keterampilan menulis akademik dalam pendidikan tinggi: Teori dan praktik. Bandung: Alfabeta.
Warschauer, M., & Grimes, D. (2008). Automated writing assessment in the classroom. Pedagogies: An International Journal, 3(1), 22–36.
Wei, Y. (2024). Peer feedback and writing quality improvement in academic writing classes. Frontiers in Psychology, 15, 1506725. https://doi.org/10.3389/fpsyg.2024.1506725
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2023). Systematic review of AI applications in higher education. International Review of Research in Open and Distributed Learning, 24(2), 96–120.
Zhang, L., Guo, S., & Wu, Y. (2023). Enhancing argumentative coherence through AI-based feedback: A quasi-experimental study. Computer Assisted Language Learning, 36(5), 955–974.
Zhao, L., Li, Q., & Wang, Y. (2023). Academic literacy levels among Chinese vocational students: A mixed-methods study. Asia-Pacific Journal of Cooperative Education, 24(1), 72–88.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
