The Use of Technology at the Higher Education Level and Student Engagement: A Meta-Analysis
DOI:
https://doi.org/10.12928/jehcp.v1i2.24606Abstract
Student engagement is a recognized factor in higher education, and its importance in students' academic success has led to increased attention. While many studies have explored the impact of technology on student engagement, no meta-analysis studies have been conducted at the higher education level to the best of the researcher's knowledge. This study aims to critically evaluate the influence of technology on student engagement within the context of learning in Indonesia. A systematic review and assessment were conducted using seven databases and two search engines. This meta-analysis study includes 5 studies with 710 subjects. Although the 5 studies indicate that technology use can enhance student engagement, the results do not yield a common effect size. Furthermore, one study presents inconclusive findings. Therefore, further research is necessary to investigate this variable by implementing more appropriate research procedures.
Keywords: technology use, meta-analysis, student engagementReferences
Adisel, A., & Prananosa, A. G. (2020). Penggunaan teknologi informasi dan komunikasi dalam sistem manajemen pembelajaran pada masa pandemi covid 19. Journal of Administration and Educational Management, 3(1), 1–10. https://doi.org/10.31539/alignment.v3i1.1291
Ahlfeldt, S., Mehta, S., & Sellnow, T. (2005). Measurement and analysis of student engagement in university classes where varying levels of PBL methods of instruction are in use. Higher Education Research and Development, 24(1), 5–20. https://doi.org/10.1080/0729436052000318541
Amelia, K. N. (2021). Technology use and student engagement during COVID-19: The case of online EFL classes. Journal of Asia TEFL, 18(4), 1413–1422. https://doi.org/10.18823/asiatefl.2021.18.4.21.1413
Ariyanti, I., Fikrie, & Hariyono, S. D. (2022). Students’ engagement dalam proses pembelajaran daring melalui lesson study pada mata kuliah kalkulus integral. Jurnal Cendekia: Jurnal Pendidikan Matematika, 6(1), 824–836.
Beetham, H., & Sharpe, R. (2013). Rethinking pedagogy for a digital age designing for 21st century learning. In Rethinking Pedagogy for a Digital Age: Designing for 21st Century Learning. Routledge. https://doi.org/10.4324/9780203078952
Berman, N. G., & Parker, R. A. (2002). Meta-analysis: Neither quick nor easy. In BMC Medical Research Methodology. http://www.biomedcentral.com/1471-2288/2/10
Bundick, M. J., Quaglia, R. J., Corso, M. J., & Haywood, D. E. (2014). Promoting student engagement in the classroom. Teachers College Record, 116(4).
Cayubit, R. F. O. (2021). Why learning environment matters? An analysis on how the learning environment influences the academic motivation, learning strategies and engagement of college students. Learning Environments Research. https://doi.org/10.1007/s10984-021-09382-x
Cohen, J. (1992). Statistical power analysis. Current Directions in Psychological Science, 1(3), 98–101. https://doi.org/10.1111/1467-8721.ep10768783
Deeks, J. J., Higgins, J. P. T., & Altman, D. G. (2022). Analysing data and undertaking meta-analyses. In J. P. T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. J. Page, & V. A. Welch (Eds.), Cochrane handbook for systematic reviews of interventions (2nd ed.). Wiley-Blackwell.
Dixson, M. D. (2015). Measuring student engagement in the online course: The online student engagement scale (OSE). Online Learning Journal, 19(4). https://doi.org/10.24059/olj.v19i4.561
Farr, T. (2014). The importance of environment in education. https://blog.udemy.com/importance-of-environment/
Fatawi, I., Degeng, I. N. S., Setyosari, P., Ulfa, S., & Hirashima, T. (2020). Effect of online-based concept map on student engagement and learning outcome. International Journal of Distance Education Technologies, 18(3), 42–56. https://doi.org/10.4018/IJDET.2020070103
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Fredricks, J. A., Blumenfeld, P., Friedel, J., & Paris, A. (2005). School engagement. In K. A. Moore & L. H. Lippman (Eds.), What do children need to flourish? Conceptualizing and measuring indicators of positive development (pp. 305–321). Springer. https://doi.org/10.1007/0-387-23823-9_19
Gebre, E., Saroyan, A., & Bracewell, R. (2014). Students’ engagement in technology rich classrooms and its relationship to professors’ conceptions of effective teaching. British Journal of Educational Technology, 45(1), 83–96. https://doi.org/10.1111/bjet.12001
Gillett-Swan, J. (2017). The challenges of online learning supporting and engaging the isolated learner. Journal of Learning Design, 10(1), 20–30.
Glynn, L. (2006). A critical appraisal tool for library and information research. Library Hi Tech, 24(3), 387–400. https://doi.org/10.1108/07378830610692154
Gunuc, S., & Kuzu, A. (2015a). Confirmation of campus-class-technology model in student engagement: A path analysis. Computers in Human Behavior, 48, 114–125. https://doi.org/10.1016/j.chb.2015.01.041
Gunuc, S., & Kuzu, A. (2015b). Student engagement scale: Development, reliability and validity. Assessment and Evaluation in Higher Education, 40(4), 587–610. https://doi.org/10.1080/02602938.2014.938019
Hart, S. R., Stewart, K., & Jimerson, S. R. (2011). The student engagement in schools questionnaire (SESQ) and the teacher engagement report form-new (TERF-N): Examining the preliminary evidence. Contemporary School Psychology, 15(1), 67–79. https://doi.org/10.1007/BF03340964
Henderson, M., Selwyn, N., Finger, G., & Aston, R. (2015). Students’ everyday engagement with digital technology in university: Exploring patterns of use and ‘usefulness.’ Journal of Higher Education Policy and Management, 37(3), 308–319. https://doi.org/10.1080/1360080X.2015.1034424
Higgins, J., Thomas, J., Chandler, J., Cumpston, M., Li, T., & Page, M. (2022). Cochrane handbook for systematic reviews of interventions (Welch VA, Ed.; Version 6.3). www.training.cochrane.org/handbook.
Kahn, P. E. (2014). Theorising student engagement in higher education. British Educational Research Journal, 40(6), 1005–1018. https://doi.org/10.1002/berj.3121
Kirkwood, A., & Price, L. (2014). Technology-enhanced learning and teaching in higher education: what is “enhanced” and how do we know? A critical literature review. Learning, Media and Technology, 39(1), 6–36. https://doi.org/10.1080/17439884.2013.770404
Kristianto, H., & Gandajaya, L. (2021). Offline vs online problem-based learning: a case study of student engagement and learning outcomes. Interactive Technology and Smart Education. https://doi.org/10.1108/ITSE-09-2021-0166
Lacka, E., Wong, T. C., & Haddoud, M. Y. (2021). Can digital technologies improve students’ efficiency? Exploring the role of Virtual Learning Environment and Social Media use in Higher Education. Computers and Education, 163. https://doi.org/10.1016/j.compedu.2020.104099
López, O. S. (2010). The digital learning classroom: Improving english language learners’ academic success in mathematics and reading using interactive whiteboard technology. Computers and Education, 54(4), 901–915. https://doi.org/10.1016/j.compedu.2009.09.019
Losh, E. (2014). The war on learning: Gaining ground in the digital university. The MIT Press.
Majid, U. (2018). Research fundamentals: Study design, population, and sample size. Undergraduate Research in Natural and Clinical Science and Technology (URNCST) Journal, 2(1), 1–7. https://doi.org/10.26685/urncst.16
Maroco, J., Maroco, A. L., Campos, J. A. D. B., & Fredricks, J. A. (2016). University student’s engagement: Development of the university student engagement inventory (USEI). Psicologia: Reflexao e Critica, 29(1), 1–12. https://doi.org/10.1186/s41155-016-0042-8
Mikolajewicz, N., & Komarova, S. v. (2019). Meta-analytic methodology for basic research: A practical guide. Frontiers in Physiology, 10. https://doi.org/10.3389/fphys.2019.00203
Mutiara, T., & Kusumawardhani, D. (2020). Hubungan intensitas penggunaan teknologi informasi dan komunikasi dengan keterlibatan belajar mahasiswa generasi z. Edcomtech Jurnal Kajian Teknologi Pendidikan, 5(1), 192–201. https://doi.org/10.17977/um039v5i22020p192
Noviati, N. P. (2018). Psychological capital, technology and media usage, student engagement, and performance academic: Empirical study on university students. Advanced Science Letters, 24(7), 5389–5394. https://doi.org/10.1166/asl.2018.11741
Oetomo, B. S. D., & Santoso, S. (2022). The influences of the learners ability and the information technology on the learning effectiveness in the e-learning era. International Journal of Information, Business and Management, 14(2), 128–139.
Prasetyawati, O. A., & Ardi, P. (2020). Integrating instagram into EFL writing to foster student engagement. Teaching English with Technology, 20(3), 40–62. http://www.tewtjournal.org
Rahayu, T., Mudofir, I., & Sutantohadi, A. (2019). Flipped instruction for speaking class: A Classroom action research for enhancing students’ engagement. Humaniora Scientia: Online Journal on Linguistics, Literature, and Translation, 05(1), 40–47.
Rashid, T., & Asghar, H. M. (2016). Technology use, self-directed learning, student engagement and academic performance: Examining the interrelations. Computers in Human Behavior, 63, 604–612. https://doi.org/10.1016/j.chb.2016.05.084
Robinson, C. (2012). Student engagement: What does this mean in practice in the context of higher education institutions? Journal of Applied Research in Higher Education, 4(2), 94–108. https://doi.org/10.1108/17581181211273039
Rosen, L. D., Whaling, K., Carrier, L. M., Cheever, N. A., & Rokkum, J. (2013). The media and technology usage and attitudes scale: An empirical investigation. Computers in Human Behavior, 29(6), 2501–2511. https://doi.org/10.1016/j.chb.2013.06.006
Rustandi, D. (2020, June). Penggunaan teknologi pembelajaran sebagai bagian hadapi kondisi kenormalan baru dunia pendidikan tinggi. Kementrian Pendidikan Dan Kebudayaan. https://dikti.kemdikbud.go.id/kabar-dikti/kabar/penggunaan-teknologi-pembelajaran-sebagai-bagian-hadapi-kondisi-kenormalan-baru-dunia-pendidikan-tinggi/
Sánchez-Meca, J., & Marín-Martínez, F. (2010). Meta-analysis in psychological research. International Journal of Psychological Research, 3(1), 150–162. https://doi.org/10.21500/20112084.860
Selwyn, N. (2016). Digital downsides: exploring university students’ negative engagements with digital technology. Teaching in Higher Education, 21(8), 1006–1021. https://doi.org/10.1080/13562517.2016.1213229
Skinner, E. A., & Pitzer, J. R. (2012). Developmental dynamics of student engagement, coping, and everyday resilience. In S. L. Christenson, C. Wylie, & A. L. Reschly (Eds.), Handbook of Research on Student Engagement (pp. 21–44). Springer. https://www.researchgate.net/publication/310773130
Sun, J. C. Y., & Rueda, R. (2012). Situational interest, computer self-efficacy and self-regulation: Their impact on student engagement in distance education. British Journal of Educational Technology, 43(2), 191–204. https://doi.org/10.1111/j.1467-8535.2010.01157.x
Yanto, H., Hidayah, R., Hajawiyah, A., Baroroh, N., & Wibowo, A. (2021). Developing operational accounting competencies during the pandemic using emergency online learning. Cogent Education, 8(1), 1–18. https://doi.org/10.1080/2331186X.2021.1926405
Zainuddin, Z., Farida, R., Keumala, C. M., Kurniawan, R., & Iskandar, H. (2021). Synchronous online flip learning with formative gamification quiz: instruction during COVID-19. Interactive Technology and Smart Education, 19(2), 236–259. https://doi.org/10.1108/ITSE-01-2021-0002
Zainuddin, Z., Hermawan, H. D., Fauzan, M. Y., & Prayitno, S. M. (2019). Students’ perceived engagement in a technology-enhanced flipped language classroom. 2019 5th International Conference on Education and Technology, ICET 2019, 1–5. https://doi.org/10.1109/ICET48172.2019.8987226
