ror.org/01f5wp925
Résumés
Abstract
This work discusses a nudging intervention mechanism combined with an artificial intelligence (AI) system for early detection of learners’ risk of failing or dropping out. Different types of personalized nudges were designed according to educational principles and the learners’ risk classification. The impact on learners’ performance, dropout reduction, and satisfaction was evaluated through a study with 252 learners in a first-year course at a fully online university. Different learners’ groups were designed, with each receiving a different set of nudges. Results showed that nudges positively impacted the learners’ performance and satisfaction, and reduced dropout rates. The impact significantly increased when different types of nudges were provided. Our research reinforced the role of AI as useful in online, distance, and open learning for providing timely learner support, improved learning experiences, and enhanced learner-teacher communication.
Keywords:
- artificial intelligence,
- early warning system,
- nudges,
- at-risk learners,
- online learning
Veuillez télécharger l’article en PDF pour le lire. Télécharger
Parties annexes
Bibliography
- Ajjawi, R., & Boud, D. (2018). Examining the nature and effects of feedback dialogue. Assessment and Evaluation in Higher Education, 43(7), 1106-1119. https://doi.org/10.1080/02602938.2018.143412810.1080/02602938.2018.1434128 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Arnold, K. E., & Pistilli, M. D. (2012, April 29). Course signals at Purdue: Using learning analytics to increase student success. In S. Dawson, C. Haythornthwaite, S. B. Shum, D. Gasevic & R. Ferguson (Eds.), Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267-270). Association for Computing Machinery. https://doi.org/10.1145/2330601.233066610.1145/2330601.2330666 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Baneres, D., Rodríguez, M. E., Guerrero-Roldán, A. E., & Karadeniz, A. (2020). An early warning system to detect at-risk students in online higher education. Applied Sciences (Switzerland), 10(13), 4427. https://doi.org/10.3390/app1013442710.3390/app10134427 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Barr, V. (2014, December 1). Women in STEM, women in computer science: We’re looking at it incorrectly. Blog@CACM. https://cacm.acm.org/blogs/blog-cacm/180850-women-in-stem-women-in-computer-science-were-looking-at-it-incorrectly/Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Benartzi, S., Beshears, J., Milkman, K. L., Sunstein, C. R., Thaler, R. H., Shankar, M., Tucker-Ray, W., Congdon, W. J., & Galing, S. (2017). Should governments invest more in nudging? Psychological Science, 28(8), 1041-1055. https://doi.org/10.1177/095679761770250110.1177/0956797617702501 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Bucher, T., Collins, C., Rollo, M. E., McCaffrey, T. A., De Vlieger, N., Van der Bend, D., Truby, H., & Perez-Cueto, F. J. A. (2016). Nudging consumers towards healthier choices: A systematic review of positional influences on food choice. British Journal of Nutrition, 115(12), 2252-2263. https://doi.org/10.1017/S000711451600165310.1017/s0007114516001653 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Caraban, A., Karapanos, E., Gonçalves, D., & Campos, P. (2019, May 2). 23 ways to nudge: A review of technology-mediated nudging in human-computer interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (article 503). Association for Computing Machinery. https://doi.org/10.1145/3290605.330073310.1145/3290605.3300733 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Castro, R. (2019). Blended learning in higher education: Trends and capabilities. Education and Information Technologies, 24(4), 2523-2546. https://doi.org/10.1007/s10639-019-09886-3Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Chassignol, M., Khoroshavin, A., Klimova, A., & Bilyatdinova, A. (2018). Artificial intelligence trends in education: A narrative overview. Procedia Computer Science, 136, 16-24. https://doi.org/10.1016/j.procs.2018.08.23310.1016/j.procs.2018.08.233 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264-75278. https://doi.org/10.1109/ACCESS.2020.298851010.1109/access.2020.2988510 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Cheung, L. L. W., & Kan, A. C. N. (2002). Evaluation of factors related to student performance in a distance-learning business communication course. Journal of Education for Business, 77(5), 257-263. https://doi.org/10.1080/0883232020959967410.1080/08832320209599674 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Clarizia, F., Colace, F., Lombardi, M., Pascale, F., & Santaniello, D. (2018, September 23). Chatbot: An education support system for student. In A. Castiglione, F. Pop, M. Ficco & F. Palmieri (Eds.), Cyberspace Safety and Security, CSS 2018 (Lecture Notes in Computer Science, Vol. 11161, pp. 291-302). Springer. https://doi.org/10.1007/978-3-030-01689-0_2310.1007/978-3-030-01689-0_23 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Damgaard, M. T., & Nielsen, H. S. (2018). Nudging in education. Economics of Education Review, 64, 313-342. https://doi.org/10.1016/j.econedurev.2018.03.008Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Didia, D., & Hasnat, B. (1998). The determinants of performance in the university introductory finance course. Financial Practice & Education, 8(1), 102-107.Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Eom, S. B., Wen, H. J., & Ashill, N. (2006). The determinants of students’ perceived learning outcomes and satisfaction in university online education: An empirical investigation. Decision Sciences Journal of Innovative Education, 4(2), 215-235. https://doi.org/10.1111/j.1540-4609.2006.00114.x10.1111/j.1540-4609.2006.00114.x Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Grau-Valldosera, J., MinguillÓn, J., & Blasco-Moreno, A. (2019). Returning after taking a break in online distance higher education: from intention to effective re-enrollment. Interactive Learning Environments, 27(3), 307-323. https://doi.org/10.1080/10494820.2018.147098610.1080/10494820.2018.1470986 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Hummel, D., & Maedche, A. (2019). How effective is nudging? A quantitative review on the effect sizes and limits of empirical nudging studies. Journal of Behavioral and Experimental Economics, 80, 47-58. https://doi.org/10.1016/j.socec.2019.03.00510.1016/j.socec.2019.03.005 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Kraft, M. A., & Rogers, T. (2015). The underutilized potential of teacher-to-parent communication: Evidence from a field experiment. Economics of Education Review, 47, 49-63. https://doi.org/10.1016/j.econedurev.2015.04.00110.1016/j.econedurev.2015.04.001 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Kruskal, W. H. (1957). Historical notes on the Wilcoxon Unpaired Two-Sample Test. Journal of the American Statistical Association, 52(279), 356-360. https://doi.org/10.1080/01621459.1957.1050139510.1080/01621459.1957.10501395 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Márquez-Vera, C., Cano, A., Romero, C., Noaman, A. Y. M., Mousa Fardoun, H., & Ventura, S. (2016). Early dropout prediction using data mining: A case study with high school students. Expert Systems, 33(1), 107-124. https://doi.org/10.1111/exsy.1213510.1111/exsy.12135 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Martínez-Argüelles, M. J., Plana, D., Hintzmann, C., Batalla-Busquets, J. M., & Badia, M. (2015). Usefulness of feedback in e-learning from the students’ perspective. Intangible Capital, 11(4), 627-645. https://doi.org/10.3926/ic.62210.3926/ic.622 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Martinez, I. (2014). The effects of nudges on students’ effort and performance: Lessons from a MOOC (EdPolicyWorks Working Paper Series No. 19). https://education.virginia.edu/sites/default/files/files/EdPolicyWorks_files/19_Martinez_Lessons_from_a_MOOC.pdfGoogle Scholar Rechercher cette référence bibliographique sur Google Scholar
- Mitrovic, A., Gordon, M., Piotrkowicz, A., & Dimitrova, V. (2019, June 21). Investigating the effect of adding nudges to increase engagement in active video watching. In S. Isotani, E. Millán, A. Ogan, P. Hastings, B. McLaren & R. Luckin (Eds.), Artificial Intelligence in Education, AIED 2019 (Lecture Notes in Computer Science, Vol. 11624, pp. 320-332). Springer. https://doi.org/10.1007/978-3-030-23204-7_2710.1007/978-3-030-23204-7_27 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Oates, B. J. (2006). Researching information systems and computing. SAGE.Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Ortigosa, A., Carro, R. M., Bravo-Agapito, J., Lizcano, D., Alcolea, J. J., & Blanco, Ó. (2019). From lab to production: Lessons learnt and real-life challenges of an early student-dropout prevention system. IEEE Transactions on Learning Technologies, 12(2), 264-277. https://doi.org/10.1109/TLT.2019.291160810.1109/tlt.2019.2911608 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Piotrkowicz, A., Dimitrova, V., Hallam, J., & Price, R. (2020, July 14). Towards personalisation for learner motivation in healthcare: A study on using learner characteristics to personalise nudges in an e-learning context. Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization, (pp. 287-292). https://doi.org/10.1145/3386392.339929010.1145/3386392.3399290 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Reimann, N., Sadler, I., & Sambell, K. (2019). What’s in a word? Practices associated with ‘feedforward’ in higher education. Assessment and Evaluation in Higher Education, 44(8), 1279-1290. https://doi.org/10.1080/02602938.2019.160065510.1080/02602938.2019.1600655 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Rodríguez, M. E., Guerrero-Roldán, A. E., Baneres, D., & Karadeniz, A. (2019, November). Towards an intervention mechanism for supporting learners performance in online learning. Proceedings of the 12th Annual International Conference of Education, Research and Innovation, ICERI 2019 (pp. 5136-5145). Seville, Spain. https://doi.org/10.21125/iceri.2019.124410.21125/iceri.2019.1244 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal. Assessment and Evaluation in Higher Education, 35(5), 535-550. https://doi.org/10.1080/0260293090354101510.1080/02602930903541015 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Siemens, G., & Baker, R. S. J. D. (2012, April 29). Learning analytics and educational data mining: Towards communication and collaboration. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 252-254). Association for Computing Machinery. https://doi.org/10.1145/2330601.233066110.1145/2330601.2330661 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Sparks, C., Dimmock, J., Whipp, P., Lonsdale, C., & Jackson, B. (2015). “Getting connected”: High school physical education teacher behaviors that facilitate students’ relatedness support perceptions. Sport, Exercise, and Performance Psychology, 4(3), 219-236. https://doi.org/10.1037/spy000003910.1037/spy0000039 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Sunstein, C. R. (2015). Which nudges do people like? A national survey. Social Science Research Network. https://doi.org/10.2139/ssrn.2619899Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- van Oldenbeek, M., Winkler, T. J., Buhl-Wiggers, J., & Hardt, D. (2019, May 15). Nudging in blended learning: Evaluation of email-based progress feedback in a flipped-classroom information systems course. Proceedings of the 27th European Conference on Information Systems, ECIS (article 186). AIS eLibrary. https://aisel.aisnet.org/ecis2019_rp/186Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Vasquez, H., Fuentes, A. A., Kypuros, J. A., & Azarbayejani, M. (2015, December 7). Early identification of at-risk students in a lower-level engineering gatekeeper course. In 2015 IEEE Frontiers in Education Conference, FIE (vol. 2015, pp. 1-9). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FIE.2015.734436110.1109/fie.2015.7344361 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- Weijers, R. J., de Koning, B. B., & Paas, F. (2020). Nudging in education: From theory towards guidelines for successful implementation. European Journal of Psychology of Education, 36, 883-902. https://doi.org/10.1007/s10212-020-00495-010.1007/s10212-020-00495-0 Google Scholar Rechercher cette référence bibliographique sur Google Scholar
- York, B., Loeb, S., & Doss, C. (2019). One step at a time: The effects of an early literacy text-messaging program for parents of preschoolers. Journal of Human Resources, 54(3), 537-566. https://doi.org/10.3368/jhr.54.3.0517-8756R10.3368/jhr.54.3.0517-8756r Google Scholar Rechercher cette référence bibliographique sur Google Scholar