Learning programming has become more and more popular and organizing introductory massive open online courses (MOOCs) on programming can be one way to bring this education to the masses. While programming MOOCs usually use automated assessment to give feedback on the submitted code, the lack of understanding of certain aspects of the tasks and feedback given by the automated assessment system can be one persistent problem for many participants. This paper introduces troubleshooters, which are help systems, structured like decision trees, for giving hints and examples of certain aspects of the course tasks. The goal of this paper is to give an overview of usability (benefits and dangers) of, and the participants’ feedback on, using troubleshooters. Troubleshooters have been used from the year 2016 in two different programming MOOCs for adults in Estonia. These MOOCs are characterized by high completion rates (50–70%), which is unusual for MOOCs. Data is gathered from the learning analytics integrated into the troubleshooters’ environment, letters from the participants, questionnaires, and tasks conducted through the courses. As it was not compulsory to use troubleshooters, the results indicate that only 19.8% of the users did not use troubleshooters at all and 10% of the participants did not find troubleshooters helpful at all. The main difference that appeared is that the number of questions asked from the organizers about the programming tasks during the courses via helpdesk declined about 29%.
- open education,
- troubleshooting system
Veuillez télécharger l’article en PDF pour le lire.
- Admiraal, W., Huisman, B., & Pilli, O. (2015). Assessment in massive open online courses. Electronic Journal of e-Learning, 13 (4), 207-216.
- Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec. J. (2014). Engaging with massive online courses. In Proceedings of the 23rd International Conference on World Wide Web (WWW '14), 687-698. ACM, New York, NY, USA. doi: 10.1145/2566486.2568042
- Baturay, M. H. (2015). An overview of the world of MOOCs. Procedia - Social and Behavioral Sciences, 174, 427-433. doi: 10.1016/j.sbspro.2015.01.685
- Downes, S. (2017). New models of open and distributed learning. In M. Jemni, Kinshuk, & M. Khribi (Eds.), Lecture notes in educational technology. Open education: from OERs to MOOCs (pp. 1-22). Berlin, Germany: Springer-Verlag. doi: 10.1007/978-3-662-52925-6_1
- Ebben, M., & Murphy, J. S. (2014). Unpacking MOOC scholarly discourse: A review of nascent MOOC scholarship. Learning, Media and Technology, 39 (3), 328-345. doi: 10.1080/17439884.2013.878352
- Garner, S., Haden, P., & Robins, A. (2005). My program is correct but it doesn't run: A preliminary investigation of novice programmers' problems. In Proceedings of the 7th Australasian Conference on Computing Education, 173-180. Retrieved from http://crpit.scem.westernsydney.edu.au/confpapers/CRPITV42Garner.pdf
- Greene, J. A., Oswald, C. A., & Pomerantz, J. (2015). Predictors of retention and achievement in a massive open online course. American Educational Research Journal, 52 (5), 925-955. doi: 10.3102/0002831215584621
- Hanks, B. (2008). Problems encountered by novice pair programmers. Journal on Educational Resources in Computing, 7 (4). doi: 1316450.1316452
- Hew, K. F., & Cheung, W. S. (2014). Students' and instructors' use of massive open online courses (MOOCs): Motivations and challenges. Educational Research Review, 12, 45-58.
- Hone, K. S., & El Said, G. R. (2016). Exploring the factors affecting MOOC retention: A survey study. Computers & Education, 98, 157-168. doi: 10.1016/j.compedu.2016.03.016
- Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15 (1). doi: 10.19173/irrodl.v15i1.1651
- Lepp, M., Luik, P., Palts, T., Papli, K., Suviste, R., Säde, M., & Tõnisson, E. (2017a). MOOC in programming: A success story. In Proceedings of the International Conference on e-Learning (ICEL), 138-147. Academic Publishing International, USA.
- Lepp, M., Luik, P., Palts, T., Papli, K., Suviste, R., Säde, M., Hollo, K., Vaherpuu, V., & Tõnisson, E. (2017b). Self- and automated assessment in programming MOOCs. In D. Joosten-ten Brinke, & M. Laanpere (Eds.), Communications in computer and information science: Vol. 653. Technology enhanced assessment (pp. 72-85). Cham, Switzerland: Springer International Publishing AG. doi: 10.1007/978-3-319-57744-9_7
- Marceau, G., Fisler, K., & Krishnamurthi, S. (2011). Measuring the effectiveness of error messages designed for novice programmers. In Proceedings of the 42nd ACM Technical Symposium on Computer Science Education (SIGCSE '11), 499-504. ACM, New York, NY, USA. doi: 10.1145/1953163.1953308
- McRitchie, K. J. (2009). Technology consultants: A successful generation of student staff. In Proceedings of the 37th Annual ACM SIGUCCS Fall Conference: Communication and Collaboration (SIGUCCS '09), 287-292. ACM, New York, NY, USA. doi: 10.1145/1629501.1629555
- Motsuk, K. (1999). The student helpdesk: student information technology support at Georgetown University. In Proceedings of the 27th Annual ACM SIGUCCS Conference on User Services: Mile High Expectations (SIGUCCS '99), 172-175. ACM, New York, NY, USA. doi: 10.1145/337043.337135
- Muuli, E., Papli, K., Tõnisson, E., Lepp, M., Palts, T., Suviste, R., Säde, M., & Luik, P. (2017). Automatic assessment of programming assignments using image recognition. In É. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Lecture notes in computer science: Vol. 10474. Data driven approaches in digital education (pp. 153-163). Cham, Switzerland: Springer International Publishing AG. doi: 10.1007/978-3-319-66610-5_12
- Onah, D. F. O., Sinclair, J. E., & Boyatt, R. (2014). Exploring the use of MOOC discussion forums. In Proceedings of London International Conference on Education, 1-4. doi: 10.13140/RG.2.1.3319.5042
- Papathoma, T., Blake, C., Clow, D., & Scanlon, E. (2015). Investigating learners' views of assessment types in massive open online courses (MOOCs). In G. Conole, T. Klobučar, C. Rensing, J. Konert, & E. Lavoué (Eds.), Lecture notes in computer science: Vol. 9307. Design for teaching and learning in a networked world (pp. 617-621). Cham, Switzerland: Springer International Publishing AG. doi: 10.1007/978-3-319-24258-3_72
- Pieterse, V. (2013). Automated assessment of programming assignments. In Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research (CSERC '13), 45-56. Open Universiteit, Heerlen, The Netherlands. Retrieved from http://dl.acm.org/citation.cfm?id=2541917.2541921
- Sanders, K., & Thomas, L. (2007). Checklists for grading object-oriented CS1 programs: Concepts and misconceptions. SIGCSE Bull, 39 (3), 166-170. doi: 10.1145/1269900.1268834
- Siemens, G. (2013). Massive open online courses: Innovation in education. Open educational Resources: Innovation, Research and Practice, 5. Retrieved from https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/pub_PS_OER-IRP_web.pdf#page=31
- Sinnett, C. J., & Barr, T. (2004). OSU helpdesk: A cost-effective helpdesk solution for everyone. In Proceedings of the 32nd annual ACM SIGUCCS conference on User services (SIGUCCS '04), 209-216. ACM, New York, NY, USA. doi: 10.1145/1027802.1027851
- Skaanning C., Jensen F.V., & Kjærulff U. (2000). Printer troubleshooting using bayesian networks. In R. Logananthara, G. Palm, & M. Ali (Eds.), Lecture notes in computer science: Vol. 1821. Intelligent problem solving. Methodologies and approaches (pp. 367-380). Berlin, Germany: Springer-Verlag. doi: 10.1007/3-540-45049-1_45
- Suen, H. K. (2014). Peer assessment for massive open online courses (MOOCs). The International Review of Research in Open and Distance Learning, 15 (3), 313-327. doi: 10.19173/irrodl.v15i3.1680
- Veletsianos, G., & Shepherdson, P. (2016). A systematic analysis and synthesis of the empirical mooc literature published in 2013-2015. International Review of Research in Open and Distributed Learning, 17 (2). doi: 10.19173/irrodl.v17i2.2448
- Vihavainen, A., Luukkainen, M., & Kurhila, J. (2012). Multi-faceted support for MOOC in programming. In Proceedings of the 13th Annual Conference on Information Technology Education, 171-176. ACM. doi: 10.1145/2380552.2380603
- Warren, J., Rixner, S., Greiner, J., & Wong, S. (2014). Facilitating human interaction in an online programming course. In: Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14), 665-670. ACM, New York, NY, USA. doi: 10.1145/2538862.2538893
- Washburn, K., & El-Bayoumi, J. (2003). UNB's single site service source. In Proceedings of the 31st Annual ACM SIGUCCS Fall Conference (SIGUCCS '03), 237-239. doi: 10.1145/947469.947532
- Wustner, S., Joumblatt, D., Teixeira, R., & Chandrashekar, J. (2012). Automated home network troubleshooting with device collaboration. In Proceedings of the 2012 ACM Conference on CoNEXT Student Workshop (CoNEXT Student '12), 61-62. ACM, New York, NY, USA. doi: 10.1145/2413247.2413284