Volume 15, Number 5, November 2014 Special Issue: Research into Massive Open Online Courses Guest-edited by George Siemens

EN:

While press coverage of MOOCs (massive open online courses) has been considerable and major MOOC providers are beginning to realize that employers may be a market for their courses, research on employers’ receptivity to using MOOCs is scarce. To help fill this gap, the Finding and Developing Talent study surveyed 103 employers and interviewed a subset of 20 about their awareness of MOOCs and their receptivity to using MOOCs in recruiting, hiring, and professional development. Results showed that though awareness of MOOCs was relatively low (31% of the surveyed employers had heard of MOOCs), once they understood what they were, the employers perceived MOOCs positively in hiring decisions, viewing them mainly as indicating employees’ personal attributes like motivation and a desire to learn. A majority of employers (59%) were also receptive to using MOOCs for recruiting purposes—especially for staff with technical skills in high demand. Yet an even higher percentage (83%) were using, considering using, or could see their organization using MOOCs for professional development. Interviews with employers suggested that obtaining evidence about the quality of MOOCs, including the long-term learning and work performance gains that employees accrue from taking them, would increase employers’ use of MOOCs not just in professional development but also in recruiting and hiring.

EN:

This study aimed to evaluate how peer-to-peer interactions through writing impact student learning in introductory-level massive open online courses (MOOCs) across disciplines. This article presents the results of a qualitative coding analysis of peer-to-peer interactions in two introductory level MOOCs: English Composition I: Achieving Expertise and Introduction to Chemistry. Results indicate that peer-to-peer interactions in writing through the forums and through peer assessment enhance learner understanding, link to course learning objectives, and generally contribute positively to the learning environment. Moreover, because forum interactions and peer review occur in written form, our research contributes to open distance learning (ODL) scholarship by highlighting the importance of writing to learn as a significant pedagogical practice that should be encouraged more in MOOCs across disciplines.

EN:

The use of massive open online courses (MOOCs) to expand students’ access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated essay scoring (AES) systems that allow students to engage in critical writing and free-response activities. However, there is a lack of research investigating the validity of such systems in MOOCs. This research examined the effectiveness of an AES tool to score writing assignments in two MOOCs. Results indicated that some significant differences existed between Instructor grading, AES-Holistic scores, and AES-Rubric Total scores within two MOOC courses. However, use of the AES system may still be useful given instructors’ assessment needs and intent. Findings from this research have implications for instructional technology administrators, educational designers, and instructors implementing AES learning activities in MOOC courses.

EN:

There is concern that online education may widen the achievement gap between students from different socioeconomic classes. The recent discussion of integrating massive open online courses (MOOCs) into formal higher education has added fuel to this debate. In this study, factors influencing enrollment and completion in a pre-college preparatory MOOC were explored. University of California at Irvine (UCI) students of all preparation levels, defined by math Scholastic Aptitude Test (SAT) score, were invited to take a Bio Prep MOOC to help them prepare for introductory biology. Students with math SAT below 550 were offered the explicit incentive of an early change to the biology major upon successful completion of the MOOC and two additional onsite courses. Our results demonstrate that, among course registrants, a higher percentage of UCI students (>60%) completed the course than non-UCI registrants from the general population (<9%). Female UCI students had a greater likelihood of enrolling in the MOOC, but were not different from male students in terms of performance. University students entering with low preparation outperformed students entering who already had the credentials to become biology majors. These findings suggest that MOOCs can reach students, even those entering college with less preparation, before they enter university and have the potential to prepare them for challenging science, technology, engineering, and mathematics (STEM) courses.

EN:

Given the ongoing alarm regarding uncontrollable costs of higher education, it would be reasonable to expect not only concern about the impact of MOOCs on educational outcomes, but also systematic efforts to document the resources expended on their development and delivery. However, there is little publicly available information on MOOC costs that is based on rigorous analysis. In this article, we first address what institutional resources are required for the development and delivery of MOOCs, based on interviews conducted with 83 administrators, faculty members, researchers, and other actors in the MOOCspace. Subsequently, we use the ingredients method to present cost analyses of MOOC production and delivery at four institutions. We find costs ranging from $38,980 to $325,330 per MOOC, and costs per completer of $74-$272, substantially lower than costs per completer of regular online courses, by merit of scalability. Based on this metric, MOOCs appear more cost-effective than online courses, but we recommend judging MOOCs by impact on learning and caution that they may only be cost-effective for the most self-motivated learners. By demonstrating the methods of cost analysis as applied to MOOCs, we hope that future assessments of the value of MOOCs will combine both cost information and effectiveness data to yield cost-effectiveness ratios that can be compared with the cost-effectiveness of alternative modes of education delivery. Such information will help decision-makers in higher education make rational decisions regarding the most productive use of limited educational resources, to the benefit of both learners and taxpayers.

EN:

This paper reports on the results of an analysis of the research proposals submitted to the MOOC Research Initiative (MRI) funded by the Gates Foundation and administered by Athabasca University. The goal of MRI was to mobilize researchers to engage into critical interrogation of MOOCs. The submissions – 266 in Phase 1, out of which 78 was recommended for resubmission in the extended form in Phase 2, and finally, 28 funded – were analyzed by applying conventional and automated content analysis methods as well as citation network analysis methods. The results revealed the main research themes that could form a framework of the future MOOC research: i) student engagement and learning success, ii) MOOC design and curriculum, iii) self-regulated learning and social learning, iv) social network analysis and networked learning, and v) motivation, attitude and success criteria. The theme of social learning received the greatest interest and had the highest success in attracting funding. The submissions that planned on using learning analytics methods were more successful. The use of mixed methods was by far the most popular. Design-based research methods were also suggested commonly, but the questions about their applicability arose regarding the feasibility to perform multiple iterations in the MOOC context and rather a limited focus on technological support for interventions. The submissions were dominated by the researchers from the field of education (75% of the accepted proposals). Not only was this a possible cause of a complete lack of success of the educational technology innovation theme, but it could be a worrying sign of the fragmentation in the research community and the need to increased efforts towards enhancing interdisciplinarity.

EN:

Massive open online courses (“MOOCs”) provide free access to higher education for anyone with Internet access. MOOCs are considered a means for democratizing education. These courses will hopefully provide an opportunity for individuals to learn from the best educators in the world, as well as help expand their personal networks, and facilitate their career development. However, research thus far shows that the majority of people taking advantage of these courses are already employed, have post-secondary degrees, and have encountered few barriers related to the affordability of higher education. Little is known about MOOC learners with financial constraints and who do not fit the typical profile of MOOC learners. This paper presents the results of the analysis of data from six Coursera courses offered by the University of Michigan from fall 2012 through winter 2013. In this analysis learners who self-identified as being unable to afford to pursue a formal education (the target group) were contrasted to other learners (the comparison group) in terms of demographics, motivations, course enrollment, engagement and performance. Learners in the target group were primarily male and over 25 years old. A statistically significant portion of the target group held less than a 4-year college degree than the comparison group. Target learners were also significantly underrepresented in the enrollment of the courses examined here. Although the comparison group had a significantly higher completion rate overall than the target group, the target group had a statistically significant higher rate of completing courses with certificates of distinction. This article provides a discussion of these results and suggests how MOOCs could be adapted to better address the needs of learners who feel financially unable to pursue a more traditional path to a post-secondary education.

EN:

Professional learning, combining formal and on the job learning, is important for the development and maintenance of expertise in the modern workplace. To integrate formal and informal learning, professionals have to have good self-regulatory ability. Formal learning opportunities are opening up through massive open online courses (MOOCs), providing free and flexible access to formal education for millions of learners worldwide. MOOCs present a potentially useful mechanism for supporting and enabling professional learning, allowing opportunities to link formal and informal learning. However, there is limited understanding of their effectiveness as professional learning environments. Using self-regulated learning as a theoretical base, this study investigated the learning behaviours of health professionals within Fundamentals of Clinical Trials, a MOOC offered by edX. Thirty-five semi-structured interviews were conducted and analysed to explore how the design of this MOOC supported professional learning to occur. The study highlights a mismatch between learning intentions and learning behaviour of professional learners in this course. While the learners are motivated to participate by specific role challenges, their learning effort is ultimately focused on completing course tasks and assignments. The study found little evidence of professional learners routinely relating the course content to their job role or work tasks, and little impact of the course on practice. This study adds to the overall understanding of learning in MOOCs and provides additional empirical data to a nascent research field. The findings provide an insight into how professional learning could be integrated with formal, online learning.

EN:

In this paper, we describe a novel methodology, grounded in techniques from the field of machine learning, for modeling emerging social structure as it develops in threaded discussion forums, with an eye towards application in the threaded discussions of massive open online courses (MOOCs). This modeling approach integrates two simpler, well established prior techniques, namely one related to social network structure and another related to thematic structure of text. As an illustrative application of the integrated technique’s use and utility, we use it as a lens for exploring student dropout behavior in three different MOOCs. In particular, we use the model to identify twenty emerging subcommunities within the threaded discussions of each of the three MOOCs. We then use a survival model to measure the impact of participation in identified subcommunities on attrition along the way for students who have participated in the course discussion forums of the three courses. In each of three MOOCs we find evidence that participation in two to four subcommunities out of the twenty is associated with significantly higher or lower dropout rates than average. A qualitative post-hoc analysis illustrates how the learned models can be used as a lens for understanding the values and focus of discussions within the subcommunities, and in the illustrative example to think about the association between those and detected higher or lower dropout rates than average in the three courses. Our qualitative analysis demonstrates that the patterns that emerge make sense: It associates evidence of stronger expressed motivation to actively participate in the course as well as evidence of stronger cognitive engagement with the material in subcommunities associated with lower attrition, and the opposite in subcommunities associated with higher attrition. We conclude with a discussion of ways the modeling approach might be applied, along with caveats from limitations, and directions for future work.

EN:

The advent of massive open online courses (MOOCs) has created opportunities for learning that are clearly in high demand, but the direction in which MOOCs should evolve to best meet the interests and needs of learners is less apparent. Motivated by our interest in whether there are potential and purpose for archived MOOCs to be used as learning resources beyond and between instructor-led live-sessions, we examined the use of a statistics MOOC and a computer science MOOC, both of which were made available as archived-courses after a live-session and for which enrolment continued to grow while archived. Using data collected from surveys of learner demographics and intent, the course database of major learner activity, and the detailed clickstream of all learner actions, we compared the demographics, intent, and behaviour of live- and archived-learners. We found that archived-learners were interested in the live-MOOC and that their patterns of use of course materials, such as the number and sequence of videos they watched, the number of assessments they completed, their demonstration of self-regulatory behaviour, and their rate of participation in the discussion forums, were similar to the live-learners. In addition, we found evidence of learners drawing on an archived-MOOC for use as reference material. Anticipated areas of impact of this work include implications for the future development of MOOCs as resources for self-study and professional development, and in support of learner success in other courses.

EN:

A recent phenomenon in the MOOC space has been the development of courses tailored to educators serving in K-12 settings. MOOCs, particularly as a form of educator professional development, face a number of challenges. Academics, as well as pundits from traditional and new media, have raised a number of concerns about MOOCs, including the lack of instructional and social supports. It is an assumption of this study that challenges arising form this problem of scale can be addressed by leveraging these massive numbers to develop robust online learning communities. This mixed-methods case study addresses critical gaps in the literature and issues of peer support in MOOCs through an examination of the characteristics, mechanisms, and outcomes of peer networks. Findings from this study demonstrate that even with technology as basic as a discussion forum, MOOCs can be leveraged to foster these networks and facilitate peer-supported learning. Although this study was limited to two unique cases along the wide spectrum of MOOCs, the methods applied provide other researchers with an approach for better understanding the dynamic process of peer supported learning in MOOCs.

EN:

One notable ‘disruptive’ impact of massive open online courses (MOOCs) has been an increased public discussion of online education. While much debate over the potential and challenges of MOOCs has taken place online confined largely to niche communities of practitioners and advocates, the rise of corporate ‘xMOOC’ ventures such as Coursera, edX and Udacity has prompted popular mass media interest at levels not seen with previous educational innovations. This article addresses this important societal outcome of the recent emergence of MOOCs as an educational form by examining the popular discursive construction of MOOCs over the past 24 months within mainstream news media sources in United States, Australia and the UK. In particular, we provide a critical account of what has been an important phase in the history of educational technology—detailing a period when popular discussion of MOOCs has far outweighed actual use/participation. We argue that a critical analysis of MOOC discourse throughout the past two years highlights broader societal struggles over education and digital technology—capturing a significant moment before these debates subside with the anticipated normalization and assimilation of MOOCs into educational practice. This analysis also sheds light on the influences underpinning how many people perceive MOOCs thereby leading to a better understanding of acceptance/adoption and rejection/resistance amongst various professional and popular publics.

EN:

We investigated how high school students taking a university preparatory economics course would engage with the learning and assessment components of a Behavioural Economics MOOC that was integrated into their school-based course. Students were divided into two groups, MOOC-only, with no teacher support, and blended-mode, with weekly tutorials. MOOC only students scored slightly lower on a teacher designed knowledge test but scored slightly higher in a MOOC test. Although the MOOC-only students watched more unique videos, the blended-mode students stayed more on-track with the MOOC. The blended-mode students showed more persistence in retaking quizzes, yet they scored lower than the MOOC-only students.