Enhancing Motivation in Online Courses with Mobile Communication Tool Support: A Comparative Study

Mobile technologies have helped establish new channels of communication among learners and instructors, potentially providing greater access to course information, and promoting easier access to course activities and learner motivation in online learning environments. The paper compares motivation between groups of learners being taught through an online course based on an e-learning system with and without the support of mobile communication tools, respectively. These tools, which are implemented on a mobile phone, extend the use of the existing Moodle learning management system (LMS) under the guidance of a mobile communication tools framework. This framework is considered to be effective in promoting learner motivation and encouraging interaction between learners and instructors as well as among learner peers in online learning environments. A quasi-experimental research design was used to empirically investigate the influence of these tools on learner motivation using subjective assessment (for attention, relevance, confidence, satisfaction, and social ability) and objective assessment (for disengagement, engagement, and academic performance). The results indicate that the use of the tools was effective in improving learner motivation, especially in terms of the attention and engagement variables. Overall, there were statistically significant differences in subjective motivation, with a higher level achieved by experimental-group learners (supported by the tools) than control-group learners (unsupported by the tools).


Résumé de l'article
Mobile technologies have helped establish new channels of communication among learners and instructors, potentially providing greater access to course information, and promoting easier access to course activities and learner motivation in online learning environments. The paper compares motivation between groups of learners being taught through an online course based on an e-learning system with and without the support of mobile communication tools, respectively. These tools, which are implemented on a mobile phone, extend the use of the existing Moodle learning management system (LMS) under the guidance of a mobile communication tools framework. This framework is considered to be effective in promoting learner motivation and encouraging interaction between learners and instructors as well as among learner peers in online learning environments. A quasi-experimental research design was used to empirically investigate the influence of these tools on learner motivation using subjective assessment (for attention, relevance, confidence, satisfaction, and social ability) and objective assessment (for disengagement, engagement, and academic performance). The results indicate that the use of the tools was effective in improving learner motivation, especially in terms of the attention and engagement variables. Overall, there were statistically significant differences in subjective motivation, with a higher level achieved by experimental-group learners (supported by the tools) than control-group learners (unsupported by the tools).

Introduction
Online learning increases learners' ability to learn at their own convenience; however, the physical separation from their peers and instructors that online learning involves may result in a lack of communication and interaction and a weaker sense of belonging to a classroom community. These affect learners' motivation and can lead to poor performance, dissatisfaction, and dropout (Balaban-Sali, 2008;Hirumi, 2002;Rau, Gao, & Wu, 2008). Effective interaction can positively impact learners' motivation, engagement, and interest in learning. To address learners' problems and needs in relation to motivation during online courses, new communication technologyparticularly mobile technology-seems to be effective by virtue of its ability to encourage interaction between learners and instructors (Rauet et al., 2008;Shih & Mills, 2007).

Relevant Research
Mobile learning gives students the ability to interact with their instructors and fellow learners immediately-at any time and place-and adapt content to their individual needs, which in turn facilitates sustained connections between learners and instructors. This may include content or processes where appropriate knowledge needs to be quickly and easily accessible and where a large volume of introduction or context is not needed; topics where the viewpoints and opinions of recognizable instructors with whom the students have had the opportunity to have fulfilling interactions; topics where advice, tips, and best practices can be simply presented and packaged, for example in areas such as recruitment and coaching; topics where capability to locate them at a certain place or time adds value, for example, location-specific access; and topics where the student will almost certainly benefit from access to learning on the move-this may include learners such as field engineers and salespeople (Ufi & Kineo, 2007).

Mobile learning research on motivation in online contexts.
Recent innovations incorporating m-learning activities in various online courses are reportedly effective in encouraging the motivation to learn (e.g., Mockus et al., 2011;Olasina, 2012). However, m-learning studies that explore motivation to learn in online environments remain limited in number. confidence, which focuses on learner performance, and helps learners develop a positive expectation that they will be able to achieve a successful learning experience; and satisfaction, which provides learners with positive reinforcement for their efforts (Keller, 1987).
In addition, collaborative learning-learning through social interaction-has been extensively acknowledged for its ability to encourage a spirit of learning and to foster knowledge about the learning process (Sharan & Shaulov, 1990). Since cooperative learning groups provide each member with essential praise and recognition for their positive effort, cooperative learning activity can raise learners' motivation. Miyake (2007) and Slavin (1995) have shown as well that learners are more motivated to learn in a collaborative situation and that this has a positive effect on academic, social, and attitudinal outcomes.
Although a significant number of studies have examined the motivational requirements of online learners and on their basis created models for motivational design in online instruction, very little research-based evidence has been conducted on learners' motivation in relation to the use of mobile devices as a complement to existing elearning systems. Therefore, this study attempts to prove that online learners' motivation can be enhanced when the proposed mobile communication tools are used as part of an existing e-learning system in accordance with a motivational design model.
This study is designed to examine whether the proposed mobile communication tools have the effect of stimulating and maintaining learners' motivation to use the e-learning system, and also whether any motivational differences exist across different conditions of online courses (i.e., those using mobile tools vs. not using them).

Method
The quasi-experimental study presented in this paper was designed to compare learning motivation between learners in a course being taught using Moodle LMS supported by mobile communication tools (the experimental group) and those being taught using regular Moodle LMS only (control group). An experimental comparison of the two groups' learning motivation was carried out in the first semester of 2011 in the Faculty of Information Technology at a university in Thailand. The initial sample consisted of 193 undergraduate students (68% female, 93% aged 18-21) enrolled that term in a course called IT for Learning. These initial participants were assigned to control (n = 92) and experimental (n = 101) groups on the basis of their demographic profile in order to ensure homogeneity across the groups, thus reducing bias.
Learners in both the experimental and control groups learned the same content and used the same online course materials. The courses consisted of weekly modules, Vol 14 | No 3 July/13 381 wherein the instructor required the learners to regularly take part in a variety of online class activities, for example, to read a given text online, post a short essay, engage in debate on the discussion forums, create their own blogs on course topics, and vote on class social activities. During the courses, learners were assessed regularly by means of formative assessments, including discussion forum posts and individual assignments, and summative assessments, including assignment grades and midterm and final exams.
The quasi-experimental design employed by this study can be separated into three periods: the pre-treatment period (first and second weeks), the treatment period (third to twelfth weeks), and the post-treatment period (thirteenth and fourteenth weeks).

Mobile communication tools used in this study.
This study's development of mobile communication tools to enhance motivation in elearning is guided by a combination of Keller's ARCS motivation model and the collaboration research of Chaiprasurt, Esichaikul, and Wishart (2011), which presented a framework for tool design and showed that the tools developed were effective in improving learner motivation.  Table 2 illustrates how the ARCS model and the collaboration factors were utilised as a framework for developing mobile communication tools into existing e-learning systems.
The approach to designing the tools based on the framework is discussed in more detail in the following sections, focusing on collaboration factor by factor and tool by tool.

Attention.
Strategies to gain and sustain learners' attention and interest include capturing interest, stimulating curiosity, and maintaining attention (Keller, 1987).
• SMS (course notifications and announcements). Receiving SMS announcements or course reminders such as deadlines for assignment submissions can stimulate learners' curiosity and interest in these learning activities and tasks.
• SMS (asking questions). When learners or instructors use SMS to ask questions, it helps them collect information, evaluate existing ideas, and create new ideas.
Frequent and thoughtful questions based on lessons learnt are expected to stimulate learners' attitude to inquiry and provide problem-solving opportunities that naturally challenge their thinking.
• Mobile RSS feeds. Mobile RSS feeds offer challenging and unexpected frequent communication. They accommodate a variety of learners' unique needs and learning preferences. They also support the attention factor leading to improved learner motivation in the LMS.

Relevance.
Relevance in this context refers to a quality of furthering personal understanding and competence, linking instruction to learners' interests, and tying it to learners' experiences (Keller, 1987).
• SMS (targeted online feedback and information). To use this tool, instructors first identify learners who have been receiving poor scores or have not submitted some or all of their assignments. They can help these learners understand the material better by texting them a link to detailed feedback or explanations of how to solve a problem or otherwise improve performance. Thus, this tool links content to learners' needs and wishes, a technique that appears to be effective in increasing learners' motivation.

Confidence.
To help learners gain self-confidence, instructors need to consider their anxieties and provide instruction that fosters positive expectations for success and belief in competence based upon the learners' efforts and abilities (Keller, 1987).
• Assignment feedback tool. The mobile feedback tool aims to provide personal information on a particular assignment via the LMS, a quicker, more convenient way to access feedback. Learners can refer to the feedback repeatedly, anytime and anywhere, using their mobile devices. Obtaining assignment feedback is a great way to improve learners' confidence by inspiring them to maintain or improve aspects of their competence.
• Attendance reporting tool. By attending online learning sessions regularly, learners are more likely to keep up with daily course activities. It is important to let them know that their personal efforts and abilities are the major factor in their success, and that this begins with attendance. Regular attendance can help learners feel that they have control over the outcome of their studies.
• Gradebook tool. This tool allows learners to view their grades through their mobile device. Learners are more comfortable accessing their grades directly through mobile applications than through mobile web browsers. Clearly, easily accessible grades, like feedback, will help learners track their progress, making it more likely that they will exert the required effort to be successful. •

Satisfaction.
These factors help learners feel satisfied with their accomplishments, and include encouraging and supporting learners' intrinsic enjoyment of the learning experience, providing rewards as incentives, and building learners' perception that they are treated fairly (Keller, 1987).
• SMS (grading results). Learners eagerly await their grades, especially at the end of the semester. During the term, timely release of grades is important for learners who need improvement and require more assistance. Sending learners their grades using SMS is a great way to immediately communicate necessary information to each individual. This tool can also encourage and support learners' intrinsic enjoyment of the learning experience, since it will reassure them regarding their progress and performance.

Collaboration.
Collaborative learning is learning through social interaction. peers on their mobile devices when away from the computer. This is a very convenient way to stay connected and get hold of each other easily.
• Mobile polls and votes. Mobile polls provide an easy way for learners to express their opinions and determine where they stand among their peers. They also provide instructors with valuable information on learners' preferences and perspectives. Polling enhances the ability to share ideas, opinions, and knowledge, which in turn adds collaborative power to learning.
On this basis, we proceed to evaluate improvement in learners' motivation when they use the proposed tools and compare motivation outcomes using objective Vol 14 | No 3 July/13 387 measurements between groups of learners being taught in an online course based on an e-learning system with and without the support of the proposed tools, respectively.

Assessment of Motivation
To assess motivation, this study measured learner motivation towards an e-learning system using subjective (self-assessment) and objective (learners' actions) measures.
For the subjective assessment, a questionnaire was constructed to identify learner The Online Course Motivation Survey developed for this study on the basis of these previous instruments consists of 45 items grouped onto five motivation scales, namely attention, relevance, confidence, satisfaction, and social ability. These scales each contain three constructs, and each construct consists of three items. The following is a list of three constructs related to each scale: • attention: (ability to) capture interest, stimulate inquiry, and maintain attention; • relevance: (ability to) relate to goals, match interests, and tie materials to experiences; • confidence: (ability to raise) success expectations, success opportunities, and personal responsibility; • satisfaction: intrinsic satisfaction, rewarding outcomes, and fair treatment; •  Table 3 lists examples of the constructs and of items used to assess learners' motivation levels in response to the attention scale. A five-point Likert-type scale was used with a choice range of (1) strongly disagree (2) disagree (3) neutral, (4) agree, and (5) strongly agree.  Russell, Ainley, and Frydenburg (2005), motivation is frequently inferred from learners' engagement in learning activities.
Under this assumption, engagement relates directly to behaviour and indicates a strong connection between person and activity, whereas disengagement indicates the lack of a connection. If the learner is motivated to perform the activity, he/she is likely to be objectively engaged. The term engagement in the present study is thus used to refer to learners' focus on the learning activity. Fredricks, Blumenfeld, and Paris (2004) conclude that behavioural disengagement is often a precursor to dropping out. This is confirmed by Martinez (2003), who contends that "low-motivational" behaviour is usually associated with dropout. Thus, a higher level of high-disengaged (lowmotivated) learners would lead to higher rates of dropout.
Moreover, the impact of motivation on the learner's academic performance is also an important aspect of effective learning. Therefore, the objective measurement of motivation in this study used engagement, disengagement, and academic performance as the indicators of motivation. Table 4 summarises the assessment methods, motivational variables, and items or instruments used to assess learners' motivation.

Results
To evaluate the impact of the proposed tools, learners' motivation was compared between regular and mobile-added modes of online learning using objective and subjective measurements in three periods along the course timeframe: before, during, and after implementing the tools. Chi-square contingency analysis revealed no difference in the demographic makeup of the treatment and control groups by gender,

Objective Assessment
Disengagement.
The number of learners dropping out of the courses (with dropout rates in parentheses) was analysed for group comparison using the Pearson chi-squared test. The dropout rate during the treatment period in the control group (15.22%) was higher than that in the experimental group (4.95%). However, the difference was not significant in all periods. Results from the analysis in each period are presented in Table 5. (There was no learner dropout during the post-treatment period.) Table 5 Dropout Rate and Chi-Squared Results

Phase
The number of learners dropping out (%) The number of learners left χ 2 p Con. Exp.

Engagement.
The numbers of submitted assignments and help requests made by learners, according to system records, were counted and compared. It can be observed from Table 6 that for the number of submitted assignments, the means of the experimental group were higher than those of the control group; furthermore, t-test results show a significant difference between the means of the two groups during the treatment period. Similarly, for the number of help requests made by learners, as shown in Table 7, the means of the experimental group were significantly greater than those of the control group during the treatment period. This shows that there were statistically significant differences in learners' engagement between the control and experimental groups during the treatment portion of the online course.
Vol 14 | No 3 July/13 392 To gauge academic performance, learners' scores on tests and assignments were evaluated. During pre-treatment and treatment periods, learners were asked to submit assignments weekly, and their average scores on these assignments were evaluated, whereas the average scores on midterm and final tests were evaluated during treatment and post-treatment, respectively. The learners in the experimental group achieved better learning scores with the proposed tools (see Table 8); however, they have a significantly higher mean score on assignments than learners in the control group only Vol 14 | No 3 July/13 393 during the treatment period (t = 3.486, p < 0.05). In contrast, the average scores on the midterm and final tests, assessed in post-treatment, were not significantly different between the two groups. Subjective Assessment

ARCS-Social ability.
A one-way MANOVA was performed to determine whether there are any differences in motivation between students in the online course with and without the proposed tools on the five dependent measures (attention, relevance, confidence, satisfaction, and social ability). Significant main effects were found for the use of the proposed tools, Wilks' λ = .89, F(5,120) = 2.90, p = .016, η2 = 0.108. A mean comparison test between the two groups was conducted on each variable and overall due to these significant MANOVA effects. Table 9  with the support of mobile tools, were higher than those in the control group. A pairwise Vol 14 | No 3 July/13 394 comparison test also revealed that the experimental groups' gain scores in all motivational variables were significantly higher than those of the control group. The attention variable shows the biggest difference in means between the two groups.  & Rosenberg, 1991). Consequently, this study emphasises the need for both objective and subjective assessments so that they can complement and reinforce each other.
In the objective assessment, the results for the disengagement variable showed that learners' dropout rate in the experimental group was less than that in the control group; however, this difference was statistically insignificant. There was a high dropout rate during the pre-treatment period, in which students were allowed to withdraw from the Vol 14 | No 3 July/13 395 course without penalty by the university. For the engagement variable, there was a significant difference between the two groups in all measures, but this was found only during the treatment period. These results confirmed that using the proposed tools can help learners to increase engagement and enhance learning.
Academic performance on assignments of learners in the experimental group was significantly higher than that in the control group during the treatment period but not the post-treatment period (that is, in the class assignments but not the midterm and final exam). There are several feasible explanations of why the post-treatment results showed no significant differences. As Amabile, Hill, Hennessey, and Tighe (1994) discovered, trait-intrinsic motivation (motivation to do something because it is enjoyable) correlates positively with course performance, while trait-extrinsic motivation (to do something due to the external reward) has no effect. Further, Moneta and Siu (2001) found that the effects of both intrinsic and extrinsic motivation on course performance can be changed by the educational or institutional environment.
They also claimed that there are four main reasons why learners' academic performance may not correlate with their motivation: course interestingness-complexity (course not sufficiently challenging), heuristic value of assignments (assignments require execution of step-by-step procedures and do not allow sufficient exploration or creative approaches), completeness-validity of assessments (assessments are not validly recognised), and shortcuts-to-grades (shortcuts to good grades allowing surface learning only instead of a deeper understanding).
Pooling these findings together with the results of this study suggests that using academic performance to measure motivation should involve formative assessment, intertwined with teaching, as well as summative assessment and that this should happen at the end of appropriate course subunits throughout the semester.
Furthermore, it will be necessary to measure learners' prior knowledge and skills in order to find out what they know coming in so that the advantages in academic performance they have gained during the online course can be more reliably identified.
In terms of subjective assessment, the Online Course Motivation Survey was carried out to assess learners' perceived levels of motivation with regard to online courses. The results revealed that the means of all motivation measures (attention, relevance, confidence, satisfaction, and social ability) in learners who used the proposed tools as part of the online course were higher than in those who did not. Indeed, there was also a significant statistical difference in means between two groups across all motivation measures. The attention measure showed the highest difference. The tools used for intervention in the attention factor consisted of SMS (asking questions, course notifications, and announcements) and RSS (forums and news updates); the results indicate that these tools seem to be more effective than the tools proposed for the other factors.
The technologies used in this study, namely Java ME and SMS, are rather traditional by some new generation developers who prefer Android or iOS platform, and a social Vol 14 | No 3 July/13 396 network service-based mobile application, respectively. However, these technologies serve the purpose of this study. In the case of Java ME, it was the most popular technology that could be supported by participants' mobile phones during the experiment period, and SMS was the only one of the proposed tools that could reach 100% of participants. From this research study, it can be concluded that the practical implications of these findings are extremely helpful for instructors concerned with how to encourage more communication between their students and between the students and the instructor so as to enhance their motivation. Learners can use the proposed tools on their own mobile phones to interact both synchronously and asynchronously.
Instructors can send SMSs on a system integrated with existing e-learning systems.
Instructors using the tools proposed here should know what particular outcomes, feedback, course information, notifications, and announcements are essential to their specific group of online learners, as different people have different needs. It is also important that everyone be seen to be treated equitably and fairly. Moreover, individual learners must have control over their learning process and be able to control the amount of effort they expend and the way in which they learn; otherwise, motivation will be difficult to maintain.

Conclusion and Future Research Considerations
This study examines the potential of several mobile communication tools (SMS, mobile RSS feeds, assignment feedback tool, gradebook tool, attendance reporting tool, MIM, mobile blogging, and mobile polls and votes) to stimulate and enhance the learner's motivation in existing e-learning settings. The quasi-experimental study was designed to compare learners' motivation in online courses with and without the support of mobile communication tools. Both subjective and objective assessments were carried out in order to evaluate the role of the proposed tools in enhancing learner motivation.
Disengagement, engagement, and academic performance were subjected to objective assessment. The Online Course Motivation Survey developed for this study, to assess learners' subjective motivation levels, consists of five measures, attention, relevance, confidence, satisfaction, and social ability, respectively. This survey is particularly robust especially in terms of content validity and reliability, providing clear and substantiated insight into the causal relationship between the online course approach and the learner's motivation.
The study revealed significant differences in motivation between the control and experimental groups on the basis of objective assessment items, engagement (the number of submitted assignments and help requests made by learners) and average scores on assignments, and subjective assessment item, ARCS-Social ability (perceived value of all motivation measurements). However, there were no significant differences for disengagement (the number of learners dropping out) and average scores on midterm and final tests. Nevertheless, learners who had the support of the tools in their online courses were less likely to dropout, and they gained more on their test scores Vol 14 | No 3 July/13 397 (midterm and final) than the control group. The tools can have a favourable impact on learners' engagement, level of interaction, and completion rate, and improve learning efficiency in the online environment. As the results of the study show a significant effect of m-learning on online learners' motivation, the proposed mobile communication tools are proved to be a valuable extension of online learning for the improvement of motivation.
In future research, other forms of objective assessment may be useful to assess online learners' motivation, such as the number of page views and posts for each task, the number of votes made and blog posts produced, or average session duration and time between sessions. In addition, future work should further investigate the impact of online learning incorporating the proposed mobile tools on learning outcomes, using a range of methods, participants, and courses. Another area for future research concerns the ways in which learners use Web 2.0 technologies such as podcasts, audio discussion boards, and social networks (e.g., Facebook and Twitter) as communication tools in tandem with online learning and how these tools can be used to increase interaction among learners and instructors in order to improve motivation and learning outcomes.