a mobile game-based insect learning system for improving the learning achievements

Procedia - Social and Behavioral Sciences 103 ( 2013 ) 42 – 50

1877-0428 © 2013 The Authors. Published by Elsevier Ltd.Selection and peer-review under responsibility of The Association of Science, Education and Technology-TASET, Sakarya Universitesi, Turkey.doi: 10.1016/j.sbspro.2013.10.305

ScienceDirect

13th International Educational Technology Conference

A Mobile Game-based Insect Learning System for improving the learning achievements

Chung-Ho Sua, Ching-Hsue Cheng b*

a Department of Animation and Game Design, Shu-Te University, Yanchao, Kaohsiung Taiwan 824 b Department of Information Management, National Yunlin University of Science and Technology, Touliu Yunlin, Taiwan 640

Abstract

This paper aimed to investigate how gamified learning approach influence science learning achievement through a context-aware mobile learning environment and to explain effects on student learning outcome. A mobile learning environment has been developed based on MILS (Mobile Insect Learning System) gamified learning activity. A series of gamified learning activities based on MILS was developed and implemented in an elementary school science curriculum to improve student learning achievement and help students to actively engage in learning activities. A quasi-experimental design was used to investigate the effectiveness of gamification approach by combining game elements with the use of MILS in a real-world scenario. The response to questionnaire indicates that students valued the outdoor learning activities made possible by use of the smartphone and its functions. Pre- and post-test results demonstrated that incorporating mobile and gamification technologies into botanical learning process could achieve a better learning achievement than using non-gamified mobile learning and traditional instruction. In managerial implications, the results could provide parents, teachers, educational organizations to make related educational decision. © 2013 The Authors. Published by Elsevier Ltd. Selection and peer-review under responsibility of The Association of Science, Education and Technology-TASET, Sakarya Universitesi, Turkey.

Keywords: Gamification, Elementary education, Teaching strategies, Mobile learning

1. INTRODUCTION

In the last decade, the development of mobile phone industry, associated with the parallel development in Mobile Internet has been explosively swift: from the earliest voice phone to the current 3G smart phone which can serve as a mini-computer, telephone, or camera, and transfer data as well as audio and video files. The

* Corresponding author. Tel.: +00 886 917 231 831; fax: +00 886 7615 8000. E-mail address: [email protected]

Available online at www.sciencedirect.com

© 2013 The Authors. Published by Elsevier Ltd. Selection and peer-review under responsibility of The Association of Science, Education and Technology-TASET, Sakarya Universitesi, Turkey.

43 Chung-Ho Su and Ching-Hsue Cheng / Procedia - Social and Behavioral Sciences 103 ( 2013 ) 42 – 50

interaction with this ubiquitous devices and their use for learning purposes extend the traditional learning paradigm into a new phenomenon so-called mobile learning (m-learning). Preliminary research suggests that mobile devices can create more active learning experiences that improve student engagement, learning, and course retention (Joosten, 2010), and the use of new technologies can enhance motivation, which is a vital aspect of learning, deliver information when needed, and encourage to solve problems and satisfy curiosity (Sharples et al., 2002). Furthermore, much research has shown that the mobile device as a mobile guide can help student to increase their science and geographical knowledge as well as their motivation to engage in learning activities (Huang et al., 2009; Hwang et al., 2010; Zhang et al., 2010). Many educators have emphasized the importance and necessity of “authentic learning activities” in which students are able to work with problems from the real world (Hwang et al., 2010). Students participating in an m-learning environment can enhance their learning performance and improve their creativity (Cavusa & Uzunboylu, 2009). Furthermore, researchers have also indicated the difficulty of supporting and guiding learners in such environments that combine real-world and digital-world learning resources (Chu et al., 2010). Therefore, it has become an important issue to develop effective and easy-to-follow learning guidance models for context-aware mobile learning system.

2. Literature review

To set a cornerstone for a common understanding before constructing the research model, some related theoretical perspectives based on literature analysis results are briefly described in this section to serve as a common ground.

2.1. Context-aware mobile learning environment

Mobile devices have become more and more popular, which can facilitate data collection, process and analysis, and the high interactivity enabled by beaming makes collaboration and communication among students handy. A learning environment is so-called mobile learning (m-learning). Mobile technologies can meet higher order learning needs and realizing a more creative and learner-centered educational process (Joo & Kim, 2009).

Several studies have demonstrated successful experiments that support knowledge production and transmission among learners and educators through the use of mobile devices in the learning activities of various courses, such as natural science (Hwang et al., 2010a), social science (Chiou et al., 2010) and language courses (Ogata et al., 2009; Sandberg et al., 2011). For example, Chen et al. (2003) proposed a mobile learning system for scaffolding bird watching learning activity that enables students to take photos of birds with handheld devices and to communicate with teachers and other students in an outdoor wireless environment. Chu et al. (2008) conducted several outdoor learning activities in a butterfly ecology garden by integrating mobile learning environments with electronic library facilities to assist elementary students to observe and distinguish butterfly features in a science course. Lai et al. (2007) note the affordances that mobile technologies provide for experiential learning by allowing rapid “note taking” through photos, audio and video recording, and by supporting students through in field provision of learning materials and prompts to assist their development of abstract concepts. Also, Huang et al. (2010) developed a mobile plant learning system to facilitate student learning in an elementary-school-level botany course. Furthermore, recent findings in this research literature show that digital learning resources, alongside the real-world learning contexts, improve students’ learning interest, motivation (Chen et al., 2003; Chen et al., 2009, among many others) and their learning achievement (Chu et al., 2010; Hwang & Chang, 2011, among many others).

Therefore, this study aimed to develop a low cost location-aware m-learning environment with appropriate learning activities that incorporate game elements, which should promote the development of problem-solving skills and to engage learning interest and increase learning achievement through adopting a game-informed approach to support learners' authentic learning experience.


2.2. Gamification

Mobile technologies can be used as powerful cognitive tools within constructivist approach to solve complex problems and to engage students in authentic and meaningful activities (Jonassen & Reeves, 1996). Educational gamification proposes the use of game-like rule systems, player experiences and cultural roles to shape learners’ behavior. In the previous research study, Sandberg et al. (2011) found that many children used a trial-and-error strategy on play the games. For this reason, gamifying a course would be a great help to primary students by take advantage of the motivational power of games and apply it to the motivational problems in education so successful learning can take place (Prensky, 2001).

3. Methodology

This study tries to enlarge the scope of game-play in learning situation by adopting gamified learning strategy and combining game elements with well-designed mobile learning activities. The goal is to determine whether mobile technologies can support gamified learning approach, and learning strategies influenced achievement in the natural science course. The implementation of our solution proposal, called Mobile Insect Learning System (MILS). A series of learning activities geared toward integrating the game elements into course design was developed for the outdoor learning environment.

3.1. Research concept

This section introduces the research design concept of our study, which applies the mobile insect learning system with game elements to facilitate the mobile learning activity in an outdoor educational environment. According to the use perspective, we designed an experiment in which students carry out the well designed gamified learning activity in a mobile learning environment. This study was based on a quasi-experimental. We divided students into three groups an experimental group and two different control groups that were formed from three classes. To evaluate the effectiveness of this approach, a mobile learning activity was implemented in the elementary school natural science courses in Kaohsiung Taiwan. Quantitative data analysis was also used to evaluate the students’ Learning achievement. The study proposes a research framework relative to the effectiveness of learning achievement by adoption of different learning approach in a mobile learning environment as shown in Fig.1.

Fig.1 Research Framework


Tow major hypotheses are described as follows according to the research purpose and research questions: H1: The demographic variables will affect the learning achievement positively. H2: The students who receive different interventions show significant difference in individual learning

achievement in an outdoor learning environment positively.

3.2. Design and Implementation

With MILS, teachers can create any number of teams for students, and create any number of specific, relevant goals and missions for that team to pursue. These include visiting learning area, observing learning target, and generally being social.

Fig.2 illustrates the framework of the MILS application, which is based on a standard server-client model and

is composed of two modules. The client side and server side are connected through a conventional 3G or Wi-Fi network. The screenshot of system functions are shown in Fig.3. After login to the mobile learning application, students can browse the learning games nearby them and select one to participate, as shown in Fig.3(a). The system then sends students a new Quest reminder with instructions on how to start with the learning task, as shown in Fig.3(b). The learning contents were represented on the screen after students scanned the QR code of specific learning target, as shown in Fig.3(c). Students can view the learning objects, the NPCs (No Player Character), and the notes created by others according to their location in the learning area, as shown in Fig.3(d). All of the NPCs are essential to the main storyline and will guide students to the next steps in chatty, as shown in Fig.3(e). Students can create personal knowledge gained through firsthand observation and personal experience, as shown in Fig.3(f).

Fig.2 The framework of the MILS application


Fig.3 The screenshot of system functions for MILS application


3.3. Participants

The participants of this study were three classes of fourth grade students taught by same teacher in an elementary school in Taiwan, the teacher had been teaching in the school for more than three years. The age range of the students was 10-11. After studying the fundamental knowledge of insects in a natural science course, these participants were randomly assigned to three groups to participate separately in three different teaching methods with some learning objects and tasks. The participants of the experimental group used MILS application incorporate game-informed learning approach in an outdoor education environment. Before analyzing the research hypotheses, we examined the level of knowledge about insects in each of the three groups by using one-way ANCOVA (Analysis of Covariance), and we found it to be equivalent among the groups. The results of the pre-test showed that the experimental group (M = 71.059, SD = 8.352), the first control group (M = 72.235, SD = 10.036) and the second control group (M = 73.176, SD = 9.846) had no significant differences between them (F = .429, p = .652 > .05).

3.4. Research instrument

In order to evaluate the students’ learning achievements and attitudes while participating in the different learning conditions, various data sources and methods were utilized, including pre-test/post-test design, questionnaires, and interviews with the teacher and students. The Cronbach's alpha value for internal consistency reliability of the pretest and posttest was .89. An acceptable alpha value was .7 or higher (Nunnaly, 1978) indicating a good reliability of the tests used in this study.

4. Data analysis and results

In this study, student toward natural science learning was measured and the effect of different teaching strategies on learning achievement in a natural science course was analyzed. There are totally 102 students participating in this study, of which 54 are male and 48 female, with the average age of 10-11 years.

4.1. Results of hypothesis test

For testing hypothesis H1, Table 1 shows the analysis comparison for the impact of demographic variables on the student’s learning achievement. The result shows the experienced students were more enjoyment in the learning activities, and more satisfied with their learning achievement in the ‘Understanding of Insects’ learning activity than the non-experienced students. The students with different gender lead to differences in post-examination achievement (P=.044). The male students did have a higher learning performance than the female students in the experimental group. The students' subject interest also indicated a significant difference for post-examination achievement (P=.000), which means the students who are interested in insects lead to higher learning achievement than the students who are not interested in insects. Moreover, the prior experience with smartphones also leads to significant difference in post-examination achievement (P=.010). Based on the results of Table 1, the hypothesis 1 is significance.


For testing hypothesis 2, this study analyzed the differences between pre-examination, post-examination and learning strategies using one-way ANCOVA in order to eliminate the influence of the pre-examination. First, normality plots revealed that the normality assumptions were valid, and there was an interaction of minor degree between pre-examination achievement and the learning strategies (F=0.429,P=0.101), which indicated that the regression slopes of the three learning strategies were homogeneous, so the assumption of equality of variance was not violated. Since the homogeneity requirement was met, we were able to carry on with the ANCOVA analysis, as depicted in Table 2. The results show that using mobile learning with gamification approach can promote student's botanical knowledge and lead to differences in learning performance, after removing the influence of the pre-examination. The post-hoc analysis for the research model showed that achievement in using mobile learning with gamification approach was higher than the achievement of conventional mobile learning and traditional instruction alone. The result shows that hypothesis H2 is significance.

Table 1 The t-test and ANOVA results for the impact of demographic variables on the student’s learning achievement

Hypothesis Constructs Gender Subject interest

Prior experience

Working off-campus

Games frequency Time to play

H1 Learning achievement t(-2.112)* t(-4.535)* t(-2.640)* F(2.846) F(2.365) F(1.449)

Comparison M>F Y>N Y>N

* P 0.05 ** P 0.01 *** P 0.001 M=male, F=female ,Y=Yes N=No

Table 2 The t-test and ANCOVA for learning achievement on learning strategies

Hypothesis Learning

Achievement Group N Mean SD

t-test for Equality of Means

F Value Sig. (2-tailed) Scheffe

Comparison

H2

Pre-test

EG 34 71.06 8.352

0.429 (.652) .789 CG1 34 72.24 10.036

CG2 34 73.18 9.846

Post-test

EG 34 82.94 10.009 25.287 (.000) .062

EG > CG1*

EG > CG2* CG1 34 75.59 9.595

CG2 34 74.71 8.956

EG= Experimental Group,CG1= Control Group 1,CG2= Control Group 2)* P 0.05 ** P 0.01 *** P 0.001

5. Conclusions & Findings

This study has investigated how different learning conditions affect student's learning achievement for botanical knowledge in an outdoor educational environment. Three interesting findings were summarized in the following:

(1) Learner characteristics affect learning achievement: The results of questionnaire indicate that among the six demographic variables and learning achievement,

subject interest were indicated as the important factor followed by gender ,subjects interests and prior experience. (See Table 1). This study supports the argument that male students have higher learning performances than females; experienced students have higher learning performances than those non-experienced students. Compared to male students, female students considered some instructional factors and learning activities more


valuable than other learning factors. It can be naturally interpreted that female students and the students who are not interested in insects.

(2) The advantages of MILS: The students in the experimental group satisfied the learner controlled pace of the learning process, and they

thought the gaming mechanics in the structure of game play were organized and useful for assisting them to learn. (3) The comparison of learning achievement with different learning strategies. Experimental group’s students

who use MILS have better learning achievement than other control groups in post-test. Through gamification we can not only create a mindset that encourages students to try new things, to not be

afraid of failing (Lee & Hammer, 2011), but also can enable students to engage in enjoyable experiences for the purpose of learning. In addition, gamification is an innovative approach to learning, and because new technologies and new applications are continuously emerging, it is still developing. Future studies must continue to examine the new mechanics and new applications associated with emerging gamification technologies.

References

Brown, DJ, McHugh, D, Standen, P, Evett, L, Shopland, N, Battersb, (2010). Designing Location based Learning Experiences for People with Intellectual Disabilities and Additional Sensory Impairments. Computers & Education, 56(1), 11-20. Caine, R. N., & Caine, G. (1994). Making connections: Teaching and the human brain. Alexandria, VA: The Association for Supervision and Curriculum Development. Cavusa, N., & Uzunboylu, H. (2009). Improving critical thinking skills in mobile learning. Procedia Social and Behavioral Sciences, 1, 434–438. Chen, P. D., Lambert, A. D., & Guidry, K. R. (2010). Engaging online learners: the impact of web-based learning technology on college student engagement. Computers & Education, 54(4), 1222–1232. Chen, T.-S., Chang, C.-S., Lin, J.-S., & Yu, H.-L. (2009). Context-aware writing in ubiquitous learning environments. Research and Practice inTechnology Enhanced Learning, 4(1), 61–82. Chen, Y. S., Kao, T. C., & Sheu, J. P. (2003). A mobile learning system for scaffolding bird watching learning. Journal of Computer Assisted Learning, 19(3), 347–359. Chang, C. S., Chen, T. S., & Hsu, W. H. (2011), The study on integrating WebQuest with mobile learning for environmental education, Computers & Education, 57(), 1228-1239. Chiou, C. K., Tseng Judy, C. R., Hwang, G. J., & Heller, S. (2010). An adaptive navigation support system for conducting context-aware ubiquitous learning in museums. Computers & Education, 55(2), 834–845. Chu, H. C., Hwang, G. J., Huang, S. X., & Wu, T. T. (2008). A knowledge engineering approach to developing e-libraries for mobile learning. Electronic Library, 26(3), 303–317. Ernest, P. (1999). Social Constructivism as a Philosophy of Mathematics: Radical Constructivism. Felder, R. M. & Brent, R. (1996). Navigating the bumpy road to student-centered instruction. College Teaching, 44(2). Retrieved February 8, 2005 from Academic Search Premier. Gee, J. P. (2005). Learning by design: Good video games as learning machines. E-Learning, 2, 5–16. Gee, J. P. (2008). Learning and games. In Katie Salen (Ed.) The ecology of games: Connecting youth, games, and learning (John D. and Catherine T. MacArthur Foundation series on digital media and learning). Cambridge, MA: The MIT Press. Huang, Y. M., Lin, Y. T., & Cheng, S. C. (2010). Effectiveness of a mobile plant learning system in a science curriculum in Taiwanese elementary education. Computers & Education, 54(1), 47–58. Hwang, G. J., Chu, H. C., Shih, J. L., Huang, S. H., & Tsai, C. C. (2010). A decision-tree-oriented guidance mechanism for conducting nature science observation activities in a context-aware ubiquitous learning environment. Educational Technology & Society, 13(2), 53–64. Hwang, G. J.,Chu, H. C.,Lin, Y. S., & Tsai, C. C. (2011). A knowledge acquisition approach to developing mindtools for organizing and sharing differentiating knowledge in a ubiquitous learning environment. Computers & Education, 57(1), 1368-1377. Hancock, D. R., Bray, M., & Nason, S. A. (1995). Influencing university students’ achievement and motivation in a technology course. Journal of Educational Research, 95(6). Hodgins, H. S., Yacko, H. A., Gottlieb, E., Goodwin, G., & Rath, P. (2002). Autonomy and engaging versus defending against experience. Unpublished manuscript, Skidmore College. Huang, Y.-M., Jeng, Y.-L., & Huang, T.-C. (2009). An Educational Mobile Blogging System for Supporting Collaborative Learning. Educational Technology & Society, 12 (2), 163–175.


Huang, Y. M., Lin, Y. T., & Cheng, S. C. (2010). Effectiveness of a mobile plant learning system in a science curriculum in Taiwanese elementary education. Computers & Education, 54(1), 47–58. Hwang, G. J., & Chang, H.-F. (2011). A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students. Computers & Education, 56(4), 1023–1031. Hwang, G. J.,Chu, H. C.,Lin, Y. S., & Tsai, C. C. (2011). A knowledge acquisition approach to developing mindtools for organizing and sharing differentiating knowledge in a ubiquitous learning environment. Computers & Education, 57(1), 1368-1377. Hwang, G. J., Chu, H. C., Shih, J. L., Huang, S. H., & Tsai, C. C. (2010). A decision-tree-oriented guidance mechanism for conducting nature science observation activities in a context-aware ubiquitous learning environment. Educational Technology & Society, 13(2), 53–64. Hwang, G. J., Wu, C. H., Tseng, Judy C. R., & Huang, I. W. (2011). Development of a ubiquitous learning platform based on a real-time help-seeking mechanism. British Journal of Educational Technology, 42(6), 992-1002. Joo, K. H., & Kim, S. H. (2009). Development and application of an efficient ubiquitous teaching and learning model. InICACT 2009, 11th International Conference on Advanced Communication Technology, Vol. 3 (pp. 2165e2168). Jonassen, D.H., & Reeves, T. C. (1996). Learning with technology: Using computers as cognitive tools. In D.H. Jonassen (Ed.), Handbook of research for educational communications and technology. 693-719. Jonassen, D. H., & Hernandez-Serrano, J. (2002). Case-based reasoning and instructional design: using stories to support problem solving. Educational Technology Research & Development, 50(2), 65–77. Joosten, T. (2010). Mobile learning and social media: Increasing engagement and interactivity. Paper presented at the New Media Consortium Conference, June 9-12, 2010, Anaheim, CA. Kiili, K. (2005). Digital game-based learning: Towards an experiential gaming model. The Internet and Higher Education, 8(1), 13–24. Kim, B., Park, H., & Baek, Y. (2009). Not just fun, but serious strategies: Using meta-cognitive strategies in game- based learning. Computers & Education, 52, 800–810. Lai, C. H., Yang, J. C., Chen, F. C., Ho, C. W., & Chan, T. W. (2007). Affordances of mobile technologies for experiential learning: The interplay of technology and pedagogical practices. Journal of Computer Assisted Learning, 23(4), 326-337. McMahon, M. (1997). Social constructivism and the world wide web - A paradigm for learning. Paper presented at the ASCILITE conference. Perth, Australia. Nunnaly, J. (1978). Psychometric theory. New York: McGraw-Hill. Ogata, H., Matsuka, Y., El-Bishouty, M. M., & Yano, Y. (2009). LORAMS: linking physical objects and videos for capturing and sharing learning experiences towards ubiquitous learning. International Journal of Mobile Learning and Organisation, 3(4), 337–350. Prensky, M. (2001). Fun, play, and games: What makes games engaging. In Digital game-based learning. (pp. 11-16). New York, NY: McGraw Hill. Prensky, M. (2003). Digital game-based learning. ACM Computers in Entertainment, 1, 1–4. Salen, K., & Zimmerman, E. (2004). Rules of play: Game design fundamentals. Cambridge, Mass: MIT Press. Sandberg, J., Maris, M., & de Geus, K. (2011). Mobile English learning: An evidence-based study with fifth graders. Computers & Education, 57(1), 1334-1347. Savery, J. R., & Duffy, T. M. (1995). Problem based learning: An instructional model and its constructivist framework. Educational Technology, 35, 31–38. Sharples, M., Corlett, D. & Westmancott, O. (2002), The Design and Implementation of a Mobile Learning Resource. Personal and Ubiquitous Computing, 6, 3, 220-234. Thomas, D., & Brown, J. S. (2011). A new culture of learning: Cultivating the imagination for aworld of constant change: CreateSpace. Wasson, B., & Ludvigsen, S. (2003). Designing for knowledge building, Oslo: Unipub forlag. Wasson, B. (2007). Design and use of collaborative network learning scenarios: The DoCTA experience. Educational Technology & Society, 10 (4), 3-16.

a mobile game-based insect learning system for improving the learning achievements

Documents