본문 바로가기
KERD
논문KCI 등재

A Hierarchical Evaluation for Success Factors of the Mobile-Assisted Language Learning Using AHP

이상준|김규미
한국콘텐츠학회 (The Korea Contents Association)|2017.09|International Journal of Contents|제13권 제3호|pp. 25-31|DOI https://doi.org/10.5392/IJoC.2017.13.3.025

1

조회

0

다운로드

5

인용

0

참고문헌

키워드

Analytic Hierarchy Process (AHP)Multi-criteria Decision MakingSuccess FactorsMobile-Assisted Language Learning (MALL)Pair-wise Comparison
주제분류컴퓨터학

초록

With tremendous advancement of information and communication technologies, mobile learning systems have been widely adopted in language learning contexts, and several frameworks have been developed for identifying and categorizing different factors of mobile-assisted language learning (MALL). However, pre-existing frameworks have limitations when evaluating the importance level of criteria. The purpose of this study is to develop a comprehensive hierarchical framework for identifying and categorizing success factors of MALL and prioritizing them according to the importance level. To do that, AHP method is used to quantitatively estimate weight values of MALL criteria. Results reveal that the priority of MALL criteria is ordered as follows: content, system, learner, language learning. Local weights of each criterion are also analyzed; for example, usefulness, accuracy, and authenticity are critical factors for improving MALL contents. Ease of use and mobility of MALL systems are also considered more critical than other systematic factors. In addition, availability of immediate feedback and self-directness has the highest weight values of importance. The findings of the study are discussed regarding hierarchical orders of MALL criteria and conclude that successful MALL implementation may be achieved if related elements are diversely measured and evaluated. Pedagogical implications and suggestions for further research are also presented.

Abstract

With tremendous advancement of information and communication technologies, mobile learning systems have been widely adopted in language learning contexts, and several frameworks have been developed for identifying and categorizing different factors of mobile-assisted language learning (MALL). However, pre-existing frameworks have limitations when evaluating the importance level of criteria. The purpose of this study is to develop a comprehensive hierarchical framework for identifying and categorizing success factors of MALL and prioritizing them according to the importance level. To do that, AHP method is used to quantitatively estimate weight values of MALL criteria. Results reveal that the priority of MALL criteria is ordered as follows: content, system, learner, language learning. Local weights of each criterion are also analyzed; for example, usefulness, accuracy, and authenticity are critical factors for improving MALL contents. Ease of use and mobility of MALL systems are also considered more critical than other systematic factors. In addition, availability of immediate feedback and self-directness has the highest weight values of importance. The findings of the study are discussed regarding hierarchical orders of MALL criteria and conclude that successful MALL implementation may be achieved if related elements are diversely measured and evaluated. Pedagogical implications and suggestions for further research are also presented.

참고문헌 (24)

  1. M. Sharples, "The Design of Personal Mobile Technologies for Lifelong Learning", Computers and Education, 34, pp.177~193 (2000)
  2. P. Thornton, "Using Mobile Phones in English Education in Japan", Journal of Computer Assisted Learning, 21, pp.217~228 (2005)
  3. A. Kukulska-Hulme, "An Overview of Mobile Assisted Language Learning : From Content Delivery to Supported Collaboration and Interaction", ReCALL, 20(3), pp.271~289 (2008)
  4. G. F. Issa, "A Scalable Framework to Quantitatively Evaluate Success Factors of Mobile Learning System", Int. J. Mobile Learning and Organisation, 5(3, pp.4) (2011), 299~316
  5. G. Stockwell, "Some Emerging Principles for Mobile-Assisted Language Learning" (2013), The International Research Foundation for English Language Education
  6. M. Shanmugapriya, "Design and Development of Mobile-Assisted Language Learning (MALL) Application for English Language Using Android Push Notification Services", International Journal of Research in Computer and Communication Technology, 2(6), pp.329~338 (2013)
  7. Y. C. Choi, "Prioritizing Major Policy Issues Regarding the Smart Schooling System Using the AHP Method", International Journal of u-and e-Service, Science and Technology, 9(5), pp.227~236 (2016)
  8. 2016Korea’s Wireless Internet Industry Map, "Ministry of Science, ICT and Future Planning", ~, pp.Statistics Report, 10-10-2016 (2016)
  9. J. Burston, "Mobile-Assisted Language Learning : A Selected Annotated Bibliography of Implementation Studies 1994-2012", Language Learning & Technology, 17(3), pp.157~225 (2013)
  10. J. Barbosa, "Mobile and Ubiquitous Computing in an Innovative Undergraduate Course", Proc. of the 38th ACM Technical Symposium on Computer Science Education, pp.379~383 (2007), ACM Press
  11. Literature Review in Mobile Technologies and Learning, "L. Naismith", Futurelab, ~, pp.Tech. Rep. 11 (2005)
  12. J. Traxler, "Defining, Discussing, and Evaluating Mobile Learning : The Moving Finger Writes and having Write", International Review of Research in Open and Distance Learning, 8(2), pp.1~12 (2007)
  13. T. L. Saaty, "Decision Making with the Analytic Hierarchy Process", Int. Journal Service Sciences, 1(1), pp.83~98 (2008)
  14. T. L. Saaty, "A Scaling Method for Priorities in Hierarchical Structures", Journal of Mathematical Psychology, 15(2), pp.234~281 (1977)
  15. T. L. Saaty, "The analytic hierarchy process" (1980), McGraw-Hill
  16. T. L. Saaty, "Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World" (1990), RWS publications
  17. 손성진, "AHP 기법을 이용한 성과측정지표의 중요도와 활용도가 경영성과에 미치는 영향", 회계연구, 17(3), pp.375~397 (2012), 대한회계학회
  18. 서창갑, "AHP를 이용한 이러닝 품질 평가에 관한 연구", 인터넷전자상거래연구, 15(4), pp.337~347 (2015), 한국인터넷전자상거래학회
  19. W. Y. Chiu, "Performance Evaluation Criteria for Personal Trainers : An Analytical Hierarchy Process Approach", Social Behavior and Personality, 38(7), pp.895~906 (2010)
  20. S. Farid, "A Hierarchical Model for e-Learning Implementation Challenges Using AHP", Malaysian Journal of Computer Science, 28(3), pp.166~188 (2015)
  21. D. Y. Jeong, "Perceived Importance of e-Learning Success Factors: An Empirical Assessment of e-Learning Firms", The Journal of Internet Electronic Commerce Research, 4(3), pp.15~41 (2004)
  22. K. Bunruamkaew, "How to do AHP analysis in Excel", pp.2012
  23. 김지예, "PR 중간관리자 리더십 AHP평가 모형 연구", 광고학연구, 26(1), pp.207~234 (2015), 한국광고학회
  24. 김봉철, "광고 창의성 평가요인의 상대적 중요도 분석: AHP의 적용", 광고학연구, 26(3), pp.61~80 (2015), 한국광고학회

이 간행물의 다른 논문 (9건)

Automatic Counting of Rice Plant Numbers After Transplanting Using Low Altitude UAV Images이경환, 나인섭, Md Nasim Rezapp. 1-8Copyright and Creativity of Popular Music in the Digital Age: Towards a Sustainable Cultural System최환호pp. 9-16Designing Health Games for Anti-Smoking Advertising Targeting College Students: The Impact of Message Types and Voice-Over유승철, Matthew S. Eastinpp. 17-24Suggestions for Developing On-Line In-Service English Teacher Training Program이병천pp. 32-37Language Identification in Handwritten Words Using a Convolutional Neural NetworkTRIEU SON TUNG, 이귀상pp. 38-42
원문 보기