Development of A New Model for the Usability Evaluation of M-commerce Applications

Authors

  • A. S. Ajibola School of Computing, University of South Africa, Johannesburg
  • E. T. Abiodun Department of Computer Science, Kwara State Polytechnic, Ilorin, Nigeria
  • L. Goosen Department of Science and Technology Education, University of South Africa, Pretoria

Keywords:

Usability evaluation, Usability attributes, Usability models, User experience

Abstract

The acceptance of Mobile commerce (M-commerce) applications has become a way of life for business professionals and mobile shoppers. The global acceptance and increase in its usefulness have resulted in concerns about the availability of a suitable model for its usability evaluation. In order to fill this literature gap, the study introduced the MObile Shoppers Application Development (MOSAD) usability model to address the limitations in current usability models when applied in the context of M-commerce applications. The proposed model in this study incorporates different essential attributes from widely accepted usability models, which helped develop a more detailed usability model for M-commerce applications. The attributes in the proposed model are not entirely new; however, the current and widely accepted usability models failed to consider some of them. This neglect could lead to usability evaluation flaws and affect the outcomes of usability evaluations of M-commerce applications.

References

C. C. Kulpa and F. G. Amaral, "Evaluation of Tablet PC Application Interfaces with Low Vision Users: Focusing on Usability," in International Conference of Design, User Experience, and Usability, 2014, pp. 273–284. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07668-3_27.

C. K. Coursaris, K. Hassanein, M. M. Head, and N. Bontis, "The impact of distractions on the usability and intention to use mobile devices for wireless data services," Computers in Human Behavior, vol. 28, no. 4, pp. 1439–1449, 2012, doi: 10.1016/j.chb.2012.03.006.

A. S. Alghamdi, A. H. Al-Badi, R. S. Alroobaea, and P. J. Mayhew, "A Comparative Study of Synchronous and Asynchronous Remote Usability Testing Methods," International Review of Basic and Applied Sciences, vol. 1, no. 3, pp. 61–97, 2013.

I. Muslukhov, Y. Boshmaf, C. Kuo, J. Lester, and K. Beznosov, "Know your enemy: the risk of unauthorised access in smartphones by insiders," in Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services, 2013, pp. 271–280. Accessed: May 01, 2014. Available: http://dl.acm.org/citation.cfm?id=2493223.

E. Chalkia, J. B. M. Colomer, S. de los Rios, and I. C. Rojo, "Evaluating the Global Public Inclusive Infrastructure: Cloud4all Evaluation Framework," in Proceedings of the 8th International Conference on Universal Access in Human-Computer Interaction. Design for All and Accessibility Practice, 2014, pp. 358–367. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07509-9_34.

ISO 9241-11, "Ergonomics of human-system interaction -- Part 210: Human-centred design for interactive systems," 2018. Accessed: May 24, 2018. Available: https://www.iso.org/standard/52075.html.

W. Oyomno, P. Jäppinen, E. Kerttula, and K. Heikkinen, "Usability study of ME2.0: User interface design for mobile context enhanced personalisation software," Personal and Ubiquitous Computing, vol. 17, no. 2, pp. 305–319, 2013, doi: 10.1007/s00779-011-0495-9.

A. A. Ozok and J. Wei, "An empirical comparison of consumer usability preferences in online shopping using stationary and mobile devices: results from a college student population," Electronic Commerce Research, vol. 10, no. 2, pp. 111–137, 2010, doi: 10.1007/s10660-010-9048-y.

T. Feng, N. DeSalvo, L. Xu, X. Zhao, X. Wang, and W. Shi, "Secure Session on Mobile: An Exploration on Combining Biometric, TrustZone, and User Behavior," in 6th International Conference on Mobile Computing, Applications and Services, Austin, USA, 2014, pp. 206–215. doi: 10.4108/icst.mobicase.2014.257767.

L. Gitau and D. Nzuki, "Analysis of Determinants of M-Commerce Adoption by Online Consumers," International Journal of Business, Humanities and Technology, vol. 4, no. 3, pp. 88–94, 2014.

M. Kaur, "A brief study of usability principles for mobile commerce," International Journal of Computational Engineering Research, vol. 4, no. 8, pp. 20–25, 2014.

A. Hussain and E. Ferneley, "Usability metric for mobile application: A goal question metric (GQM) approach," in Proceedings of the 10th International Conference on Information Integration and Web-based Applications & Services, 2008, pp. 567–570. Accessed: May 02, 2014. Available: http://dl.acm.org/citation.cfm?id=1497412

N. A. bt Mohd and Z. F. Zaaba, "A Review of Usability and Security Evaluation Model of Ecommerce Website," Procedia Computer Science, vol. 161, pp. 1199–1205, 2019, doi: 10.1016/j.procs.2019.11.233.

K. Benmoussa, M. Laaziri, S. Khoulji, M. L. Kerkeb, and A. E. Yamami, "Evaluating the Usability of a Moroccan University Research Management Web Platform," Procedia Manufacturing, vol. 32, pp. 1008–1016, 2019, doi: 10.1016/j.promfg.2019.02.315.

K. Ishaq, F. Rosdi, N. Azan, and A. Abid, "Usability and Design Issues of Mobile Assisted Language Learning Application," IJACSA, vol. 11, no. 6, 2020, doi: 10.14569/IJACSA.2020.0110611.

A. Hussain and A. Mohamed Omar, "Usability Evaluation Model for Mobile Visually Impaired Applications," Int. J. Interact. Mob. Technol., vol. 14, no. 05, p. 95, Apr. 2020, doi: 10.3991/ijim.v14i05.13349.

J. Nielsen, Usability Engineering, 1st ed. Morgan Kaufmann, USA, 1994. Accessed: Apr. 20, 2015. Available: http://www.amazon.com/Usability-Engineering-Interactive-Technologies-Nielsen-ebook/dp/B0029ZBK80

D. Cáliz and X. Alamán, "Usability Evaluation Method for Mobile Applications for the Elderly: A Methodological Proposal," in Annual Conference on Human Factors in Computing Systems, Italy, 2014, pp. 252–260. Accessed: Feb. 26, 2015 Available: http://www.bookmetrix.com/detail/chapter/2802f3c2-2b1b-40df-9577-99f9c2e3cbf1#downloads

N. Bevan, "Using the Common Industry Format to Document the Context of Use," in Human-Computer Interaction. Human-Centred Design Approaches, Methods, Tools, and Environments, Berlin, Heidelberg, 2013, vol. 8004, pp. 281–289. doi: 10.1007/978-3-642-39232-0_32.

S. Hörold, C. Mayas, and H. Krömker, "Guidelines for Usability Field Tests in the Dynamic Contexts of Public Transport," in International Conference on Human-Computer Interaction, 2014, pp. 489–499. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07233-3_45

P. Ponce, D. Balderas, T. Peffer, and A. Molina, "Deep learning for automatic usability evaluations based on images: A case study of the usability heuristics of thermostats," Energy and Buildings, vol. 163, no. 1, pp. 111–120, 2018, doi: 10.1016/j.enbuild.2017.12.043.

A. De Lima Salgado and A. P. Freire, "Heuristic Evaluation of Mobile Usability: A Mapping Study," in Proceedings of the 16th International Conference on Human Computer Interaction, M. Kurosu (Ed.)., Crete, Greece: Springer, 2014, pp. 178–188. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07227-2_18

M. S. Al-Razgan, H. S. Al-Khalifa, and M. D. Al-Shahrani, "Heuristics for Evaluating the Usability of Mobile Launchers for Elderly People," in A. Marcus (Ed.): International Conference of Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience, Crete, Greece, 2014, pp. 415–424. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07668-3_40

G. R. Howard, "Investigating good usability consistency within and across the South African super 14 rugby franchise web sites," University of South Africa, South Africa, 2009. Accessed: Jun. 02, 2015. Available: http://uir.unisa.ac.za/handle/10500/3885

L. I. González-Pérez, M. S. Ramírez-Montoya, F. J. García-Peñalvo, and J. E. Q. Cruz, "Usability evaluation focused on user experience of repositories related to energy sustainability: A Literature Mapping," in Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality - TEEM 2017, Cádiz, Spain, 2017, pp. 1–11. doi: 10.1145/3144826.3145385.

T. Álvarez, C. Rusu, F. Álvarez, E. Benítez-Guerrero, and A. Esparza, "Applying usability evaluation methods with blind users: a systematic mapping study," in Proceedings of the XVIII International Conference on Human Computer Interaction - Interacción '17, Cancun, Mexico, 2017, pp. 1–4. doi: 10.1145/3123818.3123829.

J. J. Randolph, "A guide to writing the dissertation literature review," Practical Assessment, Research and Evaluation, vol. 14, no. 13, pp. 1–13, 2009.

R. Baharuddin, D. Singh, and R. Razali, "Usability dimensions for mobile applications—A review," Research Journal of Applied Sciences, Engineering and Technology, vol. 5, no. 6, pp. 2225–2231, 2013.

C. Coursaris and D. Kim, "A qualitative review of empirical mobile usability studies," 2006, pp. 1–14. Accessed: Feb. 14, 2015. Available: http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1900&context=amcis2006

R. Budiu, "Mobile: Native Apps, Web Apps, and Hybrid Apps," Nielsen Norman Group, Sep. 2013. http://www.nngroup.com/articles/mobile-native-apps/ (accessed Apr. 23, 2015).

L. Rivero, G. Kawakami, and T. U. Conte, "Using a Controlled Experiment to Evaluate Usability Inspection Technologies for Improving the Quality of Mobile Web Applications Earlier in their Design," 2014, pp. 161–170. doi: 10.1109/SBES.2014.24.

A. Nathoo, G. Bekaroo, T. Gangabissoon, and A. Santokhee, "Using tangible user interfaces for teaching concepts of internet of things: Usability and learning effectiveness," ITSE, vol. 17, no. 2, pp. 133–158, Jun. 2020, doi: 10.1108/ITSE-09-2019-0061.

N. A. Nik Ahmad, N. I. M. Hamid, and A. Mohd Lokman, "Performing Usability Evaluation on Multi-Platform Based Application for Efficiency, Effectiveness, and Satisfaction Enhancement," Int. J. Interact. Mob. Technol., vol. 15, no. 10, p. 103, May 2021, doi: 10.3991/ijim.v15i10.20429.

R. Alturki and V. Gay, "Usability Attributes for Mobile Applications: A Systematic Review," in Recent Trends and Advances in Wireless and IoT-enabled Networks, M. A. Jan, F. Khan, and M. Alam, Eds. Cham: Springer International Publishing, 2019, pp. 53–62. doi: 10.1007/978-3-319-99966-1_5.

P. Weichbroth, "Usability of Mobile Applications: A Systematic Literature Study," IEEE Access, vol. 8, pp. 55563–55577, 2020, doi: 10.1109/ACCESS.2020.2981892.

N. Andriamilanto and T. Allard, "BrFAST: a Tool to Select Browser Fingerprinting Attributes for Web Authentication According to a Usability-Security Trade-off," in Companion Proceedings of the Web Conference 2021, Apr. 2021, pp. 701–704. doi: 10.1145/3442442.3458610.

E. O. C. Mkpojiogu, O. E. Okeke-Uzodike, and E. I. Emmanuel, "Quality Attributes for an LMS Cognitive Model for User Experience Design and Evaluation of Learning Management Systems:," presented at the 3rd International Conference on Integrated Intelligent Computing Communication & Security (ICIIC 2021), Bangalore, India, 2021. doi: 10.2991/ahis.k.210913.029.

Y. Liu and H. Li, "Exploring the impact of use context on mobile hedonic services adoption: An empirical study on mobile gaming in China," Computers in Human Behavior, vol. 27, no. 2, pp. 890–898, 2011, doi: 10.1016/j.chb.2010.11.014.

R. Koci, X. Franch, P. Jovanovic, and A. Abello, "A Data-Driven Approach to Measure the Usability of Web APIs," in 2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Portoroz, Slovenia, Aug. 2020, pp. 64–71. doi: 10.1109/SEAA51224.2020.00021.

R. Alexander, N. Thompson, T. McGill, and D. Murray, "The Influence of User Culture on Website Usability," International Journal of Human-Computer Studies, vol. 154, p. 102688, Oct. 2021, doi: 10.1016/j.ijhcs.2021.102688.

A. Amiruddin, R. S. Dewi, and E. Widodo, "Structural modeling for usability attributes on technology acceptance model for smart parking mobile application," IOP Conf. Ser.: Mater. Sci. Eng., vol. 1072, no. 1, p. 012024, Feb. 2021, doi: 10.1088/1757-899X/1072/1/012024.

R. Kumar, A. Irshad Khan, Y. B. Abushark, M. M. Alam, A. Agrawal, and R. A. Khan, "An Integrated Approach of Fuzzy Logic, AHP and TOPSIS for Estimating Usable-Security of Web Applications," IEEE Access, vol. 8, pp. 50944–50957, 2020, doi: 10.1109/ACCESS.2020.2970245.

H. M. Alotaibi, "Computer-Assisted Translation Tools: An Evaluation of Their Usability among Arab Translators," Applied Sciences, vol. 10, no. 18, p. 6295, Sep. 2020, doi: 10.3390/app10186295.

I. K. R. Arthana, I. M. A. Pradnyana, and G. R. Dantes, "Usability testing on website wadaya based on ISO 9241-11," J. Phys.: Conf. Ser., vol. 1165, p. 012012, Feb. 2019, doi: 10.1088/1742-6596/1165/1/012012.

T. Rupere and M. Jakovljevic, "Usability and user evaluation of an integrated multimedia e-learning management system," Knowledge Management & E-Learning: An International Journal, vol. 13, no. 3, pp. 334–366, 2021, doi: 10.34105/j.kmel.2021.13.018.

R. Harrison, D. Flood, and D. Duce, "Usability of mobile applications: Literature review and rationale for a new usability model," Journal of Interaction Science, vol. 1, no. 1, pp. 1–16, 2013.

A. Saleh, R. Ismail, and N. Fabil, "Evaluating Usability for Mobile Application: A MAUEM Approach," in Proceedings of the 2017 International Conference on Software and e-Business - ICSEB 2017, Hong Kong, China, 2017, pp. 71–77. doi: 10.1145/3178212.3178232.

J. Xu, X. Ding, K. Huang, and G. Chen, "A Pilot Study of an Inspection Framework for Automated Usability Guideline Reviews of Mobile Health Applications," in Proceedings of the Wireless Health 2014 on National Institutes of Health, 2014, pp. 1–8. Accessed: Feb. 26, 2015. Available: http://dl.acm.org/citation.cfm?id=2669585

A. Thorpe, K. Nesbitt, and A. Eidels, "Assessing Game Interface Workload and Usability: A Cognitive Science Perspective," in Proceedings of the Australasian Computer Science Week Multiconference on - ACSW 2019, Sydney, NSW, Australia, 2019, pp. 1–8. doi: 10.1145/3290688.3290749.

T. Page, "Usability of text input interfaces in smartphones," Journal of Design Research, vol. 11, no. 1, pp. 39–56, 2013.

A. R. Façanha, W. Viana, M. C. Pequeno, M. de Borba Campos, and J. Sánchez, "Touchscreen Mobile Phones Virtual Keyboarding for People with Visual Disabilities," in Human-Computer Interaction. Applications and Services, Springer, 2014, pp. 134–145. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07227-2_14

B. Poulcheria and V. Costas, "A context management architecture for m-commerce applications," Central European Journal of Computer Science, vol. 2, no. 2, pp. 87–117, 2012.

F. Gündüz and A.-S. K. Pathan, "On the Key Factors of Usability in Small-sized Mobile Touch-Screen Application.," International Journal of Multimedia and Ubiquitous Engineering, vol. 8, no. 3, pp. 115–138, 2013.

M. Quaresma and R. Gonçalves, "Usability Analysis of Smartphone Applications for Drivers," in Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience, Springer, 2014, pp. 352–362. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07668-3_34

L. Olsina, L. Santos, and P. Lew, "Evaluating Mobileapp Usability: A Holistic Quality Approach," in International Conference on Web Engineering, 2014, pp. 111–129. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-08245-5_7

F. Lettner and C. Holzmann, "Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications," in Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia, 2012, pp. 118–127. Accessed: Feb. 26, 2015. Available: http://dl.acm.org/citation.cfm?id=2428983

G. Orlandini, G. A. Castadelli, and L. M. P. Braccialli, "Ergonomics and Usability in Sound Dimension: Evaluation of a Haptic and Acoustic Interface Application for Mobile Devices," in International Conference of Design, User Experience, and Usability, 2014, pp. 193–202. Accessed: Feb. 26, 2015. Available: http://link.springer.com/chapter/10.1007/978-3-319-07626-3_18

R. Ravendran, I. MacColl, and M. Docherty, "A comparative usability study of a tag-based interface in the mobile banking context," in Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction, 2012, pp. 80–83. Accessed: Feb. 26, 2015. Available: http://dl.acm.org/citation.cfm?id=2379269

R. Ivanov, "Blind-environment interaction through voice augmented objects," Journal on Multimodal User Interfaces, vol. 8, no. 4, pp. 345–365, Oct. 2014, doi: 10.1007/s12193-014-0166-z.

M. Kenteris, D. Gavalas, and D. Economou, "An innovative mobile electronic tourist guide application," Personal and Ubiquitous Computing, vol. 13, no. 2, pp. 103–118, 2009, doi: 10.1007/s00779-007-0191-y.

A. S. Ajibola, "Usability Attributes and Evaluation Methods for M-Commerce Websites," PhD Thesis, University of South Africa, Pretoria, South Africa, 2019. Available: https://uir.unisa.ac.za/bitstream/handle/10500/29006/thesis_ajibola_as.pdf?sequence=1

A. S. Ajibola and L. Goosen, "Development of heuristics for usability evaluation of m-commerce applications," in Proceedings of the South African Institute of Computer Scientists and Information Technologists, Thaba Nchu, South Africa, 2017, pp. 1–10. doi: 10.1145/3129416.3129428.

S. A. Ajibola and L. Goosen, "Information Systems Architecture and Technology Security Aspects Relating to the Usability Attributes and Evaluation Methods of Mobile Commerce Websites," in 40th International Conference Information Systems Architecture and Technology, Wrocław, Poland, 2019, pp. 40–53.

D. Nyumbeka and J. Wesson, "Using Mobile Computing to Support Malnutrition Management in South Africa," in Proceedings of the Southern African Institute for Computer Scientist and Information Technologists Annual Conference on Empowered by Technology, 2014, pp. 352–360. doi: 10.1145/2664591.2664622.

S. A. Ajibola and L. Goosen, "Development of Landscape of Usability Evaluation Methods for Mobile Applications," International Journal of Computer Science Engineering, vol. 8, no. 2, pp. 89–102, 2019.

A. S. Ajibola and L. Goosen, "Missed Opportunities in Mobile E-Commerce Usability," International Journal of Scientific & Engineering Research, vol. 5, no. 6, pp. 954–956, 2014.

A. S. Ajibola and L. Goosen, "Trends of Mobile E-Commerce Usability in South Africa," South Africa, p. 3, 2013.

Downloads

Published

2022-09-30

How to Cite

Ajibola, A. S. ., Abiodun, E. T. ., & Goosen, L. . (2022). Development of A New Model for the Usability Evaluation of M-commerce Applications. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 14(3), 1–9. Retrieved from https://jtec.utem.edu.my/jtec/article/view/6189