A Systematic Review on Usability Evaluation Methods for M-Commerce Apps


  • Azham Hussain School of Computing, Universiti Utara Malaysia, 06010 Sintok, Malaysia.
  • Emmanuel O.C Mkpojiogu School of Computing, Universiti Utara Malaysia, 06010 Sintok, Malaysia.
  • Fazillah Mohmad Kamal School of Quantitative Science, Universiti Utara Malaysia, 06010 Sintok, Malaysia.


M-Commerce Apps/Applications, Systematic Review, Usability Evaluation Methods,


There are several literatures pertaining to the usability of mobile commerce (m-commerce) applications, however, these literatures do not sufficiently address issues about usability methods or adequately provide knowledge concerning usability methods used in most of the empirical usability evaluation for applications in m-commerce. Hence, this paper attempts to review available literatures with the aim of capturing the usability techniques commonly or frequently used in the domain of usability evaluation for applications in m-commerce. To achieve the stated research goal, the study applied systematic literature review methodology. Sixty seven (67) papers in the area of usability evaluation for m-commerce apps were downloaded. Out of these papers, twenty one (21) most relevant studies were selected for review in order to extract the appropriate information needed for the analysis. The results from the review reveal that heuristic evaluation, formal test and think-aloud methods are the most commonly utilized methods in m-commerce application usability evaluation compared to the cognitive walkthrough and informal test methods. In addition, most of the studies applied control experiment (33.30% of the total reviewed studies); other studies that applied case study in usability evaluation make up 14.28%. However, most of the studies reviewed, lacked comprehensive framework to demonstrate the applicability of other usability methods in m-commerce domain such as survey and field study. The results from this paper provide additional knowledge for usability practitioners, designers, developers, and the research community to know the current usability methods applied in m-commerce application evaluation.


A. Hussain, M. Kutar, "Usability metric framework for mobile phone application". PGNet, 2009, pp.978.

J. Nielsen, Usability engineering, Elsevier, 1994.

S. Keele, Guidelines for perf. systematic literature reviews in softw. eng., Tech. report, EBSE-2007-01, 2007.

S.S Aparna, K. Basheer, "A Systematic Review on measuring and evaluating web usability in Model Driven Web Development", Int'l J. Eng. Dev. & Res., 2014.

I.M. Moczarny, Dual-method usability evaluation of e-commerce

websites: in quest of better user exp. 2011.

R. Ravendran, I. MacColl, M. Docherty, "Usabiity Evaluation of a TagBased Interface". J. usab. Stud., vol.7, no.4, 2012, pp.143-160.

C. Jooste, J. Van Biljon, J. Mentz, "Usability evaluation for Business Intelligence applications: A user support perspective". South African Computer Journal, Special Issue 1, vol.53, 2014, pp.32-44.

Y.E. Lee, I. Benbasat, "A framework for the study of customer interface design for mobile commerce". Int'l J. Electronic Commerce, vol.8, no.3, 2004, pp.79-102.

S.S Chan, "Usability for Mobile Commerce Across Multiple Form Factors". J. Elect.. Com. Res., vol.3, no.3, 2002, pp.187-199.

C. Condos, Ten usability principles for the devevelopment of effective WAP and m-commerce services. MCB UP Ltd, 2002

B. Kitchenham, "Procedures for performing systematic reviews". Keele, UK, Keele University, vol.33, 2004, pp.1-26.

B. Moczarny, M. De Villiers, J. Van Biljon. "How can usability contribute to user experience?: a study in the domain of e-commerce". South African Institute for Comp. Scientists & Info. Technologists Conf. 2012.

P. Tarasewich, "Wireless devices for mobile commerce: user interface design and usability". Mobile commerce: technology, theory, and applications, 2003, pp.26-50.

Q. Min, S. Li, Q. Zhong. "An Empirical Study of M-Commerce Adoption from Usability Perspective". 8th Int'l Conf. on Mobile Business, 2009.

A. Singh, J. Wesson. "Evaluation criteria for assessing the usability of ERP systems". Annual research conf. of the South African Institute of Computer Scientists & Info. Technologists. ACM, 2009.

S.J. Barnes, B. Corbitt, "Mobile banking: concept & potential". Int'l J. Mobile Comm., vol.1, no.3, 2003, pp.273-288.

R. Jeffries, et al. "User interface evaluation in the real world: a comparison of four techniques". SIGCHI conference on Human factors in computingsystems. ACM, 1991.

S. Odeh, I.O. Adwan, A Usability Testing Approach to Evaluate UserInterfaces in Business Administration. 2009.

C. Salvador, A. Nakasone, J.A. Pow-Sang. "A systematic review of usability techniques in agile methodologies". 7th Euro American Conf. on Telematics and Info. Systems, ACM, 2014.

A. Fernandez, S. Abrahão, E. Insfran. "A systematic review on the effectiveness of web usability evaluation methods". 16th Int'l Conf. on Evaluation & Assessment in Software Engineering 2012.

L.H.A. Salazar, et al., "A systematic literature review on usability heuristics for mobile phones". International Journal of Mobile Human Computer Interaction (IJMHCI), vol.5, no.2, 2013, pp.50-61.

E. Insfran, A. Fernandez. "A systematic review of usability evaluation in Web development". in Web Info. Systems Eng. WISE 2008 Workshops, Springer, 2008.

A. Fernandez, E. Insfran, S. Abrahão, "Usability evaluation methods for the web: A systematic mapping study". Information and Software Technology, vol.53, no.8, 2011, pp.789-817.

F. Paz, J.A. Pow-Sang. "Current Trends in Usability Evaluation Methods:A Systematic Review" in Advanced Software Engineering and Its Applications (ASEA), IEEE, 2014.

K. Hassanein, M.M. Head. "Ubiquitous Usability: Exploring Mobile Interfaces within the Context of a Theoretical Model". CAiSE

Workshops. Citiseer, 2003.

A.M.K. Ahmad, H.A. Al-Zu’bi, "E-banking functionality and outcomes of customer satisfaction: an empirical investigation". Int'l J. Marketing Studies, vol.3, no.1, 2011, pp.50.

E.A. Emmanuel, M.H. Nsung-Nza, Mobile Commerce Interaction Techniques for African Rural Economy Development: A Case Study for Dwesa. 2012.

R. Alnanih, R., O. Ormandjieva, T. Radhakrishnan. "A new quality-inuse model for mobile user interfaces" in Software Measurement and the 2013 8th Int'l Conf. on Software Process and Product Measurement 2013.

J.J Wang, et al. "Design and evaluation of m-commerce applications". Asia-Pacific Conf. on Comm., 2005.

V. Venkatesh, V., V. Ramesh, A.P. Massey, "Understanding usability in mobile commerce". Communications of the ACM, vol.46, no.12, 2003, pp.53-56.

M. Zarifopoulos, A.A. Economides, "Evaluating mobile banking portals".Int'l J. Mobile Communications, 7(1), (2009), 66-90.

C.R. Wu, The study of mobile commerce and operational efficiency-an application of Cox proportional hazard model. (2012).

A. Hussain, E.O.C. Mkpojiogu, Z. Hussain, "Usability evaluation of a web-based health awareness portal on Smartphone devices using ISO 9241-11 model". Jurnal Teknologi, 77 (4), (2015), 1-5.

A. Hussain, E.O.C. Mkpojiogu, "An application of ISO/IEC 25010 standard in the quality-in-use assessment of an online health awareness system". Jurnal Teknologi, 77 (5), (2015), 9-13.

A. Hussain, E.O.C. Mkpojiogu, "The effect of responsive web design on the user experience with laptop and Smartphone devices". Jurnal Teknologi, 77 (4), (2015), 41-47.

A. Hussain, E.O.C. Mkpojiogu, F. Hassan. "Systematic review of mobile learning applications for children". Proceedings of the 2nd International Conference on Information and Communication Technology for Transformation (IC-ICT4T’16), 5-7 April 2016, Kota Kinabalu, Sabah, Malaysia.

A. Hussain, E.O.C. Mkpojiogu. "Perceived usefulness, perceived ease of use, and perceived enjoyment as drivers for the user acceptance of interactive mobile maps". Proceedings of the 1st

International Soft Science Conference (ISSC’16), 11-13 April 2016, Langkawi Island, Malaysia.

A. Hussain, E.O.C. Mkpojiogu, E.O.C. "A systematic review of usability test metrics for mobile video streaming apps". Proceedings of the 1st International Soft Science Conference (ISSC’16), 11-13 April 2016, Langkawi Island, Malaysia.

E.O.C. Mkpojiogu, N.L. Hashim, R. Adamu. "Observed demographic differentials in user perceived satisfaction on the usability of mobile banking applications". 8th Knowledge Management International Conference (KMICe’16), Chiang Mai, Thailand, 29-30 August 2016.

A. Hussain, E.O.C. Mkpojiogu, "Antecedents to user adoption of interactive mobile maps" Journal of Technology, Electronics & Computer Engineering (JTEC), 2016.

A. Hussain, E.O.C. Mkpojiogu." Mobile video streaming applications: A systematic review of test metrics in usability evaluation" Journal of Technology, Electronics & Computer Engineering (JTEC), 2016.




How to Cite

Hussain, A., Mkpojiogu, E. O., & Mohmad Kamal, F. (2016). A Systematic Review on Usability Evaluation Methods for M-Commerce Apps. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 8(10), 29–34. Retrieved from https://jtec.utem.edu.my/jtec/article/view/1361