A Systematic Review on Usability Evaluation Methods for M-Commerce Apps
Keywords:
M-Commerce Apps/Applications, Systematic Review, Usability Evaluation Methods,Abstract
There are several literatures pertaining to the usability of mobile commerce (m-commerce) applications, however, these literatures do not sufficiently address issues about usability methods or adequately provide knowledge concerning usability methods used in most of the empirical usability evaluation for applications in m-commerce. Hence, this paper attempts to review available literatures with the aim of capturing the usability techniques commonly or frequently used in the domain of usability evaluation for applications in m-commerce. To achieve the stated research goal, the study applied systematic literature review methodology. Sixty seven (67) papers in the area of usability evaluation for m-commerce apps were downloaded. Out of these papers, twenty one (21) most relevant studies were selected for review in order to extract the appropriate information needed for the analysis. The results from the review reveal that heuristic evaluation, formal test and think-aloud methods are the most commonly utilized methods in m-commerce application usability evaluation compared to the cognitive walkthrough and informal test methods. In addition, most of the studies applied control experiment (33.30% of the total reviewed studies); other studies that applied case study in usability evaluation make up 14.28%. However, most of the studies reviewed, lacked comprehensive framework to demonstrate the applicability of other usability methods in m-commerce domain such as survey and field study. The results from this paper provide additional knowledge for usability practitioners, designers, developers, and the research community to know the current usability methods applied in m-commerce application evaluation.References
A. Hussain, M. Kutar, "Usability metric framework for mobile phone application". PGNet, 2009, pp.978.
J. Nielsen, Usability engineering, Elsevier, 1994.
S. Keele, Guidelines for perf. systematic literature reviews in softw. eng., Tech. report, EBSE-2007-01, 2007.
S.S Aparna, K. Basheer, "A Systematic Review on measuring and evaluating web usability in Model Driven Web Development", Int'l J. Eng. Dev. & Res., 2014.
I.M. Moczarny, Dual-method usability evaluation of e-commerce
websites: in quest of better user exp. 2011.
R. Ravendran, I. MacColl, M. Docherty, "Usabiity Evaluation of a TagBased Interface". J. usab. Stud., vol.7, no.4, 2012, pp.143-160.
C. Jooste, J. Van Biljon, J. Mentz, "Usability evaluation for Business Intelligence applications: A user support perspective". South African Computer Journal, Special Issue 1, vol.53, 2014, pp.32-44.
Y.E. Lee, I. Benbasat, "A framework for the study of customer interface design for mobile commerce". Int'l J. Electronic Commerce, vol.8, no.3, 2004, pp.79-102.
S.S Chan, "Usability for Mobile Commerce Across Multiple Form Factors". J. Elect.. Com. Res., vol.3, no.3, 2002, pp.187-199.
C. Condos, Ten usability principles for the devevelopment of effective WAP and m-commerce services. MCB UP Ltd, 2002
B. Kitchenham, "Procedures for performing systematic reviews". Keele, UK, Keele University, vol.33, 2004, pp.1-26.
B. Moczarny, M. De Villiers, J. Van Biljon. "How can usability contribute to user experience?: a study in the domain of e-commerce". South African Institute for Comp. Scientists & Info. Technologists Conf. 2012.
P. Tarasewich, "Wireless devices for mobile commerce: user interface design and usability". Mobile commerce: technology, theory, and applications, 2003, pp.26-50.
Q. Min, S. Li, Q. Zhong. "An Empirical Study of M-Commerce Adoption from Usability Perspective". 8th Int'l Conf. on Mobile Business, 2009.
A. Singh, J. Wesson. "Evaluation criteria for assessing the usability of ERP systems". Annual research conf. of the South African Institute of Computer Scientists & Info. Technologists. ACM, 2009.
S.J. Barnes, B. Corbitt, "Mobile banking: concept & potential". Int'l J. Mobile Comm., vol.1, no.3, 2003, pp.273-288.
R. Jeffries, et al. "User interface evaluation in the real world: a comparison of four techniques". SIGCHI conference on Human factors in computingsystems. ACM, 1991.
S. Odeh, I.O. Adwan, A Usability Testing Approach to Evaluate UserInterfaces in Business Administration. 2009.
C. Salvador, A. Nakasone, J.A. Pow-Sang. "A systematic review of usability techniques in agile methodologies". 7th Euro American Conf. on Telematics and Info. Systems, ACM, 2014.
A. Fernandez, S. Abrahão, E. Insfran. "A systematic review on the effectiveness of web usability evaluation methods". 16th Int'l Conf. on Evaluation & Assessment in Software Engineering 2012.
L.H.A. Salazar, et al., "A systematic literature review on usability heuristics for mobile phones". International Journal of Mobile Human Computer Interaction (IJMHCI), vol.5, no.2, 2013, pp.50-61.
E. Insfran, A. Fernandez. "A systematic review of usability evaluation in Web development". in Web Info. Systems Eng. WISE 2008 Workshops, Springer, 2008.
A. Fernandez, E. Insfran, S. Abrahão, "Usability evaluation methods for the web: A systematic mapping study". Information and Software Technology, vol.53, no.8, 2011, pp.789-817.
F. Paz, J.A. Pow-Sang. "Current Trends in Usability Evaluation Methods:A Systematic Review" in Advanced Software Engineering and Its Applications (ASEA), IEEE, 2014.
K. Hassanein, M.M. Head. "Ubiquitous Usability: Exploring Mobile Interfaces within the Context of a Theoretical Model". CAiSE
Workshops. Citiseer, 2003.
A.M.K. Ahmad, H.A. Al-Zu’bi, "E-banking functionality and outcomes of customer satisfaction: an empirical investigation". Int'l J. Marketing Studies, vol.3, no.1, 2011, pp.50.
E.A. Emmanuel, M.H. Nsung-Nza, Mobile Commerce Interaction Techniques for African Rural Economy Development: A Case Study for Dwesa. 2012.
R. Alnanih, R., O. Ormandjieva, T. Radhakrishnan. "A new quality-inuse model for mobile user interfaces" in Software Measurement and the 2013 8th Int'l Conf. on Software Process and Product Measurement 2013.
J.J Wang, et al. "Design and evaluation of m-commerce applications". Asia-Pacific Conf. on Comm., 2005.
V. Venkatesh, V., V. Ramesh, A.P. Massey, "Understanding usability in mobile commerce". Communications of the ACM, vol.46, no.12, 2003, pp.53-56.
M. Zarifopoulos, A.A. Economides, "Evaluating mobile banking portals".Int'l J. Mobile Communications, 7(1), (2009), 66-90.
C.R. Wu, The study of mobile commerce and operational efficiency-an application of Cox proportional hazard model. (2012).
A. Hussain, E.O.C. Mkpojiogu, Z. Hussain, "Usability evaluation of a web-based health awareness portal on Smartphone devices using ISO 9241-11 model". Jurnal Teknologi, 77 (4), (2015), 1-5.
A. Hussain, E.O.C. Mkpojiogu, "An application of ISO/IEC 25010 standard in the quality-in-use assessment of an online health awareness system". Jurnal Teknologi, 77 (5), (2015), 9-13.
A. Hussain, E.O.C. Mkpojiogu, "The effect of responsive web design on the user experience with laptop and Smartphone devices". Jurnal Teknologi, 77 (4), (2015), 41-47.
A. Hussain, E.O.C. Mkpojiogu, F. Hassan. "Systematic review of mobile learning applications for children". Proceedings of the 2nd International Conference on Information and Communication Technology for Transformation (IC-ICT4T’16), 5-7 April 2016, Kota Kinabalu, Sabah, Malaysia.
A. Hussain, E.O.C. Mkpojiogu. "Perceived usefulness, perceived ease of use, and perceived enjoyment as drivers for the user acceptance of interactive mobile maps". Proceedings of the 1st
International Soft Science Conference (ISSC’16), 11-13 April 2016, Langkawi Island, Malaysia.
A. Hussain, E.O.C. Mkpojiogu, E.O.C. "A systematic review of usability test metrics for mobile video streaming apps". Proceedings of the 1st International Soft Science Conference (ISSC’16), 11-13 April 2016, Langkawi Island, Malaysia.
E.O.C. Mkpojiogu, N.L. Hashim, R. Adamu. "Observed demographic differentials in user perceived satisfaction on the usability of mobile banking applications". 8th Knowledge Management International Conference (KMICe’16), Chiang Mai, Thailand, 29-30 August 2016.
A. Hussain, E.O.C. Mkpojiogu, "Antecedents to user adoption of interactive mobile maps" Journal of Technology, Electronics & Computer Engineering (JTEC), 2016.
A. Hussain, E.O.C. Mkpojiogu." Mobile video streaming applications: A systematic review of test metrics in usability evaluation" Journal of Technology, Electronics & Computer Engineering (JTEC), 2016.
Downloads
Published
How to Cite
Issue
Section
License
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.
