Timeliness, Steadiness, Behaviourness and Effortlessness: An Efficiency Evaluation Model for Measuring Mobile Applications Usage


  • Amalina F. A. Fadzlah Department of Computer Science, Faculty of Science and Defence Technology, National Defence University of Malaysia, 57000 Kuala Lumpur, Malaysia.


Efficiency Measure, Evaluation Framework, User Interface, Mobile Applications,


Both the theory and practice of measuring the efficiency of mobile applications usage have been hampered by the absence of a thorough mathematically based model as a method for evaluation. This research effort has been in a position to derive a preliminary mathematically based specification and measurement scheme specifically for assessing the mobile applications usage from the perspective of efficiency measures. The ultimate value for developing a mathematical oriented approach is to provide a systematic and quantitative method for conducting mobile applications usage efficiency evaluation research. As a result, a total number of 39 metrics and 10 attributes and 4 criterions were identified having associated towards measuring the efficiency of mobile applications usage. The applicability of the model was also tested on two experimental systems: Training Evaluation System (PELAKAD) group where participants manipulated the cadet training tasks; and Clinical Information System (CAPSULE) group where participants manipulated the clinical delivery tasks). Analysis of the efficiency on both types of systems was assessed in terms of timeliness, steadiness, behaviourness, and effortlessness. As a result, it was concluded that the model developed and proposed in this study provides a common basis for comparison between systems as well as helping in selecting suitable product based on their needs and requirements. By producing a quantifiable measurement, the overall efficiency of mobile applications usage thus can be assessed.


Greenspun H, Coughlin S. (2012). mHealth in an mWorld: How Mobile Technology is Transforming Health Care, Washington, DC: Deloitte Center for Health Solutions.

Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P. (2013). The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis, PLoS Med, 10 (1).

Gary, A. (2011). Invasion of the mobile apps, Communications of the ACM, 54(9), 16-18.

Dehlinger, J. and Dixon, J. (2011). Mobile Application Software Engineering: Challenges and Research Directions, Proceedings of the Workshop on Mobile Software Engineering. Springer, 29–32.

Zhang D, Adipat B. (2005). Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications”, International Journal of Human-Computer Interaction, 18 (3), 293–308.

Gafni, R. (2009). Usability Issues in Mobile - Wireless Information Systems, Issues in Informing Science and Information Technology, 6, 755-769.

Yahaya, J., Deraman, A., Baharom, F., Hamdan, A. R. (2011). SPQF: Software Process Quality Factor: For Software Process Assessment and Certification, Proceedings of the International Conference on Electrical Engineering and Informatics, Bandung, Indonesia.

Deraman, A., Kamaruddin, A., Yahya, S., Selamat, H., & Zulzalil, H. (2001). Perception On Software Certification Model: An Empirical Study, Proceeding of the International Conferencen on Information Technology and Multimedia (ICIMU, 2001), Uniten, Malaysia, 464-469.

Fadzlah A. F. A. and Deraman, A. (2007). Measuring the Usability of Software Applications: Metrics for Behaviorness, Proceedings of the 2007 International Conference in Computational Science and Its Applications, Vol Part II, Springer-Verleg Berlin, Heidelberg.

Fadzlah A. F. A. (2016). Defence Mobile Application System Usability Evaluation Scale (Defence-MoASUES): Examining Construct Validity using Exploratory Factor Analysis Results, Proceedings of the International Conference on Defence and Security Technology (DSTC2016), Putrajaya, Malaysia

Paz, F. and Pow-Sang, J. A. (2014). Current Trends in Usability Evaluation Methods: A Systematic Review, Proceedings of the 2014 7th International Conference on Advanced Software Engineering and Its Applications, pp. 11-15.

Nielsen, J. and Landauer, T. K. (1993). A Mathematical Model of the Finding of Usability Problems, Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, pp. 206-213.

Ghasemifard, N., Shamsi, M., Kenari, A. R., Ahmadi, V. (2015). A New View at Usability Test Methods of Interfaces for Human Computer Interaction, Global Journal of Computer Science and Technology, 15 (1).

Fadzlah A. F. A. (2011). An Initial Mathematical Model for Quantifying the Accuracy of Handheld Application Usage, Proceedings of the International Conference on Computer and Software Modeling (ICCSM’2011), Singapore.

Fadzlah A. F. A. (2016). Readiness Measurement Model (RMM): Mathematical-based Evaluation Technique for the Quantification of Knowledge Acquisition, Individual Understanding, and Interface Acceptance Dimensions of Software Applications on Handheld Devices, Proceedings of the 4th International Conference on Computer Science, Applied Mathematics and Applications (ICCSAMA 2016), Vienna, Austria.




How to Cite

A. Fadzlah, A. F. (2017). Timeliness, Steadiness, Behaviourness and Effortlessness: An Efficiency Evaluation Model for Measuring Mobile Applications Usage. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(2-9), 59–69. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2677