Test Case Prioritization based on Extended Finite State Machine Model
Keywords:Extended Finite State Machine, Model-Based, Regression Testing, Test Case Prioritization Technique,
AbstractRegression testing is done to test the modified version of a software, however re-testing all test cases are very inefficient. Test Case Prioritization is one of the techniques used to overcome this problem. It prioritizes the test cases in the test suite by ordering them according to a desired objective goal like revealing faults earlier and has various approaches in performing it. One of them is model-based approach which utilizes the system model to make prioritization. The advantages of this approach are cheaper execution cost and lesser prioritization time compared to code-based prioritization. In this paper, we propose a model-based test case prioritization approach using extended finite state machine. The proposed approach will be based on several related existing approaches with an extra criterion of degree of code changes. The contribution of the proposed approach is it overcomes the identified limitations from the related works and improve the prioritization result.
M. Rava and W. M. Wan-Kadir, “A review on prioritization techniques in regression testing,” International Journal of Software Engineering and Its Applications, vol. 10, no. 1, pp. 221-232, 2016.
S. Yoo and M. Harman, “Regression testing minimization, selection and prioritization: a survey,” Software Testing, Verification and Reliability, vol. 22, no. 2, pp. 67-120, 2012.
C. Catal and D. Mishra, “Test case prioritization: a systematic mapping study,” Software Quality Journal, vol. 21, no. 3, pp. 445- 478, 2013.
T. Hall, S. Beecham, D. Bowes, D. Gray, and S. Counsell, “A systematic literature review on fault prediction performance in software engineering,” IEEE Transactions on Software Engineering, vol. 38, no. 6, pp. 1276-1304, 2012.
A. Mahdian, A. A. Andrews, and O. J. Pilskalns, “Regression testing with UML software designs: a survey,” Journal of Software Maintenance and Evolution: Research and Practice, vol. 21, no. 4, pp. 253-286, 2009.
S. Elbaum, P. Kallakuri, A. Malishevsky, G. Rothermel, and S. Kanduri, “Understanding the effects of changes on the cost‐ effectiveness of regression testing techniques,” Software Testing, Verification and Reliability, vol. 13, no. 2, pp. 65-83, 2003.
C.-T. Lin, K.-W. Tang, and G. M. Kapfhammer, “Test suite reduction methods that decrease regression testing costs by identifying irreplaceable tests,” Information and Software Technology, vol. 56, no. 10, pp. 1322-1344, 2014.
M. Grindal, B. Lindström, J. Offutt, and S. F. Andler, “An evaluation of combination strategies for test case selection,” Empirical Software Engineering, vol. 11, no. 4, pp. 583-611, 2006.
Y. Singh, A. Kaur, B. Suri, and S. Singhal, “Systematic Literature Review on Regression Test Prioritization Techniques,” Informatica (Slovenia), vol. 36, no. 4, pp. 379-408, 2012.
B. Korel, L. H. Tahat, and M. Harman, “Test prioritization using system models,” in 21st IEEE International Conference on Software Maintenance (ICSM'05), 2005, pp. 559-568.
L. Tahat, B. Korel, G. Koutsogiannakis, and N. Almasri, “State-based models in regression test suite prioritization,” Software Quality Journal, vol. 25, no. 3, pp. 703-742, 2016.
L. Tahat, B. Korel, M. Harman, and H. Ural, “Regression test suite prioritization using system models,” Software Testing, Verification and Reliability, vol. 22, no. 7, pp. 481-506, 2012.
M. Utting, A. Pretschner, and B. Legeard, “A taxonomy of modelbased testing approaches,” Software Testing, Verification and Reliability, vol. 22, no. 5, pp. 297-312, 2012.
M. Shafique and Y. Labiche, “A systematic review of state-based test tools,” International Journal on Software Tools for Technology Transfer, vol. 17, no. 1, pp. 59-76, 2015.
J. Ernits, R. Roo, J. Jacky, and M. Veanes, “Model-based testing of web applications using NModel,” in Testing of Software and Communication Systems. 2009, pp. 211-216.
S. Elbaum, A. G. Malishevsky, and G. Rothermel, “Prioritizing test cases for regression testing,” in ISSTA '00 Proceedings of the 2000 ACM SIGSOFT International Symposium on Software Testing and Analysis, 2000, pp. 102-112.
B. Korel, G. Koutsogiannakis, and L. H. Tahat, “Application of system models in regression test suite prioritization,” in IEEE International Conference on Software Maintenance, 2008, pp. 247- 256.
P. Sapna and H. Mohanty, “Prioritizing use cases to aid ordering of scenarios,” in Third UKSim European Symposium on Computer Modeling and Simulation, 2009, pp. 136-141.
A. Al-Herz and M. Ahmed, “Model-based web components testing: a prioritization approach,” in International Conference on Software Engineering and Computer Systems, 2011, pp. 25-40.
M. Barnett, K. R. M. Leino, and W. Schulte, “The Spec# programming system: An overview,” in International Workshop on Construction and Analysis of Safe, Secure, and Interoperable Smart Devices, 2004, pp. 49-69.
S. Elbaum, A. G. Malishevsky, and G. Rothermel, “Test case prioritization: A family of empirical studies,” IEEE Transactions on Software Engineering, vol. 28, no. 2, pp. 159-182, 2002.
How to Cite
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.