A Comparison on Similarity Distances and Prioritization Techniques for Early Fault Detection Rate

Authors

  • Safwan Abd Razak Faculty of Computing, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia.
  • Mohd Adham Isa Faculty of Computing, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia.
  • Dayang Norhayati Abang Jawawi Faculty of Computing, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia.

Keywords:

Product-Line Testing, Prioritization, Software Product Lines,

Abstract

Nowadays, the Software Product Line (SPL) had replaced the conventional product development system. Many researches have been carried out to ensure the SPL usage prune the benefits toward the recent technologies. However, there are still some problems exist within the concept itself, such as variability and commonality. Due to its variability, exhaustive testing is not possible. Various solutions have been proposed to lessen this problem. One of them is prioritization technique, in which it is used to arrange back the test cases to achieve a specific performance goal. In this paper, the early fault detection is selected as the performance goal. Similarity function is used within our prioritization approach. Five different types of prioritization techniques are used in the experiment. The experiment results indicate that the greed-aided-clustering ordered sequence (GOS) shows the highest rate of early fault detection.

References

P. Clements, and L. Northrop, Software product lines: Practices and Patterns. USA: Addison-Wesley, 2002, pp. 5-6.

D. M. Weiss, “The Product Line Hall of Fame,” in Proceedings of the International Software Product Line Conference (SPLC), San Francisco, 2008, pp. 395-395.

G. Perrouin, S. Oster, S. Sen, J. Klein, B. Budry, and Y. le Traon, “Pairwise testing for software product lines: comparison of two approaches,” Software Quality Journal, vol. 20, no. 3-4, pp. 605-643, Sep. 2012.

C. Catal and D. Mishra, “Test case prioritization: a systematic mapping study,” Software Quality Journal, vol. 21, no. 3, pp. 445-478, Sep. 2013.

G. Rothermel, R. Untch, C. Chu, and M. Harrold, “Test case prioritization: An empirical study,” in Proceedings IEEE International Conference on Software Maintenance, Oxford, 1999, pp. 179-188.

H. Hemmati, and L. Briand, “An industrial investigation of similarity measures for model-based test case selection,” in Symposium IEEE 21st International on Software Reliability Engineering (ISSRE), San Jose, 2010, pp. 141-150.

M. Al-Hajjaji, T. Thüm, M. Lochau, J. Meinicke, and G. Saake, “Effective product-line testing using similarity-based product prioritization,” Software & Systems Modeling, vol. 16, pp. 1-23, Dec. 2016.

A. B. Sánchez, S. Segura, and A. Ruiz-Cortés, “A comparison of test case prioritization criteria for software product lines,” in Conference IEEE Seventh International Conference on Software Testing, Verification and Validation (ICST), Cleveland, 2014, pp. 41-50.

C. Fang, Z. Chen, K. Wu, and Z. Zhao, “Similarity-based test case prioritization using ordered sequences of program entities,” Software Quality Journal, vol. 22, no. 2, pp. 335-361, Jun 2014.

C. Henard, M. Papadakis, G. Perrouin, J. Klein, P. Heymans, and Y. Le Traon, “Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines,” IEEE Transactions on Software Engineering, vol. 40, no. 7, pp. 650-670, Jul 2014.

S. Elbaum, A. G. Malishevsky, and G. Rothermel, “Test case prioritization: A family of empirical studies,” IEEE transactions on software engineering, vol. 28, no. 2, pp. 159-182, Feb 2002.

C. Dietrich, R. Tartler, W. Schröder-Preikshat, and D. Lohmann, “Understanding linux feature distribution,” in Proceedings of the 2012 workshop on Modularity in Systems Software, Potsdam, 2012, pp. 15- 20.

X. Qu, M. B. Cohen, and K. M. Woolf, “Combinatorial interaction regression testing: A study of test case generation and prioritization,” in Conference IEEE International Conference on Software Maintenance (ICSM), Maison Internationale, 2007, pp. 255-264.

G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold, “Prioritizing test cases for regression testing,” IEEE Transactions on software engineering, vol. 27, no. 10, pp. 929-948, Oct 2001.

L. Zhang, D. Hao, L. Zhang, G. Rothermel, and H. Mei, “Bridging the gap between the total and additional test-case prioritization strategies,” in Proceedings of the 2013 International Conference on Software Engineering, San Francisco, 2013, pp. 192-201.

K. C. Kang, S. G. Cohen, J. A. Hess, W. E. Novak, and A. S. Peterson, Feature-oriented domain analysis (FODA) feasibility study. Pittsburgh, PA: Carnegie-Mellon University, 1990.

M. F. Johansen, Ø. Haugen, and F. Fleurey, “An algorithm for generating t-wise covering arrays from large feature models,” in Proceedings of the 16th International Software Product Line Conference, Salvador, 2012, pp. 46-55.

B. Jiang, Z. Zhang, W. K. Chan, and T. H. Tse, “Adaptive random test case prioritization,” in Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering, Auckland, 2009, pp. 233-244.

Downloads

Published

2017-10-20

How to Cite

Abd Razak, S., Isa, M. A., & Abang Jawawi, D. N. (2017). A Comparison on Similarity Distances and Prioritization Techniques for Early Fault Detection Rate. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-3), 89–94. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2883

Issue

Vol. 9 No. 3-3: Special Issue on Software Engineering I

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.