ABC Algorithm for Combinatorial Testing Problem

Authors

  • AbdulRahman A. Alsewari Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, IBM Centre of Excellence, Universiti Malaysia Pahang, Pahang, Malaysia.
  • Amaar K. Alazzawi Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, Universiti Malaysia Pahang, Pahang, Malaysia.
  • Taha H. Rassem Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, Universiti Malaysia Pahang, Pahang, Malaysia.
  • Muhammad N. Kabir Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, Universiti Malaysia Pahang, Pahang, Malaysia.
  • Ameen A. Ba Homaid Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, Universiti Malaysia Pahang, Pahang, Malaysia.
  • Yazan A. Alsariera Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, Universiti Malaysia Pahang, Pahang, Malaysia.
  • Nasser M. Tairan College of Computer Science, King Khaled University.
  • Kamal Z. Zamli Software Engineering Research Group, Faculty of Computer Systems and Software Engineering, Universiti Malaysia Pahang, Pahang, Malaysia.

Keywords:

Computational Intelligence, Combinatorial Optimization Problem, Software Testing, Test Data Generation,

Abstract

Computer software is in high demand everywhere in the world. The high dependence on software makes software requirements more complicated. As a result, software testing tasks get costlier and challenging due to a large number of test cases, coupled with the vast number of the system requirements. This challenge presents the need for reduction of the system redundant test cases. A combinatorial testing approach gives an intended result from the optimization of the system test cases. Hence, this study implements a combinatorial testing strategy called Artificial Bee Colony Test Generation (ABC-TG) that helps to get rid of some of the current combinatorial testing strategies. Results obtained from the ABC-TG were benchmarked with the results obtained from existing strategies in order to determine the efficiency of the ABC-TG. Finally, ABC-TG shows the efficiency and effectiveness in terms of generating optimum test cases size of some of the case studies and a comparable result with the existing combinatorial testing strategies.

References

A. A. Alsewari and K. Z. Zamli, “Interaction test data generation using harmony search algorithm,” in Proceeding of IEEE Symposium on Industrial Electronics & Applications, Langkawi, Malaysia, 2011, pp. 559-564.

A. R. A. Alsewari and K. Z. Zamli, “Design and implementation of a harmony-search-based variable-strength t-way testing strategy with constraints support,” Information and Software Technology, vol. 54, no. 6, pp. 553-568, 2012.

A. A. Ahmed and C. Xue Li, “Analyzing Data Remnant Remains on User Devices to Determine Probative Artifacts in Cloud Environment,” Journal of Forensic Sciences, 2017.

B. Hambling, P. Morgan, A. Samaroo, and P. Williams, Software Testing: An ISTQB-ISEB Foundation Guide: BCS, The Chartered Institute, 2010.

M. B. Cohen, M. B. Dwyer, and J. Shi, “Interaction testing of highlyconfigurable systems in the presence of constraints,” in the 2007 international symposium on Software testing and analysis, 2007, pp. 129-139.

A. A. B. Homaid and A. A. Alsewari, “A variable combinatorial test suite strategy based on modified greedy algorithm,” in Software Engineering and Computer Systems (ICSECS), 2015 4th International Conference on, 2015, pp. 154-159.

K. Z. Zamli, A. R. Alsewari, and B. Al-Kazemi, “Comparative benchmarking of constraints t-way test generation strategy based on late acceptance hill climbing algorithm,” International Journal of Software Engineering & Computer Sciences (IJSECS), vol. 1, pp. 14- 26, 2015.

T. Shiba, T. Tsuchiya, and T. Kikuno, “Using artificial life techniques to generate test cases for combinatorial testing,” in the 28th Annual International on Computer Software and Applications Conference, 2004. COMPSAC 2004. , 2004, pp. 72-77.

J. Stardom, Metaheuristics and the Search for Covering and Packing Arrays. Simon Fraser University, 2001.

D. M. Cohen, S. R. Dalal, M. L. Fredman, and G. C. Patton, “The AETG system: an approach to testing based on combinatorial design,” Software Engineering, IEEE Transactions on, vol. 23, no. 7, pp. 437- 444, 1997.

D. V. Reddy and A. R. M. Reddy, “An approach for fault detection in software testing through optimized test case prioritization,” International Journal of Applied Engineering Research, vol. 11, no. 1, pp. 57-63, 2016.

Y. Lei, R. Kacker, D. R. Kuhn, V. Okun, and J. Lawrence, “IPOG/IPOG‐D: efficient test generation for multi‐way combinatorial testing,” Software Testing, Verification and Reliability, vol. 18, no. 3, pp. 125-148, 2008.

Y. Lei and K.-C. Tai, “In-parameter-order: a test generation strategy for pairwise testing,” in the Third IEEE International on HighAssurance Systems Engineering Symposium, 1998, 1998, pp. 254-261.

A. Williams, J. Lo, and A. Lareau, “TConfig,” ed, 2010.

J. Czerwonka, D. Butt, and C. Gens, “Pairwise testing in real word: practical extensions to test case generators,” in Proc. of the 24th pacific northwest software quality conf. 2006, 2006.

E. Lehmann and J. Wegener, “Test case design by means of the CTE XL,” in Proceedings of the 8th European International Conference on Software Testing, Analysis & Review (EuroSTAR 2000), Kopenhagen, Denmark, 2000.

Jenkins, “Test Tool,” 2003. Available at http://www.burtleburtle.net/bob/math/jenny.html.

A. Hartman, T. Klinger, and L. Raskin, “IBM intelligent test case handler,” Discrete Mathematics, vol. 284, pp. 149-156, 2010.

P. J. Schroeder, E. Kim, J. Arshem, and P. Bolaki, “Combining behavior and data modeling in automated test case generation,” in the Third International Conference on Quality Software, 2003., 2003, pp. 247-254.

B. Nozohour-leilabady and B. Fazelabdolabadi, “On the Application of Artificial Bee Colony (ABC) Algorithm for Optimization of Well Placements in Fractured Reservoirs; Efficiency Comparison with the Particle Swarm Optimization (PSO) methodology,” Petroleum, 2015.

D. Karaboga and B. Akay, “A comparative study of artificial bee colony algorithm,” Applied mathematics and computation, vol. 214, no. 1, pp. 108-132, 2009.

Downloads

Published

2017-10-20

How to Cite

A. Alsewari, A., K. Alazzawi, A., H. Rassem, T., N. Kabir, M., A. Ba Homaid, A., A. Alsariera, Y., M. Tairan, N., & Z. Zamli, K. (2017). ABC Algorithm for Combinatorial Testing Problem. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-3), 85–88. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2877

Issue

Vol. 9 No. 3-3: Special Issue on Software Engineering I

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.