A Framework for Managing Software Testing Outsourcing Projects
Keywords:Outsourcing, Project Management, Software Testing,
AbstractSoftware testing aims to ensure that the software produced is reliable and able to function correctly. In order to do so, the testing execution requires experts and technology that might not be available within an organisation. Therefore, shifting to outsourcing for testing is one preferred option. This alternative provides benefits such as testing expertise, costs and time reduction, better testing technology and high-quality software products. Translating these benefits into practice has, however, proved challenging. Some testing outsourcing projects have failed outright. These projects either exceed the specified time or the allocated budget or failed to deliver the anticipated quality. This paper therefore intends to address this concern by providing guidance in managing software testing outsourcing projects in the form of a framework based on identified success factors. Previous studies have collected the success factors from theoretical and empirical perspectives. The investigation continues by ratifying the factors via software testing and project management experts from both the client and vendor sides. In order to develop the framework, this study adopted a qualitative approach, in which semi-structured interviews were employed to confirm the factors. The data were then analysed using content analysis. The framework consists of two aspects, namely People and Process. Four factors make up the People aspect, while another ten constitute the Process aspect. Each factor contains elements, which represent either the roles that should be played or activities that should be conducted. This framework contributes to the understanding of conducting successful software testing outsourcing projects. It could also act as a reference for future research in the software testing domain.
Y. Lu, and T. Käkölä, “A dynamic life-cycle model for the provisioning of software testing services : experiences from a case study in the chinese ict sourcing market,” in The 19th European Conf. on Information Systems (ECIS) 2011 Proc., 2011, pp. 48–59.
A. Bertolino, and I. A. Faedo, “Software testing research: achievements, challenges, dreams,” in Future of Software Engineering, 2007 (FOSE '07), 2007, pp. 85-103.
A. M. Ahmed, and W. Zhu, “Outsourcing software testing activities: a case study for eastern ocean solutions (eos) — china,” in 2011 IEEE 3rd Int. Conf. Commun. Softw. Networks (ICCSN), 2011, pp. 742–744.
I. Tervonen, A. Haapalahti, L. Harjumaa, and J. Simila, “Outsourcing software testing: a case study in the oulu area,” in 2013 13th Int. Conf. Qual. Softw. (QSIC), 2013, pp. 65–74.
K. Karhu, O. Taipale, and K. Smolander, “Outsourcing and knowledge management in software testing,” in EASE'07 Proc. of the 11th Int. Conf. on Evaluation and Assessment in Softw. Engineering, 2007, pp. 53-63.
R. S. Poston, J. C. Simon, and R. Jain, “Managing offshore outsourcing of software testing,” Available at https://umdrive.memphis.edu/gmis/www/memphis/step/documents/pa pers/PostonR.step-07.pdf (downloaded02.01.2014).
B. Nicholson, and S. Sahay, “Some political and cultural issues in the globalisation of software development : Case experience from britain and india,” Inf. Organ., vol. 11, no 1, pp. 25–43, Jan 2001.
S. Ullah, M. Niazi, and R. Ahmad, “Factors influencing clients in the selection of offshore software outsourcing vendors : An exploratory study using a systematic literature review,” J. Syst. Softw., vol. 84, no. 4, pp. 686–699, Apr. 2011.
A. U. Alam, and K. U. Siffat, “Knowledge sharing management in offshore software development outsourcing relationships from vendors’ perspective : A systematic literature review protocol,” in 2011 5th Malaysian Conf. Softw. Eng., 2011, pp. 469–474.
A. Yalaho, and N. Nahar, “Key success factors for managing offshore outsourcing of software production using the ICT-supported unified process model: a case experience from Finland, India, Nepal and Russia,” in 2010 Proc. Technol. Manag. Glob. Econ. Growth (PICMET), 2010, pp. 1–14.
R. Hanna, and T. Daim, “Critical success factors in outsourcing: case of software industry,” in Manag. Eng. Technol. Portl. Int. Cent., 2007, pp. 1456 – 1465.
H. Shah, S. Sinha, and M. J. Harrold, “Outsourced, offshored softwaretesting practice: Vendor-side experiences,” in 2011 IEEE Sixth Int. Conf. Glob. Softw. Eng., 2011, pp. 131–140.
O. Taipale, K. Karhu, and K. Smolander, “Observing software testing practice from the viewpoint of organizations and knowledge management,” in First Int. Symp. Empir. Softw. Eng. Meas. (ESEM 2007), 2007, pp. 21–30.
Z. Pei, Z. Zhen-xiang, and H. Chun-ping, “A framework for it outsourcing decision process,” in Serv. Syst. Serv. Manag., 2008, pp. 1–4.
B. Aubert, J.-F. Houde, M. Patry, and S. Rivard, “Characteristics of it outsourcing contracts,” in Proc. 36th Hawaii Int. Conf. Syst. Sci., 2003, pp. 1–9.
F. F. Ismail, and R. Razali, “Contributing factors of successful software testing outsourcing,” in 2014 8th Malaysian Softw. Eng. Conf., 2014, pp. 55–60.
F. F. Ismail, and R. Razali, “A qualitative empirical investigation of contributing success factors for software testing outsourcing projects,” J. Teknol. Science Eng., vol. 77, no. 9, pp. 97–114, 2015.
H. Shah, S. Sinha, and M. J. Harrold, “Studying the influence of culture on outsourced, offshored software-testing practice: an ethnographic approach,” in 2011 IEEE Sixth Int. Conf. Glob. Softw. Eng. Work. (ICGSEW), 2011, pp. 105–107.
R. P. Jain, R. S. Poston, and J. C. Simon, “An empirical investigation of client managers’ responsibilities in managing offshore outsourcing of software-testing projects,” IEEE Trans. Eng. Manag., vol. 58, no. 4, pp. 743–757, Nov. 2011.
I. Tervonen, “Offshoring test automation : observations and lessons learned,” in 2009 Fourth IEEE Int. Conf. Glob. Softw. Eng. Offshoring, 2009, pp. 226-235.
W. K. Abdul and U. K. Siffat, “Critical success factors for offshore software outsourcing contract management from vendors’ perspective: an exploratory study using a systematic literature review,” IET Softw., vol. 7, no. 6, pp. 327–338, Dec. 2013.
T. Herath and R. Kishore, “Offshore outsourcing: risks, challenges, and potential solutions,” Inf. Syst. Manag., vol. 26, no. 4, pp. 312–326, Oct. 2009.
S. P. Frank, T. Ossi, and K. Smolander, “Organizational and customer related challenges of software testing: an empirical study in 11 software companies,” in 2014 IEEE Eighth Int. Conf. Res. Challenges Inf. Sci. (RCIS), 2014, pp. 1–12.
C. Clott, “An uncertain future: a preliminary study of offshore outsourcing from the manager’s perspective,” Manag. Res. News, vol. 30, no. 7, pp. 476–494, June 2007.
L. M. Abdullah and J. M. Verner, “Analysis and application of an outsourcing risk framework,” J. Syst. Softw., vol. 85, no. 8, pp. 1930– 1952, Aug. 2012.
R. T. Nakatsu and C. L. Iacovou, “A comparative study of important risk factors involved in offshore and domestic outsourcing of software development projects: a two-panel delphi study,” Inf. Manag., vol. 46, no. 1, pp. 57–68, Jan. 2009.
S. U. Khan, M. Niazi, and R. Ahmad, “Critical barriers for offshore software development outsourcing vendors: a systematic literature review,” in 2009 16th Asia-Pacific Softw. Eng. Conf., 2009, pp. 79–86.
A. Ghag, “Case study : testing for utilities sector,” in Rightshore!, W. Messner, A. Hendel, and F. Thun, Eds. Springer Berlin Heidelb., 2008, pp. 187–201.
E. Lamas, L. A. V. Dias, and A. M. Da Cunha, “Applying testing to enhance software product quality,” in 2013 10th Int. Conf. Inf. Technol. New Gener (ITNG), 2013, pp. 349–356.
N. Iqbal and M. R. J. Qureshi, “Improvement of key problems of software testing in quality assurance,” Sci. Int., vol. 21, no. 1, pp. 25– 28, Mar. 2009.
A. Sanz, J. García, J. Saldaña, and A. Amescua, “A proposal of a process model to create a test factory,” in Proc. Int. Conf. Softw. Eng., 2009, pp. 65–70.
B. S. Andaloussi, and A. Braun, “A test specification method for software interoperability tests in offshore scenarios : a case study,”in IEEE Int. Conf. Glob. Softw. Eng., 2006, pp. 169-178.
L. Baresi, and M. Pezze, “An introduction to software testing,” Electron. Notes Theor. Comput. Sci., vol. 148, no. 1, pp. 89–111, 2006.
C. Kaner, “An outline for software testing outsourcing,” Available at http://www.kaner.com/pdfs/outsource.pdf (downloaded 02.01.2014), 2000.
N. Oza, T. Hall, A. Rainer, and S. Grey, “Critical factors in software outsourcing: a pilot study,” in ACM Work. Interdiscip. Softw. Eng. Res. WISER 2004, 2004, pp. 67–71.
M. Choi, M. Brand, and J. Kim, “A feasibility evaluation on the outsourcing of quality testing and inspection,” Int. J. Proj. Manag., vol. 27, no. 1, pp. 89–95, Jan 2009.
P. T. Nguyen, M. A. Babar, and J. M. Verner, “Critical factors in establishing and maintaining trust in software outsourcing relationships,” in ICSE’06 Proc. 28th Int. Conf. Softw. Eng., 2006, pp. 624–627.
M. Niazi, S. U. Khan, S. Imtiaz, M. Bano, and N. Ikram, “Establishing trust in offshore software outsourcing relationships: An exploratory study using a systematic literature review,” IET Softw., vol. 7, no. 5, pp. 283–293, Oct. 2013.
F. Li, and W. Ma, “Architecture centric approach to enhance software testing management,” in Eighth Int. Conf. on Intelligent Systems Design and Applications, 2008. ISDA'08., 2008, pp. 654-659.
U. Flick, “An introduction to qualitative research,” in An Introduction to Qualitative Research, 4th ed., London: SAGE Publications, Jan 2010.
K. Krippendorff, “Component of content analysis,” in Content Analysis: An Introduction to its Methodology. Los Angeles: SAGE Publication, 2013.
D. Elfriede, “Efective software testing, ” in 50 Specific Ways to Improve Your Testing, Canada : Pearson Education, Inc, 2003.
R. Black, “Testing throughout the software life cycle,” in Foundations of software Testing: ISTQB certification, United Kingdom: Cenange Learning, 2015.
How to Cite
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.