Crowdsource Requirements Engineering: Using Online Reviews as Input to Software Features Clustering


  • Noor Hasrina Bakar Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 UKM Bangi, Selangor, Malaysia.
  • Zarinah M. Kasirun Faculty of Computer Science and Information Technology, University of Malaya, 50603 Kuala Lumpur, Malaysia.
  • Norsaremah Salleh Kuliyyah of Information and Communication Technology, International Islamic University Malaysia, 50728 Kuala Lumpur, Malaysia.
  • Azni H. Halim Faculty Science and Technology, Universiti Sains Islam Malaysia, 71800 Nilai, Negeri Sembilan, Malaysia.


Crowdsource Software Development, Feature Extraction, Requirements Engineering, Similar Systems Development,


As to date, various software being produced to help in our daily routines. At times, there are complaints on errors or faults lodged by users over the internet. This information can be valuable for software development teams to enhance the software functionalities in the next releases. Not only that, these comments contain important software features that can be extracted and reuse for future development of similar software systems. Reviews provided by various user from unknown background is an example of open call involvement in crowdsource software engineering. In this paper, sample software reviews available in the internet were collected. In the experiment conducted, twenty-five groups of random software reviews within the domain of children online learning software were selected as input to crowdsource requirements engineering. T h e extracted reviews were then clustered into related groups by using K-Means algorithm. The clustering results achieved by K-Means were evaluated in terms of cluster compactness and cohesion. A statistically significant result with time efficiency obtained and reported at the end of this paper. Based on this information, this paper provides some recommendations on how user reviews can be used as input to the crowdsource requirements engineering either for improving existing software or for production of a new similar systems.


K. Mao, L. Capra, M. Harman, and Y. Jia, “A survey of the use of crowdsourcing in software engineering,” J. Syst. Softw., 2017. vol 126, pp. 57-84.

E. Guzman and W. Maalej, “RE 2014 - Appstore review and reuse,” in How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews, 2014, pp. 153– 162.

N. Genc-Nayebi and A. Abran, “A systematic literature review: opinion mining studies from mobile app store user reviews,” J. Syst. Softw., 2017. vol. 125, pp 207-219.

L. V. G. Carreno, and K. Windbladh. “Analysis of user comments: An approach for software requirements evolution,” in 2013 35th International Conference on Software Engineering (ICSE), 2013, pp. 582–591.

J. Howe, “The rise of Crowdsourcing,” Wired, vol. 14, no. 6, pp. 1-4, 2006.

N. Hasteer, N. Nazir, A. Bansal, and B. K. Murthy, “Crowdsourcing software development: Many benefits many concerns,” Phys. Procedia, vol. 78, pp. 48–54, 2016.

K.-J. Stol and B. Fitzgerald, “Two’s company, three’s a crowd: a case study of crowdsourcing software development,” in Proceedings of the 36th International Conference on Software Engineering - ICSE 2014, 2014, pp. 187–198.

T. T. D. Latoza and A. van der Hoek, “Crowdsourcing in software engineering: Models, opportunities, and challenges,” IEEE Softw., vol. 33, no. 1, pp. 1–13, 2016.

D. Damian and A. Finkelstein, “StakeSource2.0: Using social networks of stakeholders to identify and prioritise requirements,” in 33rd Internation Conference of Software Engineering, ICSE 2011, 2011, pp. 1022–1024.

S. L. Lim and A. Finkelstein, “StakeRare: Using social networks and collaborative filtering for large-scale requirements elicitation,” IEEE Trans. Softw. Eng., vol. 38, no. 3, pp. 707–735, 2012.

A. Adepetu, K. Ahmed, and Y. Al Abd, “CrowdREquire: A Requirements Engineering Crowdsourcing Platform,” in 2012 AAAI Spring Symposium Series, 2012, pp. 1-6, Available at 4685, Date retrieved: 28/8/2017.

N. H. Bakar, Z. M. Kasirun, N. Salleh, and A. H. A. Halim, “Extracting software features from online reviews to demonstrate requirements reuse in software engineering,” in Proceedings of the International Conference on Computing & Informatics, 2017, pp. 184-190.

S. Deerwester, S. T. Dumais, G. W. Furnas, and T. K. Landauer, “Indexing by latent semantic analysis,” J. Am. Soc. Inf. Sci., vol. 41, no. 6, p. 391, 1998.

D. Hand, H. Mannila, and P. Smyth, Principles of Data Mining. Adaptive C. MIT Press, 2001.




How to Cite

Bakar, N. H., M. Kasirun, Z., Salleh, N., & H. Halim, A. (2017). Crowdsource Requirements Engineering: Using Online Reviews as Input to Software Features Clustering. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-3), 141–146. Retrieved from