Integrated-Software Sustainability Evaluation Model (i-SSEM) Development


  • Ruzita Ahmad Human-Centered Computing Research Lab, School of Computing, Universiti Utara Malaysia, 06010, Kedah, Malaysia
  • Azham Hussain Human-Centered Computing Research Lab, School of Computing, Universiti Utara Malaysia, 06010, Kedah, Malaysia
  • Fauziah Baharom Human-Centered Computing Research Lab, School of Computing, Universiti Utara Malaysia, 06010, Kedah, Malaysia


Software sustainability evaluation, sustainability dimension, evaluation criteria, goal question metric (GQM),


An integrated-Software Sustainability Evaluation Model (i-SSEM) presents the holistic evaluation criteria of software sustainability with performed the systematic measurement by using Goal Question Metric (GQM) approach. The required of the holistic evaluation in software sustainability is to address the limitations of the previous studies in which the needs to integrate all evaluation criterion into sustainability dimension such as environment, economic and social. The evaluation criteria are supported by references standards such as standard organization of product quality, sustainability development principal introduced by Bruntland Commission Report and the best practices from individual and organization in software sustainability evaluation (SSE). In order to provide the holistic SSE with integrated all sustainability dimensions, the proposed characteristic and sub-characteristic is evaluated based on “what, who, when, why, where” and “how” to measure the criteria. The proposed evaluation criteria consist nine (9) characteristics and thirty-two (32) sub-characteristics with nineteen (19) metrics. Embedded of GQM contributes in defining the measurement goals by determining the purposes, perspectives, point of views in the following context of environment with respect to achieve software sustainability.


U. N. W. Commission, “Report of the World Commission on Environment and Development: Our Common Future” in United Nations Conference on Environment and Development, 1987.

J. Cabot, S. Easterbrook, J. Horkoff, and J. Maz, “Integrating Sustainability in Decision-Making”, Processes_A Modelling Strategy. Journal of Green Engineering, 1–4. 2009.

H. Koziolek, “Sustainability Evaluation of Software Architectures: A Systematic Review”, Journal of Environmental Assessment Policy and Management. 2011.

H. Koziolek, D. Domis, T. Goldschmidt, and P. Vorst, “Measuring Architecture Sustainability”, IEEE Software, 30(6), 54–62. doi:10.1109/MS.2013.101. 2013.

C. Calero and M. F. Bertoa, “Sustainability and Quality: icing on the cake”, Journal of Green Engineering. 2013.

C. Calero, M. A. Moraga, and M. F. Bertoa, “Towards a Software Product Sustainability Model”, Journal of Sustainability, 25010, 4. Retrieved from 2013.

B. Penzenstadler, A. Raturi, and D. Richardson, “Safety, Security, Now Sustainability: The Nonfunctional Requirement for the 21st Century”, IEEE Software, 31, 40–47. doi:10.1109/MS.2014.22. 2013.

B. Penzenstadler, and H. Femmer, “A generic model for sustainability with process- and product-specific instances”, Proceedings of the 2013 workshop on Green in/by software engineering - GIBSE ’13, 3. 2013.

J. Schelp, and S. Aier, “SOA and EA — Sustainable Contributions for Increasing Corporate Agility”, Proceedings of the 42nd Hawaii International Conference on System Sciences, 1–8. 2009.

J. Governor, “SOA: An On Ramp to Sustainability”, Redmonk Greenpaper, (March), 1–9. 2009.

C. C. Venters, L. Lau, M. K. Griffiths, V. Holmes, R. R. Ward and J. Xu, “The Blind Men and the Elephant: Towards a Software Sustainability Architectural Evaluation Framework”, Journal of Green Engineering. 2013.

S. A. Kocak, “Green Software Development and Design for Environmental Sustainability”, Journal of Green Engineering. 2012.

P. Lago, S. A. Kocak, I. Crnkovic and B. Penzenstadler, “Framing Sustainability as a Property of Software Quality”, Communication of the ACM. Vol.58, No.10, DOI: 10.1145/2714560. 2015.

R. Ahmad, F. Baharom, and A. Hussain, “A Systematic Review on Characteristic and Sub-Characteristic for Software Development towards Software Sustainability”, World Scientific and Engineering Academy and Society (Wseas), 23 –25 April 2015, Kuala Lumpur, Malaysia 2015.

R. Ahmad, F. Baharom, and A. Hussain, “A Systematic Literature Review on Sustainability Studies in Software Engineering”, Knowledge Management International Conference (KMICe), 12–15 August 2014, Malaysia 2014.

Z. Durdik, B. Klatt, H. Koziolek, K. Krogmann, J. Stammel, and R. Weiss, “Sustainability guidelines for long-living software systems”, 2012 28th IEEE International Conference on Software Maintenance (ICSM), 517–526. doi:10.1109/ICSM.2012.640531. 2012.

Software Sustainability Institute, Retrieved from 2010-2016.

ISO/IEC25023, “ISO Standards”, Retrieved from 2016.

ISO/IEC25022, “ISO Standards”, Retrieved from 2012.

ISO/IEC25010, “ISO Standards”. Retrieved from 2010.

M. Uddin, A. Shah, R. Alsaqour and J. Memon, “Measuring Efficiency of Tier Level Data Centers to Implement Green Energy Efficient Data Centers”, Middle-East Journal of Scientific Research. 15 (2). 200-207. ISSN 1990-9233. 2013.

R. B. Gibson, “Beyond the three pillars : Sustainability Assessment as a Framework for Effective Integration of Social, Economic, and Ecological Considerations in Significant Decision Making”, Journal of Environmental Assessment Policy and Management, 8(3), 259–280. 2006.

R. Ciegis, J. Ramanauskiene, and B. Martinkus, “The Concept of Sustainable Development and its Use for Sustainability Scenarios”, Engineering Economics, (2), 28–37. 2009.

V. R. Basili, J. Heidrich, and M. Lindvail, “Bridging the Gap between Business Strategy and Software Development Why Measurement?” International Conference on Information Systems (2007), 1–16. 2007.

V. R Basili, G. Caldiera, and H. D. Rombach, H. D. (1994), “The goal question metric approach”, Encyclopedia of Software Engineering, 2, 528–532. doi: 1994.

V. R Basili, M. Lindvall, N. Regardie, M, C. Seaman, J. Heidrich, J. Münch, and A. Trendowicz, “Linking software development and business strategy through measurement”, IEEE Computer Society, 43(4), 57–65. doi:10.1109/MC.2010.108. 1997

R. Ahmad, F. Baharom, and A. Hussain, “Goal Oriented Measurement for Software Sustainable Evaluation Metric Focused on Environmental Dimension”, Knowledge Management International Conference (KMICe) 2016, 29 – 30 August 2016, Malaysia.




How to Cite

Ahmad, R., Hussain, A., & Baharom, F. (2018). Integrated-Software Sustainability Evaluation Model (i-SSEM) Development. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 10(1-11), 39–46. Retrieved from

Most read articles by the same author(s)

1 2 3 4 > >>