Can Scoring Rubrics be used in Assessing the Performance of Students in Software Requirements Engineering Education?
Keywords:
Engineering Education, Assessing Students’ Performance, Scoring Rubrics, Software Requirements,Abstract
In this paper, the authors investigated how helpful scoring rubrics are in the assessment of the performance of students in software requirements engineering education and how the use of the tool can lead to the enhancement of students’ performance in the design of software requirements artifacts and work products. In the study, two instructors employed scoring rubrics to assess the cognitive performance of a learner (student) in the design of software requirements work documents and artifacts. The outcome of the study shows that the utilization of scoring rubrics is very supportive in assessing software engineering students’ cognitive performance without the usual bias associated with other assessment tools. In addition, the findings indicated that the employment of scoring rubrics also helps in pointing to whether a student is either improving or not improving in an iterative or a repeated assessment. In sum, it can potentially lead to the enhancement of the learning capacity and cognitive performance achievements of requirements/software engineering students. The study’s findings offer some insights for future investigations and will provide benefits to researchers and professionals in requirements engineering, software engineering and particularly, software engineering and software requirements engineering education.References
H. Andrade and Y. Du, Students use of rubrics. Practical Assessment, Research & Evaluation, vol. 10, no.3, p.1-11, 2005.
R. Bailey and Z. Szabo, Assessing engineering design process knowledge, Int. J. Engineering Education, vol. 22, no. 3, p. 508-518, 2006.
E. Barrella and M.K. Watson, “Developing a cross-disciplinary sustainable design rubric for engineering projects”, Engineering Education for Sustainable Development, Bruges, Belgium, 4-7 September, 2016.
M. Besterfield-Sacre, J. Gerchak, M. Lyons, L.J. Shuman, and H. Wolf, Scoring concept maps: An integrated rubrics for assessing engineering education, Journal of Engineering Education, 2004. doi: 10.1002/j.2168-9830.2004.tb00795.x
L. Bodnar, M. Lagoudas, J. Hodge, T. Smith, J. Oronzco, J. Corso, C. Sanchez, J. Freise, H. Ringler, and I. Cortes, “Engaging freshman in team based engineering projects”. Proc. American Society for Engineering Education Annual Conference, 2012.
R. Caverly, H. Fulmer, S. Santhanam, P. Singh, J. O’Brien, G. Jones, E. Char, F. Mercede, R. Weinsten, and J. Yost, “Project-based freshman engineering experience: The core course”. Proc. American Society for Engineering Education Annual Conference, 2010.
B. Dirjak, D. Grabar, and M. Maretic, Assessing analytics for peer-assessment: a model and implementation, 2016.
A. Jonsson, and G. Svingby, The use of scoring rubrics: reliability, validity and educational consequences. Educational Research Review, vol. 2, no. 2, p. 130-144, 2007.
J. Kaupp, N. Simper, and B. Frank, “Triangulated authentic assessment in the HEQCO learning outcomes assessment consortium”. Proc. 2014 Canadian Engineering Education Association Conference, Canmore, AB, June 8-11, 2014.
E.O.C Mkpojiogu and N.L. Hashim, “Improving the quality of requirements work products using scoring rubrics-assisted reading”. 6th International Conference on Computing and Informatics 2017 (ICOCI’17), Kuala Lumpur, Malaysia, 25-27 April, 2017.
E.O.C. Mkpojiogu and N.L. Hashim, Does scoring rubrics-assisted reading (SRAR) technique enhance the quality of software requirements artifacts? Journal of Information and Communication Technology (JICT), 2017.
E.O.C. Mkpojiogu and N.L. Hashim, Evaluating the effectiveness of scoring rubric-assisted reading (SRAR) technique in the reading of software requirements work documents. Journal of Engineering and Applied Sciences (JEAS), 2017.
E.O.C. Mkpojiogu and N.L. Hashim, Assessing the efficiency of scoring rubric-assisted reading (SRAR) approach in the review of software requirements work products. Journal of Engineering and Applied Sciences (JEAS) 2017.
A. Mustapha, N.A. Samsudin, N. Arbaiy, R. Mohammed and I.R. Hamid, Generic assessment rubrics for computer programming courses; TOJET: The Turkish Online Journal of Educational Technology, vol. 15, no. 1, January, 2016.
A.R. Razaei and M. Lovorn, Reliability and validity of rubrics for assessment through writing, Assessing Writing, vol. 15, p. 18-39, 2010.
L. Riebe and D. Jackson, The use of rubrics in benchmarking and assessing employability skills, Journal of Management Education, vol. 38, no. 3, p. 319-344, 2014.
M. Roth, “Introduction to geotechnical engineering using a project-based module in a first-year engineering course”. ASEE 123rd Annual Conference & Exposition, New Orleans, LA, 26-29 June, 2016.
D.R. Sadler, Indeterminacy in the use of preset criteria for assessment and grading, Assessment & Evaluation in Higher Education, vol. 34, p. 159-179, 2009.
M.G. Simkin, Should you allow your students to grade their own homework? Journal of Information Systems Education, vol. 26, no.2, Spring, 2015.
M. Sindelar, L. Shuman, M. Besterfield-Sacre, R. Miller, C. Mitcham, B. Olds, R. Pinkus and H. Wolfe, “Assessing engineering students’ abilities to resolve ethical dilemmas”. ASEE/IEEE Frontiers in Education Conference, Boulder, CO, 5-8 November, 2003.
D. van Breukelen, M. Smeets, and M. de Vries, Explicit teaching and scaffolding to enhance concept learning by design challenges, Journal of Research in STEM Education, vol. 1, no. 2, 87-105 December, 2015.
T.G. Wang, D. Schwartz and R. Lingard, Assessing student learning in software engineering, Consortium for Computing Sciences in Colleges (CCSC): Southwestern Conference, JCSC, vol. 23, no. 6, June, 2008.
A. Hussain, E.O.C. Mkpojiogu, and I. Abdullah, Requirements engineering practices in UUMIT centre: an assessment based on the perceptions of in-house software developers. Journal of Telecommunication, Electronic & Computer Engineering (JTEC). Vol. 8, no. 8, p. 27-32, 2016.
A. Hussain, E.O.C. Mkpojiogu and F.M. Kamal, The role of requirements in the success or failure of software projects. International Review of Management and Marketing, vol. 6, no. S7, p. 306-311, 2016; ISSN: 2146-4405.
E.O.C. Mkpojiogu and N.L. Hashim, Understanding the relationship between Kano model’s customer satisfaction scores and self-stated requirements importance. SpringerPlus. vol. 5, no. 1, p. 1-22, 2016; doi: 10.1186/s40064-016-1860-y
A. Hussain, E.O.C. Mkpojiogu and I. Abdullah, Investigation of Current Requirements Engineering Practices Among Software Developers at the Universiti Utara Malaysia Information Technology (UUMIT) Centre. Proceedings of the International Conference on Applied Science and Technology (ICAST’16), Kedah, Malaysia. AIP Conf. Proc. vol. 1761, no. 1, p. 020045, 2016.
A. Hussain and E.O.C. Mkpojiogu, Requirements: Towards an understanding on why software projects fail. Proceedings of the International Conference on Applied Science and Technology (ICAST’16), Kedah, Malaysia. AIP Conf. Proc. vol. 1761, no. 1, p. 020046, 2016.
A. Hussain, E.O.C. Mkpojiogu and M.N.M. Nawi, Requirements model for an e-health awareness portal. Proceedings of the International Conference on Applied Science and Technology (ICAST’16), Kedah, Malaysia. AIP Conf. Proc., vol. 1761, no. 1, p. 020048, 2016.
A. Hussain, and E.O.C. Mkpojiogu, An application of Kano method in the elicitation of stakeholder satisfying requirements for an e-Ebola awareness system. International Journal of Systems Applications, Engineering and Development. vol. 10, p. 169-178, 2016; ISSN: 2074-1308;
A. Hussain, E.O.C. Mkpojiogu, and F.M. Kamal, “Eliciting user satisfying requirements for an e-health awareness system using kano model”. In Xiaodong Zhuang (Ed.) Recent Advances in Computer Science-Proceedings of the 14th WSEAS International Conference on Computer and Computational Science (ACACOS’15), Kuala Lumpur, Malaysia, 23-26 April, 2015, p.156-165. WSEAS press. ISSN: 1790-5109; ISBN: 978-1-61804-297-2.
P.A. Asunda and R.B. Hill, Critical features of engineering design in technology education. Journal of Industrial Teacher Education, vol. 44, no. 1, 2007.
R.J. Howell, Exploring the impact of grading rubrics on academic performance: Findings from a quasi-experimental, pre-post evaluation. Journal of Excellence in College Teaching, vol. 22, no. 2, p. 31-49, 2011.
E.O.C. Mkpojiogu, and A. Hussain, Assessing students’ performance in software requirements engineering education using scoring rubrics. International Conference on Applied Science and Technology (ICAST’17), Langkawi Island, Malaysia, 3-5 April, 2017.
Downloads
Published
How to Cite
Issue
Section
License
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.
