Test software quality issues and connections to international standards

Open access


This paper examines how ISO/IEC 9126-1 and ISO/IEC 25010 quality models can be applied to software testing products in industrial environment. We present a set of code smells for test systems written in TTCN-3 and their categorization according to quality model standards. We demonstrate our measurements on industrial and ETSI projects, and provide a method for estimating their effects on product risks in current projects.

[1] A. Bánsághi, B. G. ézsiás, A. Kovács, A. Tátrai, Source Code Scanners in Software Quality Management and Connections to International Standards, Annales Univ. Sci. Budapest. Sect. Comput., 37 (2012) 81-92. →79, 80

[2] B. W. Boehm, Ph. N. Papaccio, Understanding and Controlling Software Costs, IEEE Transactions on Software Engineering, 14, 10 (1988) 1462-1477. →78

[3] Checkstyle, http://checkstyle.sourceforger.net →84

[4] CMMI institute, http://cmmiinstitute.com/ →78

[5] ETSI ES 201 873-1 v4.5.1: Methods for Testing and Specification (MTS), The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language. →85

[6] FindBugs, http://findbugs.sourceforge.net →84

[7] M. Fowler, Refactoring, Improving the Design of Existing Code, Addison-Wesley, 1999. →84

[8] FxCop, http://msdn.microsoft.com →80, 84

[9] S. Herbold, J. Grabovszki, S. Waack, Calculation and Optimization of Thresholds for Sets of Software Metrics. Empirical Software Engineering, Springer, Netherlands, May 2011. →94[10] W. S. Humphrey, The Team Software Process, (2000) Technical Report, CMU/SEI-2000-TR-023, ESC-TR-2000-023 →78

[11] ISO/IEC 9126:1991, ISO Standard for Software Engineering - Product Quality Revised by ISO/IEC 9126-1:2001. →78, 81

[12] ISO/IEC 9126-1:2001: ISO Standard for Software Engineering - Product Quality - Part 1: Quality Model. →81

[13] ISO/IEC TR 9126-2:2003: ISO Standard for Software Engineering - Product Quality - Part 2: External Metrics. →81

[14] ISO/IEC TR 9126-3:2003: ISO Standard for Software Engineering - Product Quality - Part 3: Internal Metrics. →81

[15] ISO/IEC TR 9126-4:2004: ISO Standard for Software Engineering - Product Quality - Part 4: Quality in Use Metrics. →81

[16] ISO/IEC 25010:2011: ISO Systems and Software Engineering - Systems and Software Quality Requirements and Evaluation (SQuaRE) - System and Software Quality Models. →78, 81

[17] S. H. Kan, Metrics and Models in Software Quality Engineering, Addison- Wesley, Boston, 2003. →80

[18] F. Khomh, M. Di Penta, Y-G. Gueheneuc, An Exploratory Study of the Impact of Code Smells on Software Change-proneness, Proc. 16th Working Conference on Reverse Engineering, 2009, pp. 75-84. →94

[19] W. Li, R. Shatnawi, An empirical study of the bad smells and class error probability in the post-release object-oriented system evolution, Systems and Software 80, 7 (2007) 1120-1128. →94

[20] G. Meszaros, xUnit Test Patterns: Refactoring Test Code, Addison-Wesley Professional, 2007. →84

[21] A. Monden, D. Nakae, T. Kamiya, S. Sato, K. Matsumoto, Software quality analysis by code clones in industrial legacy software, Symposium on Software Metrics, 2002, pp. 87-94. →94

[22] H. Neukirchen, B. Zeiss, J. Grabovszki, An approach to quality engineering of TTCN-3 test specifications, International Journal on Software Tools for Technology Transfer (STTT), 10, 4 (2008) 309-326. →85

[23] H. Neukirchen, M. Bisanz, Utilising code smells to detect quality problems in TTCN-3 test suites, Proc 19th IFIP International Conference on Testing of Communicating Systems and 7th International Workshop on Formal Approaches to Testing of Software (TestCom/FATES 2007 ), June 26-29, 2007, Tallinn, Estonia. Lecture Notes in Computer Science (LNCS) 4581, 2007 pp. 228-243. → 85

[24] PMD, http://pmd.sourceforge.net →80, 84

[25] R. van Solingen, E. Berghout, The Goal/Question/Metric Method, a Practical Method for Quality Improvement of Software Development, McGraw-Hill, 1999. →78

[26] K. Szabados, Structural analysis of large TTCN-3 projects, Proc. 21st IFIP WG 6.1 International Conference on Testing of Software and Communication Systems and 9th International FATES Workshop, Lecture Notes in Computer Science 5826:, Testing of Software and Communication Systems, Springer- Verlag Berlin, Heidelberg, 2009 pp. 241-246. →80

[27] The Personal Software Process (PSP) Body of Knowledge, Version 2.0; Special Report; CMU/SEI-2009-SR-018 →78

[28] TRex, http://www.trex.informatik.uni-goettingen.de/trac →84

[29] B. Zeiss, D. Vega, I. Schiferdecker, H. Neukirchen, J. Grabovszki, Applying the ISO 9126 Quality Model to Test Specifications - Exemplified for TTCN-3 Test Specifictions, Software Engineering, Lecture Notes in Informatics (LNI) 105, 2007, pp. 231-242. Gesellschaft für Informatik, K¨ollen Verlag, Bonn, →79

[30] M. Zhang, T. Hall, N. Baddoo, Code Bad Smells: a review of current knowledge, J. Softw. Maint. Evol.: Research and Practice 23, 3 (2011) 179-202. →93

Acta Universitatis Sapientiae, Informatica

The Journal of "Sapientia" Hungarian University of Transylvania

Journal Information


All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 118 118 18
PDF Downloads 45 45 9