A Regression-Based Family of Measures for Full-Reference Image Quality Assessment

Open access

Abstract

The advances in the development of imaging devices resulted in the need of an automatic quality evaluation of displayed visual content in a way that is consistent with human visual perception. In this paper, an approach to full-reference image quality assessment (IQA) is proposed, in which several IQA measures, representing different approaches to modelling human visual perception, are efficiently combined in order to produce objective quality evaluation of examined images, which is highly correlated with evaluation provided by human subjects. In the paper, an optimisation problem of selection of several IQA measures for creating a regression-based IQA hybrid measure, or a multimeasure, is defined and solved using a genetic algorithm. Experimental evaluation on four largest IQA benchmarks reveals that the multimeasures obtained using the proposed approach outperform state-of-the-art full-reference IQA techniques, including other recently developed fusion approaches.

[1] Chandler, D. M. (2013). Seven challenges in image quality assessment: Past, present, and future research. SRN Signal Processing, 2013, art. ID 905685.

[2] Ponomarenko, N., Jin, L., Ieremeiev, O., Lukin, V., Egiazarian, K., Astola, J.,Vozel, B., Chehdi, K., Carli, M., Battisti, F., Kuo, C.-C. J. (2015). Image database TID2013: Peculiarities results and perspectives. Signal Processing: Image Communication, 30, 57-77.

[3] Anbarjafari, G. (2015). An objective no-reference measure of illumination assessment. Measurement Science Review, 15(6), 319-322.

[4] Valenzise, G., Magni, S., Tagliasacchi, M., Tubaro, S. (2012). No-reference pixel video quality monitoring of channel-induced distortion. IEEE Transactions on Circuits and Systems for Video Technology, 22 (4), 605-618.

[5] Li, X., Guo, Q., Lu, X. (2016). Spatiotemporal statistics for video quality assessment. IEEE Transactions on Image Processing, 25 (7), 3329-3342.

[6] Damera-Venkata, N., Kite, T. D., Geisler, W. S., Evans, B. L., Bovik, A. C. (2000). Image quality assessment based on a degradation model. IEEE Transactions on Image Processing, 9 (4), 636-650.

[7] Wang, Z., Bovik, A. C. (2002). A universal image quality index. IEEE Signal Processing Letters, 9 (3), 81-84.

[8] Wang, Z., Bovik, A. C., Sheikh, H. R., Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13 (4), 600-612.

[9] Wang, Z., Simoncelli, E. P., Bovik, A. C. (2003). Multiscale structural similarity for image quality assessment. n 37th Asilomar Conference on Signals, Systems & Computers. IEEE, 1398-1402.

[10] Wang, Z., Li, Q. (2011). Information content weighting for perceptual image quality assessment. IEEE Transactions on Image Processing, 20 (5), 1185-1198.

[11] Sheikh, H. R., Bovik, A. C. (2006). Image information and visual quality. IEEE Transactions on Image Processing, 15 (2), 430-444.

[12] Sheikh, H., Bovik, A., de Veciana, G. (2005). An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Transactions on Image Processing, 14 (12), 2117-2128.

[13] Zhang, L., Zhang, L., Mou, X., Zhang, D. (2011). SIM: A feature similarity index for image quality assessment. IEEE Transactions on Image Processing, 20 (8), 2378-2386.

[14] Zhang, L., Li, H. (2012). SR-FSIM: A fast and high performance IQA index based on spectral residual. In: 19th IEEE International Conference on Image Processing. IEEE, 1473-1476.

[15] Zhang, L., Shen, Y., Li, H. (2014). VSI: A visual saliency-induced index for perceptual image quality assessment. IEEE Transactions on Image Processing, 23 (10), 4270-4281.

[16] Zhang, L., Zhang, L., Mou, X. (2010). RFSIM: A feature based image quality assessment metric using Riesz transforms. In 2010 IEEE International Conference on Image Processing. IEEE, 321-324.

[17] Wang, F., Sun, X., Guo, Z., Huang, Y., Fu, K. (2015). An object-distortion based image quality similarity. IEEE Signal Processing Letters, 22 (10), 1534-1537.

[18] Wu, J., Lin, W., Shi, G. (2014). Image quality assessment with degradation on spatial structure. IEEE Signal Processing Letters, 21 (4), 437-440.

[19] Liu, A., Lin, W., Narwaria, M. (2012). Image quality assessment based on gradient similarity. IEEE Transactions on Image Processing, 21 (4), 1500-1512.

[20] Zhou, F., Lu, Z., Wang, C., Sun, W., Xia, S.-T., Liao, Q. (2015). Image quality assessment based on inter-patch and intra-patch similarity. PLoS ONE, 10 (3), e0116312.

[21] Guo, S., Xiang, T., Li, X. (2015). Image quality assessment based on multiscale fuzzy gradient similarity deviation. Soft Computing, doi:

[22] Liu, M., Yang, X. (2009). A new image quality approach based on decision fusion. In Fifth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD ’08). IEEE, 10-14.

[23] Larson, E. C., Chandler, D. M. (2010). Most apparent distortion: Full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging, 19 (1), 011006.

[24] Peng, P., Li, Z.-N. (2012). Regularization of the structural similarity index based on preservation of edge direction. In: 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 2127-2132.

[25] Saha, A., Wu, Q. M. J. (2014). Full-reference image quality assessment by combining global and local distortion measures. arXiv:1412.5488 [cs.CV].

[26] Okarma, K. (2010). Combined full-reference image quality metric linearly correlated with subjective assessment. In Artificial Intelligence and Soft Computing. Springer, 539-546.

[27] Okarma, K. (2013). Extended Hybrid Image Similarity - combined full-reference image quality metric linearly correlated with subjective scores. Elektronika ir Elektrotechnika, 19 (10), 129-132.

[28] Oszust, M. (2016). Full-reference image quality assessment with linear combination of genetically selected quality measures. PLoS ONE, 11 (6), 1-17.

[29] Lahouhou, A., Viennet, E., Beghdadi, A. (2010). Selecting low-level features for image quality assessment by statistical methods. Journal of Computing and Information Technology - CIT, 18 (2), 183-189.

[30] Peng, P., Li, Z.-N. (2012). A mixture of experts approach to multi-strategy image quality assessment. In Image Analysis and Recognition, Springer, LNCS 7324, 123-130.

[31] Liu, T.-J., Lin, W., Kuo, C.-C. (2013). Image quality assessment using multi-method fusion. IEEE Transactions on Image Processing, 22 (5), 1793-1807.

[32] Jin, L., Egiazarian, K., Kuo, C.-C. (2012). Perceptual image quality assessment using block-based multimetric fusion (BMMF). In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). IEEE, 1145-1148.

[33] Ponomarenko, N., Ieremeiev, O., Lukin, V., Egiazarian, K., Carli, M. (2011). Modified image visual quality metrics for contrast change and mean shift accounting. In 11th International Conference - The Experience of Designing and Application of CAD Systems in Microelectronics (CADSM). IEEE, 305-311.

[34] Oszust, M. (2016). Image quality assessment with lasso regression and pairwise score differences. Multimedia Tools and Applications, doi:

[35] Lukin, V. V., Ponomarenko, N. N., Ieremeiev, O. I., Egiazarian, K. O., Astola, J. (2015). Combining full reference image visual quality metrics by neural network. In Human Vision and Electronic Imaging XX, SPIE, Vol. 9394, 93940K.

[36] Yuan, Y., Guo, Q., Lu, X. (2015). Image quality assessment: A sparse learning way. Neurocomputing, 159, 227-241.

[37] Neter, J., Kutner, M. H., Nachtsheim, C. J., Wasserman, W. (1996). Applied Linear Statistical Models, Vol. 4. McGraw-Hill/Irwin.

[38] Sheikh, H. R., Sabir, M. F., Bovik, A. C. (2006). A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing, 15 (11), 3440-3451.

[39] Video Quality Experts Group (VQEG). (2003). Final report from the video quality experts group on the validation of objective models of video quality assessment, phase ii (fr_tv2). http://bit.ly/2g1TeXz.

[40] Yang, Y., Huang, S., Gao, J., Qian, Z. (2014). Multifocus image fusion using an effective discrete wavelet transform based algorithm. Measurement Science Review, 14 (2), 102-108.

[41] Chang, H.-W., Zhang, Q.-W., Wu, Q.-Q., Gan, Y. (2015). Perceptual image quality assessment by independent feature detector. Neurocomputing, 151, 1142 -1152.

[42] Chang, H.-W., Yang, H., Gan, Y., Wang, M.-H. (2013). Sparse feature fidelity for perceptual image quality assessment. IEEE Transactions on Image Processing, 22 (10), 4007-4018.

[43] Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Carli, M., Battisti, F. (2009). TID2008 - A database for evaluation of full-reference visual quality assessment metrics. Advances of Modern Radioelectronics, 10, 30-45.

[44] Goldberg, D. E. (1989). Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Professional.

[45] Zou, H., Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society B, 67 (2), 301-320.

[46] Pei, S.-C., Chen, L.-H. (2015). Image quality assessment using human visual DOG model fused with random forest. IEEE Transactions on Image Processing, 24 (11), 3282-3292.

[47] Li, S., Zhang, F., Ma, L., Ngan, K. N. (2011). Image quality assessment by separately evaluating detail losses and additive impairments. IEEE Transactions on Multimedia, 13 (5), 935-949.

[48] Wu, J., Lin,W., Shi, G., Liu, A. (2013). Perceptual quality metric with internal generative mechanism. IEEE Transactions on Image Processing, 22 (1), 43-54.

[49] Barri, A., Dooms, A., Jansen, B., Schelkens, P. (2014). A locally adaptive system for the fusion of objective quality measures. IEEE Transactions on Image Processing, 23 (6), 2446-2458.

Measurement Science Review

The Journal of Institute of Measurement Science of Slovak Academy of Sciences

Journal Information


IMPACT FACTOR 2017: 1.345
5-year IMPACT FACTOR: 1.253



CiteScore 2017: 1.61

SCImago Journal Rank (SJR) 2017: 0.441
Source Normalized Impact per Paper (SNIP) 2017: 0.936

Cited By

Metrics

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 119 119 16
PDF Downloads 44 44 6