Journal of Optoelectronics · Laser, Volume. 35, Issue 8, 785(2024)
Image quality assessment based on ViT and multi-task self-supervised learning
[1] [1] WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
[2] [2] MITTAL A, MOORTHY A K, BOVIK A C. No-reference image quality assessment in the spatial domain[J]. IEEE Transactions on Image Processing, 2012, 21(12): 4695-4708.
[3] [3] KANG L, YE P, LI Y, et al. Convolutional neural networks for no-reference image quality assessment[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition, June 24-27, 2014, Columbus, USA. New York: IEEE, 2014:1733-1740.
[4] [4] BOSSE S, MANIRY D, MLLER K, et al. Deep neural networks for no-reference and full-reference image quality assessment[J]. IEEE Transactions on Image Processing, 2018, 27(1): 206-219.
[5] [5] ZHANG W X, MA K D, YAN J, et al. Blind image quality assessment using a deep bilinear convolutional neural network[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30(1): 36-47.
[6] [6] ZHU H C, LI L D, WU J J, et al. MetaIQA: deep meta-learning for no-reference image quality assessment[C]//2020 IEEE Conference on Computer Vision and Pattern Recognition, June 14-19, 2020, Seattle, USA. New York: IEEE, 2020:14143-14152.
[9] [9] DOSOVITSKIY A, BEYER L, KOLESNIKOV A, et al. An image is worth 16×16 words: transformers for image recognition at scale[EB/OL]. (2021-06-03) [2022-12-25]. https://arxiv.org/abs/2010.11929v2.
[10] [10] ZIAEI N H, SHAHKOLAEI A, HEDJAM R, et al. Mean deviation similarity index: efficient and reliable full-reference image quality evaluator[J]. IEEE Access, 2016, 4:5579-5590.
[11] [11] KENDALL, ALEX, YARIN G, et al. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics[C]//2018 IEEE Conference on Computer Vision and Pattern Recognition, June 18-22, 2018, Salt Lake City, USA. New York: IEEE, 2018:7482-7491.
[12] [12] MA K D, DUANMU Z F, WU Q B, et al. Waterloo exploration database: new challenges for image quality assessment models[J]. IEEE Transactions on Image Processing, 2017, 26(2): 1004-1016.
[13] [13] PONOMARENKO N, JIN L N, IEREMEIEV O, et al. Image database TID2013: peculiarities, results and perspectives[J]. Signal Processing: Image Communication, 2015, 30:57-77.
[14] [14] SHEIKH H R, WANG Z, CORMACK L, et al. Live image quality assessment database release 2[EB/OL]. (2007-06-30)[2022-12-25]. https://live.ece.utexas.edu/research/quality.
[15] [15] LARSON E C, CHANDLER D M. Categorical subjective image quality (CSIQ) database[EB/OL]. (2009)[2022-12-25]. https://vision.okstate.edu/csiq.
[16] [16] CIANCIO A, TARGINO DA COSTA A L N T, DA SILVA E A B, et al. No-reference blur assessment of digital pictures based on multifeature classifiers[J]. IEEE Transactions on Image Processing, 2011, 20(1): 64-75.
[17] [17] GHADIYARAM D, BOVIK A C. Massive online crowdsourced study of subjective and objective picture quality[J]. IEEE Transactions on Image Processing, 2016, 25 (1): 372-387.
[18] [18] VIRTANEN T, NUUTINEN M, VAAHTERANOKSA M, et al. CID2013: a database for evaluating no-reference image quality assessment algorithms[J]. IEEE Transactions on Image Processing, 2015, 24(1): 390-402.
[19] [19] ZHANG L, ZHANG L, BOVIK A C. A feature-enriched completely blind image quality evaluator[J]. IEEE Transactions on Image Processing, 2015, 24(8): 2579-2591.
[20] [20] MA K, LIU W, ZHANG K, et al. End-to-end blind image quality assessment using deep neural networks[J]. IEEE Transactions on Image Processing, 2018, 27(3): 1202-1213.
[21] [21] SU S L, YAN Q S, ZHU Y, et al. Blindly assess image quality in the wild guided by a self-adaptive hyper network[C]//2020 IEEE Conference on Computer Vision and Pattern Recognition, June 14-19, 2020, Seattle, USA. New York: IEEE, 2020:3664-3673.
[22] [22] MADHUSUDANA P C, BIRKBECK N, WANG Y, et al. Image quality assessment using contrastive learning[J]. IEEE Transactions on Image Processing, 2022, 31:4149-4161.
[23] [23] GOLESTANEH S A, DADSETAN S, KITANI K M. No-reference image quality assessment via transformers, relative ranking, and self-consistency[EB/OL]. (2022-01-05) [2022-12-25]. https://arxiv.org/abs/2108.06858.
[24] [24] YANG S, WU T, SHI S, et al. MANIQA: Multi-dimension attention network for no-reference image quality assessment[C]//2022 IEEE Conference on Computer Vision and Pattern Recognition, June 19-24, 2022, New Orleans, USA. New York: IEEE, 2022:1191-1200.
[25] [25] SAAD M A, BOVIK A C, HARRIER C C. Blind image quality assessment: a natural scene statistics approach in the DCT domain[J]. IEEE Transactions on Image Processing, 2012, 21(8): 3339-3352.
[26] [26] XU J T, YE P, LI Q H, et al. Blind image quality assessment based on high order statistics aggregation[J]. IEEE Transactions on Image Processing, 2016, 25(9): 4444-4457.
Get Citation
Copy Citation Text
WANG Huacheng, SANG Qingbing, HU Cong. Image quality assessment based on ViT and multi-task self-supervised learning[J]. Journal of Optoelectronics · Laser, 2024, 35(8): 785
Category:
Received: Dec. 25, 2022
Accepted: Dec. 13, 2024
Published Online: Dec. 13, 2024
The Author Email: SANG Qingbing (qingbings@jiangnan.edu.cn)