Optics and Precision Engineering, Volume. 29, Issue 10, 2481(2021)

Fine restoration of incomplete image with external features and image features

Tao XU1、*, Ji-yong ZHOU2, Guo-liang ZHANG3, and Lei CAI1
Author Affiliations
  • 1School of Artificial Engineering, Henan Institute of Science and Technology, Xinxiang453003, China
  • 2School of Mechanical and Electrical Engineering, Henan Institute of Science and Technology, Xinxiang453003, China
  • 3Global Energy Interconnection Research Institute co.Ltd., Beijing102209, China
  • show less
    References(34)

    [1] [1] 1李志丹, 苟慧玲, 程吉祥, 等. 结合梯度特征与色彩一致性的图像修复[J]. 光学 精密工程, 2019, 27(1): 251-259. doi: 10.3788/ope.20192701.0251LIZH D, GOUH L, CHENGJ X, et al. Image inpainting using gradient features and color consistency[J]. Opt. Precision Eng., 2019, 27(1): 251-259. (in Chinese). doi: 10.3788/ope.20192701.0251

    [2] V V V, S R A, M V I et al. Video inpainting of complex scenes based on local statistical model. Electronic Imaging, 1-6(2016).

    [3] Z Y YAN, X M LI, M LI et al. Shift-net: Image Inpainting Via Deep Feature Rearrangement, 3-19(2018).

    [4] W XIONG, J H YU, Z LIN et al. Foreground-aware image inpainting, 5833-5841(2019).

    [5] [5] 5NAZERIK, NG E, JOSEPHT, et al. EdgeConnect: generative image inpainting with adversarial edge learning[EB/OL]. 2019: arXiv: 1901. doi: 10.1299/transjsme.18-0021200212[cs.CV]. https://arxiv.org/abs/1901.00212. doi: 10.1299/transjsme.18-00212

    [6] A A EFROS, T K LEUNG. Texture synthesis by non-parametric sampling, 1033-1038(1999).

    [7] M BERTALMIO, L VESE, G SAPIRO et al. Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing, 12, 882-889(2003).

    [8] A CRIMINISI, P PEREZ, K TOYAMA. Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing, 13, 1200-1212(2004).

    [9] O LE MEUR, J GAUTIER, C GUILLEMOT. Examplar-based inpainting based on local geometry, 3401-3404(2011).

    [10] [10] 10金炜, 王文龙, 符冉迪, 等. 联合块匹配与稀疏表示的卫星云图修复[J]. 光学 精密工程, 2014, 22(7): 1886-1895. doi: 10.3788/OPE.20142207.1886JINW, WANGW L, FUR D, et al. Satellite cloud image inpainting based on patch matching and sparse representation[J]. Opt. Precision Eng., 2014, 22(7): 1886-1895. (in Chinese). doi: 10.3788/OPE.20142207.1886

    [11] T F CHAN, J H SHEN. Nontexture inpainting by curvature-driven diffusions. Journal of Visual Communication and Image Representation, 12, 436-449(2001).

    [12] T F CHAN, J H SHEN, L VESE. Variational PDE models in image processing(2002).

    [13] [13] 13朱为, 李国辉. 基于自动结构延伸的图像修补方法[J]. 自动化学报, 2009, 35(8): 1041-1047. doi: 10.3724/SP.J.1004.2009.01041ZHUW, LIG H. Image completion based on automatic structure propagation[J]. Acta Automatica Sinica, 2009, 35(8): 1041-1047. (in Chinese). doi: 10.3724/SP.J.1004.2009.01041

    [14] [14] 14李志丹, 苟慧玲, 程吉祥, 等. 结合梯度特征与色彩一致性的图像修复[J]. 光学 精密工程, 2019, 27(1): 251-259. doi: 10.3788/ope.20192701.0251LIZH D, GOUH L, CHENGJ X, et al. Image inpainting using gradient features and color consistency[J]. Opt. Precision Eng., 2019, 27(1): 251-259. (in Chinese). doi: 10.3788/ope.20192701.0251

    [15] S IIZUKA, E SIMO-SERRA, H ISHIKAWA. Globally and locally consistent image completion. ACM Transactions on Graphics, 36, 1-14(2017).

    [16] T DEKEL, C GAN, D KRISHNAN et al. Sparse, smart contours to represent and edit images, 3511-3520(2018).

    [17] J GOODFELLOW, J POUGET-ABADIE, M MIRZA et al. Generative adversarial nets, 2672-2680(2014).

    [18] J X GU, H D ZHAO, Z LIN et al. Scene graph generation with external knowledge and image reconstruction, 1969-1978(2019).

    [19] S SAINBAYAR, A SZLAM, W JASON et al. End-To-End memory networks, 2440-2448(2017).

    [20] X CAIMING, M STEPHEN, S RICHARD et al. Dynamic memory networks for visual and textual question answering, 2397-2406(2016).

    [21] C X ZHENG, T J CHAM, J F CAI. Pluralistic image completion, 1438-1447(2019).

    [22] H Y LIU, B JIANG, Y XIAO et al. Coherent semantic attention for image inpainting, 4169-4178(2019).

    [23] J H YU, Z LIN, J M YANG et al. Generative image inpainting with contextual attention, 5505-5514(2018).

    [24] Q WU, C H SHEN, P WANG et al. Image captioning and visual question answering based on attributes and external knowledge. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 1367-1381(2018).

    [25] A KUMAR, O IRSOY, P ONDRUSKA et al. Ask me anything: dynamic memory networks for natural language processing, 2068-2078(2015).

    [26] C E BARNES, A SHECHTMAN, D B GOLDMAN et al. Patchmatch: a randomized correspondence algorithm forstructural image editing. Transactions on Graphics, 28, 1-11(2009).

    [27] D PATHAK, P KRÄHENBÜHL, J DONAHUE et al. Context encoders: feature learning by inpainting, 2536-2544(2016).

    [28] C YANG, X LU, Z LIN et al. High-resolution image inpainting using multi-scale neural patch synthesis, 4076-4084(2017).

    [29] O RUSSAKOVSKY, J DENG, H SU et al. ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 115, 211-252(2015).

    [30] A G KAMALYAN, V V SIMONYAN. On the number of solutions of a certain type of one-dimensional pseudodifferential equations in the Sobolev-Slobedetski space. Journal of Shellfish Research, 21, 201-210(2002).

    [31] Z W LIU, P LUO, X G WANG et al. Deep learning face attributes in the wild, 3730-3738(2015).

    [32] R S LIU, X FAN, M ZHU et al. Real-world underwater enhancement: challenges, benchmarks, and solutions under natural light. IEEE Transactions on Circuits and Systems for Video Technology, 30, 4861-4875(2020).

    [33] Y J WANG, J H LI, Y LU et al. Image quality evaluation based on image weighted separating block peak signal to noise ratio, 994-997(2003).

    [34] E TUNCEL, H FERHATOSMANOGLU, K ROSE. VQ-index: an index structure for similarity searching in multimedia databases, 1, 543-552(2002).

    Tools

    Get Citation

    Copy Citation Text

    Tao XU, Ji-yong ZHOU, Guo-liang ZHANG, Lei CAI. Fine restoration of incomplete image with external features and image features[J]. Optics and Precision Engineering, 2021, 29(10): 2481

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: Mar. 25, 2021

    Accepted: --

    Published Online: Nov. 23, 2021

    The Author Email: XU Tao (xutao@hist.edu.cn)

    DOI:10.37188/OPE.20212910.2481

    Topics