Laser & Optoelectronics Progress, Volume. 58, Issue 12, 1210030(2021)
Image Semantic Description Algorithm with Integrated Spatial Attention Mechanism
The image semantic description model usually adopts the encoder-decoder method to realize the image semantic description. The model has problems such as insufficient utilization of image features and insufficient location information extraction of image objects. In response to this problem, an image semantic description algorithm is proposed that integrates the attention mechanism in the encoder part, and the attention weight of different image features is allocated through the context information of the decoder, thereby improving the expressive ability of image semantic description. And verified on the Flickr30k and MSCOCO data sets, the model improves the BLEU-4 evaluation index by 1.9% and 0.8%, respectively. The experiment proves the effectiveness of the proposed algorithm.
Get Citation
Copy Citation Text
Lie Guo, Tuanshan Zhang, Weizhen Sun, Jielong Guo. Image Semantic Description Algorithm with Integrated Spatial Attention Mechanism[J]. Laser & Optoelectronics Progress, 2021, 58(12): 1210030
Category: Image Processing
Received: Sep. 4, 2020
Accepted: Sep. 30, 2020
Published Online: Jun. 22, 2021
The Author Email: Guo Lie (lie_guo@163.com)