Acta Optica Sinica, Volume. 43, Issue 12, 1210001(2023)

Multi-Focus Image Fusion Method for Microscopic Algal Images

Renqing Jia1,2, Gaofang Yin2、*, Nanjing Zhao1,2、**, Min Xu2, Xiang Hu3, Peng Huang3, Tianhong Liang2, Yu Zhu4, Xiaowei Chen2, Tingting Gan2, and Xiaoling Zhang5
Author Affiliations
  • 1School of Environment Science and Optoelectronic Technology, University of Science and Technology of China, Hefei 230026, Anhui, China
  • 2Key Laboratory of Environment Optics and Technology, Chinese Academy of Sciences, Anhui Institute of Optics and Fine Mechanics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, Anhui, China
  • 3Hefei University, Hefei 230601, Anhui, China
  • 4Anhui Ecological Environment Monitoring Center, Hefei 230061, Anhui, China
  • 5Anhui University, Hefei 230601, Anhui, China
  • show less

    Objective

    Clear microscopic images of algae are the basis of accurate identification. However, the microscopic images of algae located outside the depth of field are blurred due to the limited depth of field of the high-power microscope. On the one hand, some algal cells are large or filamentous in morphology. For example, the length of Anabaena sp. can reach hundreds of microns, and the depth distance of the algal cells can easily exceed the depth of field range of the microscope during microscopic imaging, and thus the area outside the depth of field range in the microscopic image is blurred due to defocus. On the other hand, the length of algal species with small cell size such as Scenedesmus sp. is only about seven microns, and the depth distance between multiple algal cells in the same field can easily exceed the depth of field of the microscope, which results in blurred algal cells in the collected microscopic algal images. Therefore, it is of great value to collect multi-focus microscopic images of the same field at different heights of the objective table and use the multi-focus image fusion method to realize multi-focus image fusion of algal cell images, so as to obtain clear images with panoramic depth.

    Methods

    In this paper, the focus area, defocus area, and background area of the microscopic images of the algal cell are detected, and then the multi-focus microscopic images are fused by using a spatial domain image fusion method. First, Laplacian energy and guided filtering are used to measure the local focus degree of algal cell images, and the focus area of microscopic algal cell images is determined after binarization, as shown in Eq. 4. Because the area where the algal cell is located can be detected by the S channel of HSV color space of the microscopic algal cell image, the defocus area of the microscopic image can be detected by combining the S channel with the focus area. The remaining parts are defined as background areas. Then the multiple microscopic images are fused in the spatial domain (Eq. 8), or in other words, the output pixel value is selected from the focus area with a larger focus degree. The defocus area does not participate in the fusion, and the average value of the background area is taken as the fused output, so as to realize the spatial domain fusion of the multi-focus microscopic algal cell images.

    Results and Discussions

    One microscopic image of algal cells is acquired by moving the precision displacement objective table every 1 μm in the direction of the depth of field. Anabaena sp., Scenedesmus sp., and Pediastrum sp. are used as experimental objects. The multi-focus microscopic images of Anabaena sp., Scenedesmus sp., and Pediastrum sp. are continuously acquired by moving 7, 7, and 15 μm in the direction of the depth of field of the objective table, respectively. There are different clear areas and defocus areas in each microscopic image due to the limitation of the microscope's depth field. The fusion effects of the wavelet transform, Laplacian pyramid, and pulse coupled neural network (PCNN) methods are compared with the proposed method in terms of subjective vision and objective quantitative evaluation. It can be seen from Fig. 5 and Fig. 6 that the proposed method can better transfer the focus area in the source image to the fusion image in subjective vision and has a better fusion effect. In terms of objective quantitative evaluation, Table 1 shows the edge information retention, spatial frequency, and average gradient of the fused images of Anabaena sp. (0.3529, 8.9654, and 0.0055), Scenedesmus sp. (0.3778, 7.0558, and 0.0023), and Pediastrum sp. (0.2940, 1.5445, and 0.0005), respectively, which are better than those of the compared methods. The proposed method effectively fuses the multi-focus microscopic images of algae and provides a method for obtaining the microscopic images of algae with panoramic depth.

    Conclusions

    In order to solve the problem of image blurring caused by the defocus diffusion effect in obtaining microscopic algal cell images, a spatial-domain multi-focus image fusion method is proposed in this paper. Laplace energy and guided filtering are used to detect the focus area of microscopic images, and obvious color characteristics of algal cell images are used to detect the defocus area by combining the S channel of HSV color space with the focus area. Then, the output image is selected according to the focus degree of the focus area in the spatial domain image fusion process. The experimental results show that the proposed fusion method can effectively fuse multi-focus microscopic images of algal cells. The fused image has better clarity, and the edge information of the source image is more effectively transmitted to the fused image. This work proposes a new method for obtaining microscopic images of algal cells with panoramic depth and provides technical support for the development of automatic monitoring instruments for algal cells.

    Tools

    Get Citation

    Copy Citation Text

    Renqing Jia, Gaofang Yin, Nanjing Zhao, Min Xu, Xiang Hu, Peng Huang, Tianhong Liang, Yu Zhu, Xiaowei Chen, Tingting Gan, Xiaoling Zhang. Multi-Focus Image Fusion Method for Microscopic Algal Images[J]. Acta Optica Sinica, 2023, 43(12): 1210001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Dec. 19, 2022

    Accepted: Jan. 29, 2023

    Published Online: Jun. 20, 2023

    The Author Email: Yin Gaofang (gfyin@aiofm.ac.cn), Zhao Nanjing (njzhao@aiofm.ac.cn)

    DOI:10.3788/AOS222153

    Topics