High Power Laser and Particle Beams, Volume. 37, Issue 5, 051001(2025)

A review of multispectral target detection algorithms and related datasets

Tianlong Zhang, Yuanchao Geng, Yuzhen Liao, and Dangpeng Xu*
Author Affiliations
  • Laser Fusion Research Center, CAEP, Mianyang 621900, China
  • show less
    Figures & Tables(10)
    Schematic diagram of complementarity between visible light and infrared images[15-16]
    Flowchart of the multispectral object detection dataset, subfigure is the classification of imaging spectrometers
    Schematic diagram of object detection dataset annotation methods[49-51]
    Evolutionary process of object detection algorithms, subfigures present the evolution process of key technologies
    Schematic diagram of MBNet[13]
    Schematic diagram of Fang algorithm[95]
    Schematic diagram of CFMW[10]
    Schematic diagram of classification of multispectral object detection algorithms
    • Table 1. Commonly used multispectral object detection data sets

      View table
      View in Article

      Table 1. Commonly used multispectral object detection data sets

      establishment timebrief introductionapplication domainimage acquisition equipment
      Indian Pines[18]1992Covering 400 - 2500 nm with a total of 224 bands.The annotations include 16 categories such as Oats and Woods.agricultural detection, environmental monitoring, etc.Avris (whiskbroom)
      Salinas[27]2001Covering a range of 400 - 2500 nm with a total of 224 bands.The annotations include 16 categories such as fallow land and celery.Agricultural detection, environmental monitoring, etc.Avris (whiskbroom)
      FLIR[15]20039711 thermal imaging pictures and 9233 RGB pictures, covering 15 common object categories.Security monitoring,autonomous driving.FLIR (filter)
      Pavia Centre & University[17]2010The spectrum covers visible light to near-infrared, with a total of 103 bands. The annotations include 9 categories such as water and trees.Land use and cover detection,environmental detectionROSIS (pushbroom)
      VEDAI[20]2014A dataset for vehicle detection captured by drones, providing different resolutions for each scene.traffic monitoring, urban planning/
      KAIST[21]2015A total of 95 328 pictures, each picture contains two versions of RGBand infrared images, and there are a total of 103 128 densely annotated ones.pedestrian monitoringPointGrey Flea3 and FLIR (filter)
      EuroSAT[29]2019The dataset is based on Sentinel-2 satellite images covering 13 spectral bands and consisting out of 10 classes with in total 27 000 labeled and geo-referenced images.land use and coverclassificationMSI on Sentinel-2 satellite (pushbroom)
      LLVIP[16]2021A pedestrian detection dataset in low-light environments, with 15488 pairs of pixel-aligned RGB-IR images.pedestrian monitoringHikvision Binocular Photography Platform (filter)
      MMShip[52]2023The dataset encompasses 5 016 sets of ship target images, with each scene consisting of a total of four bands, including the visible light and the near infrared.ship monitoringMSI on Sentinel-2 satellite (pushbroom)
      SMOD[53]2024The dataset comprises 5 378 pairs of daytime scene images captured at 3 p.m. and 3 298 pairs of nighttime ones at 7 p.m.pedestrian monitoring, traffic monitoringAsens FV6 Binocular Photography Platform (filter)
    • Table 2. A summary of multispectral object detection algorithms

      View table
      View in Article

      Table 2. A summary of multispectral object detection algorithms

      establishment timeperformance/%
      KAIST(MR)*LLVIP(mAP)VEDAI(mAP50)
      KAIST(MR)*:The data selects the ‘all’ subset under the KAIST dataset.
      IATDNN + IAMSS[11]2018.226.37\\
      IAF R-CNN[12]2018.815.73\\
      MBNet[13]2020.88.13\\
      CFB(CFT)[95]2022.1\63.685.3
      SuperYOLO[19]2023.4\\75.09
      CFMW[10]2024.4\64.8\
      RSDet[99]2024.526.0261.3\
    Tools

    Get Citation

    Copy Citation Text

    Tianlong Zhang, Yuanchao Geng, Yuzhen Liao, Dangpeng Xu. A review of multispectral target detection algorithms and related datasets[J]. High Power Laser and Particle Beams, 2025, 37(5): 051001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Oct. 22, 2024

    Accepted: Mar. 3, 2025

    Published Online: May. 22, 2025

    The Author Email: Dangpeng Xu (xudp803810@163.com)

    DOI:10.11884/HPLPB202537.240370

    Topics