Acta Optica Sinica, Volume. 40, Issue 1, 0111020(2020)

Object Detection of Remote Sensing Image Based on Improved Rotation Region Proposal Network

Yuan Dai, Benshun Yi, Jinsheng Xiao*, Junfeng Lei, Le Tong, and Zhiqin Cheng
Author Affiliations
  • Electronic Information School, Wuhan University, Wuhan, Hubei 430072, China
  • show less
    Figures & Tables(17)
    Structure of Faster R-CNN network model
    Network structure of proposed algorithm
    Diagram of multi-scale feature extraction. (a) Faster R-CNN feature extraction method; (b) feature pyramid
    Anchor strategy in our method. (a) Redesigned scale; (b) special ratio; (c) angular parameters
    Calculation process of tilted IoU. (a) Regular intersection; (b) irregular intersection
    Comparison of results of different NMS detections. (a) Traditional NMS with common box; (b) traditional NMS with rotated box; (c) tilted NMS with rotated box
    RoIPooling and RoIAlign. (a) RoIPooling; (b) RoIAlign
    Comparison of testing results between original RRPN and our method. (a)(c) Original RRPN; (b)(d) improved method
    Detection results of different algorithms for large vehicle. (a) YOLO v2; (b) YOLO v3; (c) Faster R-CNN; (d) RRPN; (e) proposed algorithm
    Detection results of different algorithms for airplane. (a) YOLO v2; (b) YOLO v3; (c) Faster R-CNN; (d) RRPN; (e) proposed algorithm
    Detection results of different algorithms for tennis court. (a) YOLO v2; (b) YOLO v3; (c) Faster R-CNN; (d) RRPN; (e) proposed algorithm
    Detection results of different algorithms for ship. (a) YOLO v2; (b) YOLO v3; (c) Faster R-CNN; (d) RRPN; (e) proposed algorithm
    • Table 1. Extraction results of different basic networks for typical object

      View table

      Table 1. Extraction results of different basic networks for typical object

      NetworkAP /%
      PlaneShipBridgeHarborStorage-tank
      VGG1679.242.118.543.144.5
      ResNet101+FPN82.144.321.645.347.4
    • Table 2. Comparison of detection effects of different RoI pooling methods

      View table

      Table 2. Comparison of detection effects of different RoI pooling methods

      Pooling methodAP /%
      BridgeHarborStorage-tankPlaneShip
      RoIPooling21.645.347.482.144.3
      RoIAlign23.947.048.583.847.4
    • Table 3. Detection results of different classification networks for 15 types of targets%

      View table

      Table 3. Detection results of different classification networks for 15 types of targets%

      CategoryAP
      Original+Conv
      Bridge23.927.5
      Small-vehicle31.632.4
      Baseball diamond67.667.3
      Basketball court47.546.3
      Harbor47.046.9
      Ground-track field40.244.6
      Soccer ball field41.242.4
      Storage-tank48.548.5
      Large-vehicle49.851.7
      Plane83.884.1
      Roundabout47.645.4
      Tennis court89.488.8
      Helicopter45.442.3
      Ship47.447.4
      Swimming pool39.838.1
      mAP50.0550.25
    • Table 4. Experimental results of proposed method for 15 types of targets%

      View table

      Table 4. Experimental results of proposed method for 15 types of targets%

      CategoryPrecisionRecallAP
      Bridge59.1532.9226.40
      Small-vehicle68.6544.1234.10
      Baseball diamond80.4081.2178.57
      Basketball court82.0176.2073.20
      Harbor77.9561.4156.00
      Ground-track field81.2960.0555.62
      Soccer ball field78.2059.9557.79
      Storage-tank81.4052.8251.50
      Large-vehicle62.6876.2056.91
      Plane94.1087.3686.50
      Roundabout75.5260.6756.05
      Tennis court97.0491.2991.16
      Helicopter82.0565.3161.88
      Ship74.0155.3550.10
      Swimming pool71.6053.4547.52
      Average77.7463.8958.89
    • Table 5. Experimental results of different methods for 15 types of targets%

      View table

      Table 5. Experimental results of different methods for 15 types of targets%

      CategoryYOLO v2YOLO v3Faster R-CNNRRPNProposed method
      Bridge14.1810.0341.8223.8826.38
      Small-vehicle13.0814.793.8534.6534.15
      Baseball diamond52.799.0972.8367.6178.57
      Basketball court42.432.2755.8147.4873.21
      Harbor51.9917.0759.0447.3056.18
      Ground-track field32.574.8184.6840.1955.64
      Soccer ball field31.670.14663.6041.1557.78
      Storage-tank40.2124.595.3148.7751.55
      Large-vehicle22.029.0938.9449.7456.91
      Plane80.9149.4438.7483.8986.52
      Roundabout44.4021.6444.4447.6156.06
      Tennis court72.5215.1889.7589.4091.15
      Helicopter21.220.0240.6445.4461.91
      Ship46.7330.313.9947.1950.15
      Swimming pool34.317.5422.7139.7847.55
      mAP39.8714.4044.4150.0858.91
    Tools

    Get Citation

    Copy Citation Text

    Yuan Dai, Benshun Yi, Jinsheng Xiao, Junfeng Lei, Le Tong, Zhiqin Cheng. Object Detection of Remote Sensing Image Based on Improved Rotation Region Proposal Network[J]. Acta Optica Sinica, 2020, 40(1): 0111020

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Special Issue on Computational Optical Imaging

    Received: Jul. 29, 2019

    Accepted: Sep. 19, 2019

    Published Online: Jan. 6, 2020

    The Author Email: Xiao Jinsheng (xiaojs@whu.edu.cn)

    DOI:10.3788/AOS202040.0111020

    Topics