Laser & Optoelectronics Progress, Volume. 59, Issue 16, 1610015(2022)

2D-3D Medical Image Registration Based on Training-Inference Decoupling Architecture

Wenjü Li1, Deqing Kong1, Guogang Cao1、*, Sicheng Li1, and Cuixia Dai2
Author Affiliations
  • 1School of Computer Science & Information Engineering, Shanghai Institute of Technology, Shanghai 201418, China
  • 2School of Sciences, Shanghai Institute of Technology, Shanghai 201418, China
  • show less
    Figures & Tables(15)
    Registration framework
    Transform parameter renderings
    Network structure of regressor
    Re-parameterization process
    Activate function. (a) ReLU/Swish; (b) ACON-C under different parameters
    Parameter error box diagrams. (a) Translation error; (b) angular error
    Registration rendering. (a) Reference image; (b) moving image; (c) registrated checkerboard rendering
    • Table 1. Transformation parameter distribution

      View table

      Table 1. Transformation parameter distribution

      ParameterDistribution range
      tx /mmU(-20, 20)
      ty /mmU(-20, 20)
      tz /mmU(-10, 10)
      tθ /(°)U(-10, 10)
      tα /(°)U(-10, 10)
      tβ /(°)U(-5, 5)
    • Table 2. Number distribution of the datasets

      View table

      Table 2. Number distribution of the datasets

      StructureNumber of images /104
      Training setTest setData set
      Pelvis314
      Chest314
    • Table 3. Comparison of network hyperparameters

      View table

      Table 3. Comparison of network hyperparameters

      BatchsizeT-MAE /mmR-MAE /(°)RMSE
      80.080.050.08
      160.100.060.09
      320.150.120.12
    • Table 4. Error comparison of branch structure ablation experiments

      View table

      Table 4. Error comparison of branch structure ablation experiments

      DatasetNetwork structureT-MAE /mmR-MAE /(°)RMSE
      PelvisNo branch0.1030.0730.115
      Identity0.0870.0620.098
      1×1 Conv0.0830.0570.093
      Proposed method0.0750.0510.084
      ChestNo branch0.1550.0990.169
      Identity0.1470.0880.156
      1×1 Conv0.1290.0820.143
      Proposed method0.1150.0680.125
    • Table 5. Time comparison of branch structure ablation experiments

      View table

      Table 5. Time comparison of branch structure ablation experiments

      Network structureParameter /106T-time /msI-time /ms
      No branch50.9829.825.7
      Identity50.9830.225.8
      1×1 Conv56.5333.225.8
      Proposed method56.5334.626.0
    • Table 6. Activation function comparison

      View table

      Table 6. Activation function comparison

      DatasetActivation functionT-MAE /mmR-MAE /(°)RMSE
      PelvisReLU0.0780.0520.087
      Swish0.0790.0530.088
      ACON-C0.0780.0520.087
      Meta-ACON0.0750.0510.084
      ChestReLU0.1430.0840.156
      Swish0.1510.0820.162
      ACON-C0.1290.0770.129
      Meta-ACON0.1150.0680.125
    • Table 7. Comparison of registration effects of different networks

      View table

      Table 7. Comparison of registration effects of different networks

      DatasetNetwork structureT-MAER-MAERMSETime /ms
      PelvisGoogLeNet0.36±0.190.23±0.130.39±0.2416.0
      VGG160.32±0.270.21±0.180.35±0.2119.2
      ResNet500.09±0.080.06±0.070.10±0.0818.4
      DenseNet1210.11±0.080.07±0.060.12±0.0934.5
      Net+GradNCC117.83±19.84.94±8.78
      Proposed method0.08±0.040.05±0.030.08±0.0626.0
      ChestGoogLeNet0.41±0.180.16±0.090.39±0.2021.5
      VGG160.56±0.450.31±0.240.60±0.4119.1
      ResNet500.33±0.090.20±0.050.35±0.1224.6
      DenseNet1210.15±0.080.09±0.050.16±0.0837.0
      Inception+branch100.611.932.3
      Proposed method0.12±0.070.07±0.040.13±0.0826.4
    • Table 8. Comparison of registration methods

      View table

      Table 8. Comparison of registration methods

      DatasetMethodNCCNMISSIMTime /ms
      PelvisNCC_Powell0.56±0.070.16±0.020.57±0.0996.4×103
      NMI_Powell0.61±0.090.15±0.010.57±0.0928.6×103
      Deep learning method90.82±0.070.32±0.0330.0
      Proposed method0.99±0.050.72±0.030.99±0.0826.0
      ChestNCC_Powell0.53±0.110.11±0.020.55±0.09101.5×103
      NMI_Powell0.57±0.090.11±0.020.58±0.0829.2×103
      Inception+branch100.422.3×103
      Proposed method0.99±0.060.56±0.020.99±0.0926.4
    Tools

    Get Citation

    Copy Citation Text

    Wenjü Li, Deqing Kong, Guogang Cao, Sicheng Li, Cuixia Dai. 2D-3D Medical Image Registration Based on Training-Inference Decoupling Architecture[J]. Laser & Optoelectronics Progress, 2022, 59(16): 1610015

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Nov. 16, 2021

    Accepted: Feb. 25, 2022

    Published Online: Aug. 8, 2022

    The Author Email: Cao Guogang (guogangcao@163.com)

    DOI:10.3788/LOP202259.1610015

    Topics