Chinese Journal of Liquid Crystals and Displays, Volume. 38, Issue 10, 1434(2023)
Optical flow estimation via fusing sequence image intensity correlation information
Fig. 3. Strength-weakness correlation of the edge-region point mapping with the center-region point mapping done by the horizontal cut（The strength of the correlation is indicated by the shade of the color of the bars，The correlation factor is set to 1 when the corresponding position area is identified as strong correlation. The weaker the rest of the color，the weaker the correlation）.
Fig. 4. Lookup operator based on correlation pyramid. The orange part is the neighborhood dot product of the query points at different scales.
Fig. 6. Convergence curve on KITTI-2015.（a）Convergence curve on EPE index；（b）Convergence curve on Fl index.
Fig. 7. Optical flow estimation results on the KITTI validation set（4，6，and 8 are the 4-point，6-point，and 8-point methods proposed in this paper，respectively）.
Fig. 8. Convergence curve on MPI-Sintel.（a）Convergence curve on EPE index；（b）Convergence curve on 1 px index；（c）Convergence curve on 3 px index；（d）Convergence curve on 5 px index.
Fig. 9. Optical flow estimation results on the MPI- Sintel validation set（4，6，and 8 are the 4-point，6-point，and 8-point methods proposed in this paper，respectively）.
Table 1. Optical flow estimation performance of different methods on KITTI-2015 test set（↓：The smaller the value，the better the performance）
View tableView in ArticleTable 1. Optical flow estimation performance of different methods on KITTI-2015 test set（↓：The smaller the value，the better the performance）
方法 EPE↓ Fl↓ VCN［ 13 ］1.417 402 2.675 603 DICL［ 21 ］1.319 655 2.679 850 RAFT［ 18 ］0.769 799 2.165 965 Ours（4） 0.706 651 1.850 664 Ours（6） 0.712 963 1.849 031 Ours（8） 0.707 347 1.862 571
Table 2. Optical flow estimation performance of different methods on MPI-Sintel test set（↓：The smaller the value，the better the performance；↑：The greater the value，the better the performance）
View tableView in ArticleTable 2. Optical flow estimation performance of different methods on MPI-Sintel test set（↓：The smaller the value，the better the performance；↑：The greater the value，the better the performance）
方法 Clean Final EPE↓ 1 px↑ 3 px↑ 5 px↑ EPE↓ 1 px↑ 3 px↑ 5 px↑ VCN［ 13 ］1.291 913 0.829 450 0.879 856 0.896 390 1.768 739 0.812 306 0.882 626 0.903 631 DICL［ 21 ］0.974 682 0.883 869 0.935 715 0.949 704 1.382 832 0.857 164 0.925 616 0.945 201 RAFT［ 18 ］0.891 926 0.901 724 0.959 283 0.972 931 1.278 316 0.869 313 0.938 721 0.958 746 Ours（4） 0.840 811 0.910 894 0.962 391 0.974 716 1.203 168 0.878 046 0.942 520 0.961 372 Ours（6） 0.847 912 0.911 220 0.962 403 0.974 791 1.206 491 0.878 168 0.942 854 0.960 920 Ours（8） 0.837 072 0.910 854 0.962 289 0.974 744 1.239 396 0.877 590 0.942 126 0.960 501
Table 3. Ablation experiments on KITTI-2015 and MPI-Sintel datasets
View tableView in ArticleTable 3. Ablation experiments on KITTI-2015 and MPI-Sintel datasets
KITTI-2015 MPI-Sintel EPE Fl Clean（EPE） Clean（1 px） Clean（3 px） Clean（5 px） Final（EPE） Final（1 px） Final（3 px） Final（5 px） BC 0.718 10 1.880 42 0.848 48 0.900 94 0.962 39 0.964 67 1.217 43 0.868 73 0.942 35 0.960 99 BA（4） 0.747 23 2.056 19 0.864 82 0.907 66 0.961 34 0.974 41 1.289 55 0.874 92 0.941 00 0.959 64 CA（4） 0.744 56 1.976 67 0.873 71 0.905 16 0.960 56 0.973 71 1.226 33 0.873 51 0.940 51 0.959 65 BA（6） 0.746 18 2.097 80 0.865 45 0.908 04 0.961 14 0.974 14 1.280 90 0.874 18 0.940 80 0.959 46 CA（6） 0.749 14 2.034 94 0.870 99 0.906 35 0.961 49 0.974 54 1.240 37 0.874 62 0.941 63 0.960 46 BA（8） 0.748 25 2.122 27 0.865 35 0.907 42 0.961 20 0.974 13 1.278 82 0.875 24 0.941 34 0.941 34 CA（8） 0.750 02 1.997 00 0.870 24 0.906 37 0.961 29 0.974 33 1.251 65 0.874 51 0.941 02 0.941 34 BCA（8） 0.707 34 1.850 66 0.837 07 0.910 85 0.962 28 0.974 74 1.239 39 0.877 59 0.942 12 0.960 50
Get Citation
Copy Citation Text
Tong AN, Di JIA, Jia-bao ZHANG, Peng CAI. Optical flow estimation via fusing sequence image intensity correlation information[J]. Chinese Journal of Liquid Crystals and Displays, 2023, 38(10): 1434
Category: Research Articles
Received: Nov. 18, 2022
Accepted: --
Published Online: Oct. 25, 2023
The Author Email: Di JIA (1319423118@qq.com)
