Laser & Optoelectronics Progress, Volume. 60, Issue 16, 1600001(2023)

Review of Camera Calibration Methods and Their Progress

Wenwen Huang1,2, Xiaohong Peng3, Liyuan Li3, and Xiaoyan Li1、*
Author Affiliations
  • 1Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, Zhejiang, China
  • 2Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
  • 3State Key Laboratory of Infrared Physics, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • show less
    References(86)

    [1] Do P N B, Nguyen Q C. A review of stereo-photogrammetry method for 3-D reconstruction in computer vision[C], 138-143(2019).

    [2] Wrobel B P. Multiple view geometry in computer vision[J]. Kybernetes, 30, 1333-1341(2001).

    [3] Fusiello A. Uncalibrated euclidean reconstruction: a review[J]. Image and Vision Computing, 18, 555-563(2000).

    [4] Ge P X, Wang Y H, Wang H Q et al. Multivision sensor extrinsic calibration method with non-overlapping fields of view using encoded 1D target[J]. IEEE Sensors Journal, 22, 13519-13528(2022).

    [5] Bu L B, Huo H T, Liu X Y et al. Concentric circle grids for camera calibration with considering lens distortion[J]. Optics and Lasers in Engineering, 140, 106527(2021).

    [6] Chen X C, Song X K, Wu J et al. Camera calibration with global LBP-coded phase-shifting wedge grating arrays[J]. Optics and Lasers in Engineering, 136, 106314(2021).

    [7] Zhang Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1330-1334(2000).

    [8] Hartley R I. Self-calibration of stationary cameras[J]. International Journal of Computer Vision, 22, 5-23(1997).

    [9] Yang C J, Wang W, Hu Z Y. An active vision based camera intrinsic parameters self-calibration technique[J]. Chinese Journal of Computers, 21, 428-435(1998).

    [10] Wu F C, Ruan Z C, Hu Z Y. Self-calibration of a camera with a non-linear model[J]. Chinese Journal of Computers, 25, 276-283(2002).

    [11] Wu F C, Hu Z Y. Linear determination of the infinite homography and camera self-calibration[J]. Acta Automatica Sinica, 28, 488-496(2002).

    [12] Li M X. Camera calibration of a head-eye system for active vision[M]. Eklundh J O. Computer vision-2014 ECCV '94. Lecture notes in computer science, 800, 541-554(1994).

    [13] Li H, Wu F C, Hu Z Y. A new linear camera self-calibration technique[J]. Chinese Journal of Computers, 23, 1121-1129(2000).

    [14] Hartley R I. Projective reconstruction and invariants from multiple images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16, 1036-1041(1994).

    [15] Pollefeys M, van Gool L, Oosterlinck A. The modulus constraint: a new constraint self-calibration[C], 349-353(1996).

    [16] Yang Y N. Research on camera self calibration method based on image sequence[D](2020).

    [17] Meng X Q, Hu Z Y. Recent progress in camera self-calibration[J]. Acta Automatica Sinica, 29, 110-124(2003).

    [18] Triggs B. Autocalibration and the absolute quadric[C], 609-614(2017).

    [19] Heyden A, Astrom K. Flexible calibration: minimal cases for auto-calibration[C], 350-355(1999).

    [20] Pollefeys M, Koch R, van Gool L. Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters[C], 90-95(1998).

    [22] Hartley R I, Hayman E, de Agapito L et al. Camera calibration and the search for infinity[C], 510-517(1999).

    [23] Vasconcelos F, Barreto J P, Boyer E. Automatic camera calibration using multiple sets of pairwise correspondences[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 791-803(2018).

    [24] Kim J O, Lee D. Mathematical model for a calibration of multiple-view thermal camera[C](2021).

    [25] Faugeras O D, Luong Q T, Maybank S J. Camera self-calibration: theory and experiments[C], 321-334(1992).

    [26] Róg M, Rzonca A. The impact of photo overlap, the number of control points and the method of camera calibration on the accuracy of 3D model reconstruction[J]. Geomatics and Environmental Engineering, 15, 67-87(2021).

    [27] Wang Z A, Liu B Q, Huang F Y. Binocular ultra-wide-angle infrared camera calibration based on generic camera model[J]. Electronics Optics & Control, 27, 108-111(2020).

    [28] Bhardwaj R, Tummala G K, Ramalingam G et al. AutoCalib: automatic traffic camera calibration at scale[J]. ACM Transactions on Sensor Networks, 14, 19(2018).

    [29] Zhao Q J, Sun Z Q, Lan L. Neural network technique in camera calibration[J]. Control and Decision, 17, 336-338, 342(2002).

    [30] Raza S N, Rehman H R, Lee S G et al. Artificial intelligence based camera calibration[C], 1564-1569(2019).

    [31] Wen J, Schweitzer G. Hybrid calibration of CCD cameras using artificial neural nets[C], 337-342(1991).

    [32] Jun J, Kim C. Robust camera calibration using neural network[C], 694-697(1999).

    [33] Lü C H, Zhang Z Y, An P. Camera calibration for stereo vision based on neural network[J]. Chinese Journal of Mechanical Engineering, 39, 93-96(2003).

    [34] Jin L G, Rui L G. Camera calibration for monocular vision system based on Harris corner extraction and neural network[C](2011).

    [35] Ding X Z. Research on kinect calibration and depth error compensation based on BP neural network[C], 596-600(2020).

    [36] Hu Z X, Wang T. Binocular camera calibration based on BP neural network optimized by improved genetic algorithm[J]. Electronics Optics & Control, 29, 75-79(2022).

    [37] Li G Y, Xu P, Li H G et al. Camera calibration based on optimized RBF-DDA neural networks[J]. Computer Engineering, 33, 244-246(2007).

    [38] Liu S, Fu H X, Wang Y C. Camera calibration for stereo vision based on LS-SVM[J]. Opto-Electronic Engineering, 35, 21-25, 47(2008).

    [39] Sun Q, Wang X Y, Xu J P et al. Camera self-calibration with lens distortion[J]. Optik, 127, 4506-4513(2016).

    [40] Tsai R Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses[J]. IEEE Journal on Robotics and Automation, 3, 323-344(1987).

    [42] Beyer H A. Calibration of CCD-cameras for machine vision and robotics[J]. Proceedings of SPIE, 1197, 88-98(1990).

    [43] Gong Y Z, Meng D, Seibel E J. Bound constrained bundle adjustment for reliable 3D reconstruction[J]. Optics Express, 23, 10771-10785(2015).

    [44] Liu Y, Li T F. Reaserch of the improvement of Zhang’s camera calibration method[J]. Optical Technique, 40, 565-570(2014).

    [45] Zhang H P, Wang Z Y, Wu P C et al. Checker pattern improvement and fully-automatic identification for camera calibration[J]. Chinese Journal of Scientific Instrument, 33, 1102-1109(2012).

    [46] Zhang H P, Wang Z Y, Wu P C et al. Camera calibration based on LCD and improved checkerboard pattern[J]. Chinese Journal of Scientific Instrument, 33, 1541-1548(2012).

    [47] Huang B Y, Tang Y, Ozdemir S et al. A fast and flexible projector-camera calibration system[J]. IEEE Transactions on Automation Science and Engineering, 18, 1049-1063(2021).

    [48] Wang Z W, Shi H S, Lin D L. Effective factors analysis on camera calibration[C], 331-334(2020).

    [49] Meng X Q, Hu Z Y. A new easy camera calibration technique based on circular points[J]. Pattern Recognition, 36, 1155-1164(2003).

    [50] Wu Y H, Zhu H J, Hu Z Y et al. Camera calibration from the quasi-affine invariance of two parallel circles[M]. Pajdla T, Matas J. Computer vision-ECCV 2004. Lecture notes in computer science, 3021, 190-202(2004).

    [51] Zhao C Y, Zhang J, Deng H X et al. Multi-cameras calibration from spherical targets[J]. Proceedings of SPIE, 9903, 99032T(2016).

    [52] Hajjami J, Caracotte J, Caron G et al. ArUcOmni: detection of highly reliable fiducial markers in panoramic images[C], 2693-2699(2020).

    [53] Ahn S J, Warnecke H J, Kotowski R. Systematic geometric image measurement errors of circular object targets: mathematical formulation and correction[J]. The Photogrammetric Record, 16, 485-502(1999).

    [54] He D, Liu X L, Peng X et al. Eccentricity error identification and compensation for high-accuracy 3D optical measurement[J]. Measurement Science & Technology, 24, 075402(2013).

    [55] An J J, Gao N, Chen C et al. Correcting method and evaluation of eccentricity error of circle target[J]. Laser & Optoelectronics Progress, 54, 041203(2017).

    [56] Ye D, Liu C Y, Che R S et al. Dummy solid camera calibration technology using genetic algorithm[J]. Optics and Precision Engineering, 14, 485-489(2006).

    [57] Yu J, Chen C, Gao N et al. Camera calibration based on phase target[J]. Laser & Optoelectronics Progress, 55, 111203(2018).

    [58] Xue J P, Su X Y, Dou Y F. A concentric circles and wedge grating-based camera self-calibration method[J]. Chinese Journal of Lasers, 39, 0308002(2012).

    [59] Sagawa R, Takatsuji M, Echigo T et al. Calibration of lens distortion by structured-light scanning[C], 832-837(2005).

    [60] Yang C J, Sun F M, Hu Z Y. Self-calibration of rotating cameras using conic correspondences[J]. Acta Automatica Sinica, 27, 310-317(2001).

    [61] Li B Q, Fang Y C, Zhang X B. Unified rotation-based self-calibration method for cameras[J]. Acta Optica Sinica, 33, 1115003(2013).

    [62] Ma S D. A self-calibration technique for active vision systems[J]. IEEE Transactions on Robotics and Automation, 12, 114-120(1996).

    [63] Wu F C, Li H, Hu Z Y. New active vision based camera self-calibration technique[J]. Acta Automatica Sinica, 27, 752-762(2001).

    [64] Wu F C, Hu Z Y. Linear determination of the infinite homography and camera self-calibration[J]. Acta Automatica Sinica, 28, 488-496(2002).

    [65] Enciso R, Viéville T. Experimental self-calibration from four views[M]. Braccini C, de Floriani L, Vernazza G. Image analysis and processing. Lecture notes in computer science, 974, 307-312(1995).

    [67] Ma Y, Vidal R, Kosecka J et al. Kruppa equation revisited: its renormalization and degeneracy[M]. David V. Computer vision-ECCV 2000. Lecture notes in computer science, 1843, 561-577(2000).

    [68] Wampler C W, Morgan A P, Sommese A J. Numerical continuation methods for solving polynomial systems arising in kinematics[J]. Journal of Mechanical Design, 112, 59-68(1990).

    [70] Hartley R I. Euclidean reconstruction from uncalibrated views[C], 237-256(1993).

    [72] Pollefeys M, Van Gool M. Self-calibration from the absolute conic on the plane at infinity[C], 175-182(1997).

    [73] Heyden A, Astrom K. Euclidean reconstruction from image sequences with varying and unknown focal length and principal point[C], 438-443(2002).

    [74] You Z. Research on camera self-calibration for 3D reconstruction with varying intrinsic parameters[D](2014).

    [75] Cui A, Yuan Z, Wang L S. Self-adaptive neural network for binocular camera calibration[J]. Computer Engineering and Applications, 45, 55-57, 60(2009).

    [76] Zhang F F, Chen L, Xue B S et al. Binocular camera calibration of BP neural networks optimized by an improved differential genetic algorithm[J]. Journal of Harbin Engineering University, 42, 928-935(2021).

    [77] Cui P F. Research of the camera calibration methods based on neural network[D](2013).

    [78] Pan F, Li W X, Gao Q[M]. Particle swarm optimizer and multi-object optimization(2013).

    [79] Woo D M, Park D C. An efficient method for camera calibration using MultiLayer perceptron type neural network[C], 358-362(2009).

    [80] Woo D M, Park D C. Implicit camera calibration using MultiLayer perceptron type neural network[C], 313-317(2009).

    [82] Pedra A V B M, Mendonça M, Finocchio M A F et al. Camera calibration using detection and neural networks[J]. IFAC Proceedings Volumes, 46, 245-250(2013).

    [83] Xiang P, Zhou B, Zhu Y K et al. Camera calibration based on deep neural network in complex environments[J]. Laser & Optoelectronics Progress, 56, 111505(2019).

    [84] Ding X Z. Research on camera calibration technology based on deep neural network in mine environment[C], 375-379(2020).

    [85] Butt T H, Taj M. Camera calibration through camera projection loss[C], 2649-2653(2022).

    Tools

    Get Citation

    Copy Citation Text

    Wenwen Huang, Xiaohong Peng, Liyuan Li, Xiaoyan Li. Review of Camera Calibration Methods and Their Progress[J]. Laser & Optoelectronics Progress, 2023, 60(16): 1600001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Reviews

    Received: May. 5, 2022

    Accepted: Sep. 16, 2022

    Published Online: Aug. 15, 2023

    The Author Email: Li Xiaoyan (lixiaoyan@ucas.ac.cn)

    DOI:10.3788/LOP221494

    Topics