[1] A H MOKHTARI, H R K DIDANI. An empirical survey on the role of human error in marine incidents. TransNav, the International Journal on Marine Navigation and Safety of Sea Transportation, 7, 363-367(2013).

[4] R MU, W H YU, Z X LI et al. Motion planning for autonomous vehicles in unanticipated obstacle scenarios at intersections based on artificial potential field. Applied Sciences, 14, 1626(2024).

[7] W GUAN, K WANG. Autonomous collision avoidance of unmanned surface vehicles based on improved a-star and dynamic window approach algorithms. IEEE Intelligent Transportation Systems Magazine, 15, 36-50(2013).

[8] D SILVER, T HUBERT, J SCHRITTWIESER et al. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science, 362, 1140-1144(2018).

[9] W GUAN, M Y ZHAO, C B ZHANG et al. Generalized behavior decision-making model for ship collision avoidance via reinforcement learning method. Journal of Marine Science and Engineering, 11, 273(2023).

[10] H Q SHEN, H HASHIMOTO, A MATSUDA et al. Automatic collision avoidance of multiple ships based on deep Q-learning. Applied Ocean Research, 86, 268-288(2019).

[11] Y S FAN, Z SUN, G F WANG. A novel reinforcement learning collision avoidance algorithm for USVs based on maneuvering characteristics and COLREGs. Sensors, 22, 2099(2022).

[12] Z Z CHU, F L WANG, T J LEI et al. Path planning based on deep reinforcement learning for autonomous underwater vehicles under ocean current disturbance. IEEE Transactions on Intelligent Vehicles, 8, 108-120(2023).

[15] H J WANG, W GAO, Z WANG et al. Research on obstacle avoidance planning for UUV based on A3C algorithm. Journal of Marine Science and Engineering, 12, 63(2024).

[16] W GUAN, H W PENG, X K ZHANG et al. Ship steering adaptive CGS control based on EKF identification method. Journal of Marine Science and Engineering, 10, 294(2022).

[17] L P PERERA, P OLIVEIRA, SOARES C GUEDES. System identification of nonlinear vessel steering. Journal of Offshore Mechanics and Arctic Engineering, 137, 031302(2015).

[18] P V DAVIS, M J DOVE, C T STOCKEL. A computer simulation of marine traffic using domains and arenas. Journal of Navigation, 33, 215-222(1980).

[19] [19] ŚMIERZCHALSKI R. Ships'' domains as collision risk at sea in the evolutionary method of trajecty planning[M]SAEED K, PEJAŚ J. Infmation Processing Security Systems. Boston: Springer, 2005: 411−422.

[20] Z W CUI, W GUAN, W Z LUO et al. Intelligent navigation method for multiple marine autonomous surface ships based on improved PPO algorithm. Ocean Engineering, 287, 115783(2023).

[21] [21] CHRISTIANO P F, LEIKE J, BROWN T B, et al. Deep reinfcement learning from human preferences[C]Proceedings of the 31st International Conference on Neural Infmation Processing Systems. Long Beach: Curran Associates Inc. , 2017: 4299−4307.

[22] [22] ZHENG Z Y, OH J, SINGH S. On learning intrinsic rewards f policy gradient methods[C]Proceedings of the 32nd International Conference on Neural Infmation Processing Systems. Montréal: Curran Associates Inc., 2018: 4644−4654.

[23] [23] ZHENG Z Y, OH J, HESSEL M, et al. What can learned intrinsic rewards capture[C]Proceedings of the 37th International Conference on Machine Learning. PMLR, 2019: 1060.