[4] [4] LIU S, XING B W, ZHU W L. A fusion fuzzy PID controller with realtime implementation on a ship course control system[C]Proceedings of the 2015 23rd Mediterranean Conference on Control Automation (MED). Tremolinos, Spain: IEEE, 2015.

[5] MAGALHÃES J, DAMAS B, LOBO V. Reinforcement learning: the application to autonomous biomimetic underwater vehicles control[J]. IOP Conference Series: Earth and Environmental Science, 172, 12-19(2018).

[6] MNIH V, KAVUKCUOGLU K, SILVER D et al. Human-level control through deep reinforcement learning[J]. Nature, 518, 529-533(2015).

[7] [7] WOO J, KIM N. Vect field based guidance method f docking of an unmanned surface vehicle[C]Proceedings of the 12th ISOPE PacificAsia Offshe Mechanics Symposium. Gold Coast, Australia: International Society of Offshe Polar Engineers, 2016.

[9] MOREIRA L, FOSSEN T I, SOARES C G. Path following control system for a tanker ship model[J]. Ocean Engineering, 34, 2074-2085(2007).

[11] [11] CARRERAS M, RIDAO P, ELFAKDI A. Semionline neural Q_leaming f realtime robot learning[C]Proceedings of 2003 IEEERSJ International Conference on Intelligent Robots Systems. Las Vegas, Nevada: IEEE, 2003: 662667.

[13] WOO J, YU C, KIM N. Deep reinforcement learning-based controller for path following of an unmanned surface vehicle[J]. Ocean Engineering, 183, 155-166(2019).

[14] [14] LILLICRAP T P, HUNT J J, PRITZEL A, et al. Continuous control with deep reinfcement learning[C]Proceedings of the 4th International Conference on Learning Representations. San Juan, 2015: A187.

[15] [15] SILVER D, LEVER G, HEESS N, et al. Deterministic policy gradient algithms[C]Proceedings of the 31st International Conference on Machine Learning. Beijing, China: ACM, 2014: I387–I395.

[16] YASUKAWA H, YOSHIMURA Y. Introduction of MMG standard method for ship maneuvering predictions[J]. Journal of Marine Science and Technology, 20, 37-52(2015).

[17] LIU J L, QUADVLIEG F, HEKKENBERG R. Impacts of the rudder profile on manoeuvring performance of ships[J]. Ocean Engineering, 124, 226-240(2016).