[4] LAZAROWSKA A. A discrete planning approach in collision avoidance for smart ships[J]. Procedia Computer Science, 176, 380-389(2020).

[5] GHADERI H. Autonomous technologies in short sea shipping: trends, feasibility and implications[J]. Transport Reviews, 39, 152-173(2019).

[6] [6] YAN X P, MA F, LIU J L, et al. Applying the navigation brain system to inl ferries[C]Proceedings of the 18th Conference on Computer IT Applications in the Maritime Industries (COMPIT 2019). Hamburg: Technische Universitt Hamburg, 2019.

[7] [7] YOU X, MA F, LU S L, et al. An integrated platfm f the development of autonomous remotecontrol ships[C]Proceedings of the 19th Conference on Computer IT Applications in the Maritime Industries (COMPIT 2020). Pontignano, Italy: [s. n. ], 2020.

[8] LIU C G, CHU X M, WU W X et al. Human-machine cooperation research for navigation of maritime autonomous surface ships: a review and consideration[J]. Ocean Engineering, 246, 110555(2022).

[11] HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 9, 1735-1780(1997).

[12] [12] SCHULMAN J, WOLSKI F, DHARIWAL P, et al. Proximal policy optimization algithms[EBOL]. (20170828). https:arxiv.gpdf1707.06347.pdf.

[13] YANG J C, ZHANG J P, WANG H H. Urban traffic control in software defined internet of things via a multi-agent deep reinforcement learning approach[J]. IEEE Transactions on Intelligent Transportation Systems, 22, 3742-3754(2021).

[14] WANG S W, MA F, YAN X P et al. Adaptive and extendable control of unmanned surface vehicle formations using distributed deep reinforcement learning[J]. Applied Ocean Research, 110, 102590(2021).

[15] [15] LILLICRAP T P, HUNT J J, PRITZEL A, et al. Continuous control with deep reinfcement learning[C]Proceedings of the 4th International Conference on Learning Representations. San Juan, Puerto Rico: [s. n. ], 2015.

[16] YAN X P, WANG S W, MA F et al. A novel path planning approach for smart cargo ships based on anisotropic fast marching[J]. Expert Systems with Applications, 159, 113558(2020).