Adaptive control of unmanned surface vehicle based on improved DDPG algorithm

Lifei SONG; Chuanyi XU; Le HAO; Rong GUO; Wei CHAI

doi:10.19693/j.issn.1673-3185.03122

[3] [3] LIU Z Q, YU L W, XIANG Q, et al. Research on USV trajecty tracking method based on LOS algithm[C]Proceedings of the 14th International Symposium on Computational Intelligence Design (ISCID). Hangzhou, China: IEEE, 2021.

[6] [6] DAOUN D, IBNAT F, ALOM Z, et al. Reinfcement learning: a friendly introduction[C]The International Conference on Deep Learning, Big Data Blockchain. Cham: Springer, 2021: 134−146.

[7] HEUILLET A, COUTHOUIS F, DÍAZ-RODRÍGUEZ N. Explainability in deep reinforcement learning[J]. Knowledge-Based Systems, 214, 106685(2021).

[9] [9] DENG W N, LI H, WEN Y Q. Datadriven unmanned surface vessel path following control method based on reinfcement learning[C]2019 Chinese Control Decision Conference (CCDC). Nanchang, China: IEEE, 2019: 3035−3040.

[10] ZHAO Y J, QI X, MA Y et al. Path following optimization for an underactuated USV using smoothly-convergent deep reinforcement learning[J]. IEEE Transactions on Intelligent Transportation Systems, 22, 6208-6220(2021).

[12] ZHAO Y J, MA Y, HU S L. USV formation and path-following control via deep reinforcement learning with random braking[J]. IEEE Transactions on Neural Networks and Learning Systems, 32, 5468-5478(2021).

[14] ZHANG Q, DING Z Y, ZHANG M J. Adaptive self-regulation PID control of course-keeping for ships[J]. Polish Maritime Research, 27, 39-45(2020).

[15] LIAO Y L, JIA Z H, ZHANG W B et al. Layered berthing method and experiment of unmanned surface vehicle based on multiple constraints analysis[J]. Applied Ocean Research, 86, 47-60(2019).

[16] ASFIHANI T, ARIF D K, SUBCHAN et al. Comparison of LQG and adaptive PID controller for USV heading control[J]. Journal of Physics:Conference Series, 1218, 012058(2019).