Chinese Journal of Ship Research, Volume. 20, Issue 1, 107(2025)

Ship global path planning based on improved DQN algorithm

Wei GUAN... Sheng QU, Xianku ZHANG and Tongbo HU |Show fewer author(s)
Author Affiliations
  • Navigation College, Dalian Maritime University, Dalian 116026, China
  • show less

    Objective

    In order to improve the economy and safety of ship navigation path in actual sea environment, this paper proposes a ship global path planning method with an improved Deep Q-Network (DQN) algorithm.

    Method

    First, a prioritized experience replay (PER) mechanism is introduced to the DQN to give higher weights to important samples and improve learning efficiency. Next, its network structure is improved through a duel network and noise network, enabling it to evaluate the values of specific states and actions more accurately and generalization capabilities.

    Result

    An experiment is carried out in the marine environment near Manila, and the results show that compared with the A* algorithm and DQN algorithm, the improved algorithm reduces the path length by 1.9% and 1.0% respectively, and the number of turning points by 62.5% and 25% respectively.

    Conclusion

    It is verified that the improved DQN algorithm can plan the effective path more economically and rationally.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Wei GUAN, Sheng QU, Xianku ZHANG, Tongbo HU. Ship global path planning based on improved DQN algorithm[J]. Chinese Journal of Ship Research, 2025, 20(1): 107

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Planning and Decision-making

    Received: Apr. 7, 2024

    Accepted: --

    Published Online: Mar. 13, 2025

    The Author Email:

    DOI:10.19693/j.issn.1673-3185.03866

    Topics