Chinese Journal of Ship Research, Volume. 16, Issue 6, 45(2021)
Maintenance strategy of ship multi-state deterioration system under reinforcement learning mode
Figures & Tables(9)
![[in Chinese]](/Images/icon/loading.gif){kind=icon}
Table 1. The cost of different actions in different states
View tableView in ArticleTable 1. The cost of different actions in different states
维修成本参数 系统状态 状态 $ {s}_{0} $ 状态 $ {s}_{1} $ 状态 $ {s}_{2} $ 状态 $ {s}_{3} $ 状态 $ {s}_{4} $ 状态 $ {s}_{5} $ 状态 $ {s}_{6} $ 运行时间 $ {t}_{}^{} $ /天150 120 110 90 70 50 − 单位运行成本e/元 10 15 25 30 35 50 − 维修成本 $ {c}_{2} $ /元− 2 400 3 000 3 400 3 800 48 00 − 维修时间 $ {r}_{2}^{} $ /元− 10 14 18 20 28 − 维修成本 $ {c}_{3} $ /元− 3 600 4 500 5 100 5 700 7 200 − 维修时间 $ {r}_{3}^{} $ /元− 15 21 27 30 42 − 维修成本 $ {c}_{4} $ /元− 6 000 7 500 8 000 9 500 12 000 15 000 维修时间 $ {r}_{4}^{} $ /元− 25 35 45 50 70 100
Table 2. The
Q value tableView tableView in ArticleTable 2. The
Q value tableQ值 系统状态 状态 $ {s}_{0} $ 状态 $ {s}_{1} $ 状态 $ {s}_{2} $ 状态 $ {s}_{3} $ 状态 $ {s}_{4} $ 状态 $ {s}_{5} $ 状态 $ {s}_{6} $ 不维修Q( $ {s}_{i} $ ,$ {a}_{1}) $ $ \times 10\;000 $ −4.33 −4.58 −5.01 −5.2 −6.12 −6.01 − 最小维修Q ( $ {s}_{i} $ ,$ {a}_{2}) $ $ \times 10\;000 $ − −4.36 −4.81 −5.19 −5.47 −5.92 − 中度维修Q ( $ {s}_{i} $ ,$ {a}_{3}) $ $ \times 10\mathrm{ }000 $ − −4.46 −4.72 −5.21 −5.46 −5.87 − 最佳维修Q ( $ {s}_{i} $ ,$ {a}_{4}) $ $ \times 10\;000 $ − −4.75 −5.01 −5.17 −5.39 −5.84 −6.45
Table 3. The optimal maintenance strategy with different
γ valuesView tableView in ArticleTable 3. The optimal maintenance strategy with different
γ values折扣系数γ 最优维修策略 最优维修行为的Q值 $ \times 10\;000 $ 0.15 [ $ {a}_{1},{a}_{1},{a}_{1},{a}_{1},{a}_{2},{a}_{3},{a}_{4} $ ][−0.36, −0.41, −0.55 ,-0.63, −1.10, −1.60, −2.77] 0.25 [ $ {a}_{1},{a}_{1},{a}_{1},{a}_{1},{a}_{2},{a}_{3},{a}_{4} $ ][−0.45, −0.53, −0.71, −0.81, −1.26, −1.77, −2.83] 0.35 [ $ {a}_{1},{a}_{1},{a}_{1},{a}_{1},{a}_{2},{a}_{3},{a}_{4} $ ][−0.60, −0.69, −0.90, −1.05, −1.48, −1.99, −2.94] 0.45 [ $ {a}_{1},{a}_{1},{a}_{1},{a}_{1},{a}_{2},{a}_{3},{a}_{4} $ ][−0.82, −0.93, −1.18, −1.34, −1.79, −2.29, −3.12] 0.55 [ $ {a}_{1},{a}_{2},{a}_{2},{a}_{1},{a}_{3},{a}_{3},{a}_{4} $ ][−1.16, −1.30, −1.61, −1.79, −2.22, −2.73, −3.41] 0.65 [ $ {a}_{1},{a}_{2},{a}_{2},{a}_{1},{a}_{4},{a}_{4},{a}_{4} $ ][−1.67, −1.75, −2.12, −2.42, −2.79, −3.25, −3.87] 0.75 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{0},{a}_{4},{a}_{4},{a}_{4} $ ][−2.47, −2.53, −2.91, −3.29, −3.67, −4.03, −4.64] 0.85 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{4},{a}_{4},{a}_{4},{a}_{4} $ ][−4.32, −4.32, −4.72, −5.17, −5.38, −5.83, −6.44] 0.95 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{4},{a}_{4},{a}_{4},{a}_{4} $ ][−13.41, −13.37, −13.75, −14.22, −14.42, −14.87, −15.47]
Table 4. The optimal maintenance strategy with different cost of inspection
View tableView in ArticleTable 4. The optimal maintenance strategy with different cost of inspection
检测成本/元 γ 最优维修策略 生命周期成本/元 0 0.85 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{4},{a}_{4},{a}_{4},{a}_{4} $ ]41903.31 200 0.85 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{4},{a}_{4},{a}_{4},{a}_{4} $ ]43104.57 500 0.85 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{4},{a}_{4},{a}_{4},{a}_{4} $ ]45263.58 1 000 0.85 [ $ {a}_{1},{a}_{2},{a}_{3},{a}_{4},{a}_{4},{a}_{4},{a}_{4} $ ]48553.46
Tools
Get Citation
Copy Citation Text
Jianda CHENG, Yan LIU, Tianyun LI, Yuntao CHU. Maintenance strategy of ship multi-state deterioration system under reinforcement learning mode[J]. Chinese Journal of Ship Research, 2021, 16(6): 45
Paper Information
Category: Ship Design and Performance
Received: Sep. 29, 2020
Accepted: --
Published Online: Mar. 28, 2025
The Author Email:
© Copyright 2018-2021 | Chinese Laser Press.
All Rights Reserved 沪ICP备15018463号-20