[1] [1] ERDELJ MNATALIZIO E.UAVassisted disaster management:applications and open issues［C］//Proceedings of IEEE International Conference on ComputingNetworking and Communications.Kauai:IEEE2016:15.

[2] [2] FAICAL B SUEYAMA JDE CARVALHO A C P L F.The use of autonomous UAVs to improve pesticide application in crop fields［C］//Proceedings of 17th IEEE International Conference on Mobile Data Management.Porto:IEEE2016:3233.

[3] [3] LI Z RLIU YHAYWARD Ret al.Knowledgebased power line detection for UAV surveillance and inspection systems［C］//Proceedings of 23rd International Conference on Image and Vision Computing.Christchurch:IEEE 2008:16.

[4] [4] OUYANG JZHUANG YLIN Met al.Optimization of beamforming and path planning for UAVassisted wireless relay networks［J］.Chinese Journal of Aeronautics 201427(2):313320.

[5] [5] SHI W SLI J LWU H Qet al.Dronecell trajectory planning and resource allocation for highly mobile networks:a hierarchical DRL approach［J］.IEEE Internet of Things Journal20218(12):98009813.

[6] [6] LIU YLUO Z HLIU Zet al.Cooperative routing problem for ground vehicle and unmanned aerial vehicle:the application on intelligencesurveillanceand reconnaissance missions［J］.IEEE Access20197:6350463518.

[7] [7] ZHAO ZNIU Y FSHEN L C.Adaptive level of autonomy for humanUAVs collaborative surveillance using situated fuzzy cognitive maps［J］.Chinese Journal of Aeronautics202033(11):28352850.

[9] [9] GAERTNER U.UAV swarm tactics:an agentbased simulation and Markov process analysis［D］.Monterey:Naval Postgraduate School2013.

[10] [10] ERNEST NCARROLL DSCHUMACHER Cet al.Genetic fuzzy based artificial intelligence for unmanned combat aerial vehicle control in simulated air combat missions［J］.Journal of Defense Management20166(1):1000144.

[11] [11] RAMIREZ A CBELLO O GRMORENO M Det al.Solving complex multiUAV mission planning problems using multiobjective genetic algorithms［J］.Soft Computing201721:48834900.

[12] [12] ZHEN Z YXING D JGAO C.Cooperative searchattack mission planning for multiUAV based on intelligent selforganized algorithm［J］.Aerospace Science and Technology201876:402411.

[13] [13] ZHANG G YLI YXU X Het al.Multiagent reinforcement learning for swarm confrontation environments［C］//Intelligent Robotics and Applications.Shenyang:Springer Cham 2019:533543.

[14] [14] SUN Z XPIAO H YYANG Zet al.Multiagent hierarchical policy gradient for air combat tactics emergence via selfplay［J］.Engineering Applications of Artificial Intelligence202098:104112.

[15] [15] ALTMAN E.Constrained Markov decision processes［M］.New York:Routledge1999.

[16] [16] HA SXU PTAN Z Yet al.Learning to walk in the real world with minimal human effort［EB/OL］.(20201103)［20221201］.https://arxiv.org/abs/2002.08550.

[17] [17] SUTTON R SBARTO A G.Reinforcement learning:an introduction［M］.Cambridge:MIT Press1998.

[18] [18] SILVER DHUANG AMADDISON C Jet al.Mastering the game of Go with deep neural networks and tree search［J］.Nature2016529:484489.

[19] [19] SILVER DSCHRITTWIESER JSIMONYAN Ket al.Mastering the game of Go without human knowledge［J］.Nature2017550:354359.

[20] [20] HAARNOJA TZHOU AABBEEL Pet al.Soft actorcritic:offpolicy maximum entropy deep reinforcement learning with a stochastic actor［EB/OL］.(20180808)［20221201］.https://arxiv.org/abs/1801.01290.

[21] [21] PLATT J CBARR A H.Constrained differential optimization［C］//Neural Information Processing Systems. Cambridge:MIT Press1987:612621.

[22] [22] HAARNOJA TZHOU AHARTIKAINEN Ket al.Soft actorcritic algorithms and applications［EB/OL］.(20190129)［20221201］.https://arxiv.org/abs/1812.05905.

[23] [23] KINGMA D PBA J.Adam:a method for stochastic optimization［EB/OL］.(20170130)［20221201］.https://arxiv.org/abs/1412.6980.

[24] [24] SCHULMAN JWOLSKI FDHARIWAL Pet al.Proximal policy optimization algorithm［EB/OL］.(20170828)［20221201］.https://arxiv.org/abs/1707.06347.