Electronics Optics & Control, Volume. 31, Issue 8, 1(2024)

UAV Intelligent Mission Planning Based on SAC-Lagrangian Under Confrontation Conditions

YUE Longfei1... YANG Rennong2, YAN Mengda2, ZHAO Xiaoru2, ZUO Jialiang2, LIU Huiliang3 and ZHANG Mingyua1 |Show fewer author(s)
Author Affiliations
  • 1National Key Laboratory of Electromagnetic, Naval University of Engineering, Wuhan 430000, China
  • 2Air Traffic Control and Navigation College, Air Force Engineering University, Xi'an 710000, China
  • 3Xi'an Satellite Control Center, Xi'an 710000, China
  • show less

    Due to its advantages of low cost,consumable,distributed deployment,agility and flexibility,UAVs have shown great success in many civil fields.However,due to the limitation of its intelligence,there are still significant challenges in how to autonomously and safely complete tasks under complex adversarial conditions.Aiming at the problems of intelligence and safety in UAV mission planning,based on safe reinforcement learning,a UAV intelligent planning method called SAC-Lagrangian is proposed.Considering the radar threats,no fly zone safety constraints and ground-to-air missile(SAM) countermeasure conditions,the mission planning problem is modeled as a Constrained Markov Decision Process (CMDP),which is transformed into a dual problem through Lagrangian multiplier method.The maximum entropy Soft Actor-Critic(SAC) algorithm is used to approximate the optimal policy,ensuring that the agent can maximize the expected return under the safety constraints.Compared with other baseline algorithms,simulation results show that the proposed method can ensure the safety while ensuring the task performance,adapt to the dynamical changing scenarios,and achieve a task completion rate of 96%.Therefore,the proposed method is efficient,robust and safe.

    Tools

    Get Citation

    Copy Citation Text

    YUE Longfei, YANG Rennong, YAN Mengda, ZHAO Xiaoru, ZUO Jialiang, LIU Huiliang, ZHANG Mingyua. UAV Intelligent Mission Planning Based on SAC-Lagrangian Under Confrontation Conditions[J]. Electronics Optics & Control, 2024, 31(8): 1

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Dec. 27, 2022

    Accepted: --

    Published Online: Nov. 20, 2024

    The Author Email:

    DOI:10.3969/j.issn.1671-637x.2024.08.001

    Topics