Chinese Journal of Lasers, Volume. 52, Issue 3, 0301001(2025)
Stabilization of Intelligent Laser Cavity Based on Deep Reinforcement Learning Algorithm
High-power, high-beam-quality lasers have wide applications in industry, medicine, scientific research, and national defense. However, in practical applications, factors such as vibration shocks and environmental temperature changes can cause the cavity mirrors of the laser resonator to deviate, thus resulting in a phenomenon known as detuning. Consequently, the laser resonator no longer functions in the optimal operating state. First, it affects the fundamental mode operation, thereby deteriorating the output-beam quality. In severe cases, this may affect the safe operation of the laser. In recent years, owing to the continuous expansion of laser applications, the autonomous monitoring and optimization of lasers have been urgently demanded in scenarios such as unmanned factories, vibration environments, and space environments, where manual maintenance cannot be achieved easily in real time.
In this study, a dual-factor fusion evaluation criterion is proposed that reflects the operating state of a laser by calculating the beam power and morphology in real time, as well as by performing correlation calculations in the theoretical Gaussian optical-field mode, while considering both the mode-field distribution and output power of the laser. Subsequently, a mirror control scheme based on the proximal policy optimization (PPO) algorithm is proposed by combining the mode and intensity of the laser spot with the posture of the cavity mirror using deep reinforcement learning (DRL). This establishes an intelligent agent that can perceive and control the laser cavity. The experimental setup is shown in Fig. 2.
Generally, deviations in the cavity mirror not only decrease the laser power but may also damage certain optical components owing to the deviated optical path. As a side-pumped laser head is used in this experiment, the deviated laser beams may damage the end-face seal, thereby affecting the normal output of the measuring pump head. Therefore, we intervene in the active control when the power fluctuates within 3%‒5%. For the first 50% power loss, the output power of the laser is more sensitive to the misalignment angle of the cavity mirror (Fig. 3). The health status of the laser is described by a reward function that combines the beam quality and output power. A pretrained deep neural network using the DRL algorithm is employed to control the laser resonant cavity. The results show that the DRL-based laser control agent can intelligently stabilize a misaligned laser resonant cavity within seconds (Fig. 8). This method presents a path advantage over previous algorithms (Fig. 9). Figure 11 shows the stability test results for the resonant cavity agent within 30 min. The average output power is 90.7 W, with a root mean square (RMS) value of 0.95. This indicates that the output power is highly stable over a long period and that the operational decisions regarding the cavity mirror remain stable over time. A spot output with a high beam quality close to the diffraction limit is obtained (Fig. 10).
In this study, an intelligent laser-cavity stabilization technique based on a DRL algorithm is introduced and demonstrated. A deep neural network pretrained using the DRL algorithm is utilized to control the laser cavity. The results show that the DRL-based laser control agent can intelligently stabilize a misaligned laser cavity within seconds. This approach avoids the disadvantages of conventional control methods such as model building, variable decoupling, and parameter tuning. In addition to linear resonant cavities, the agent can be used for various other types of resonant cavities, including folded and ring cavities. Using a simple feedforward neural network architecture that requires minimal computational and storage resources, the agent is easy to integrate into embedded or edge computing devices, facilitating large-scale deployment of intelligent hardware. Compared with other optimization algorithms, the agent offers more efficient strategies and is thus applicable to higher-dimensional control problems. The perception and operational space of the laser can be extended by integrating artificial intelligence (AI)-based adjustment systems and multiple sensors. Such intelligent lasers can autonomously adjust the optical components based on real-time requirements and environmental changes, thereby achieving highly personalized laser outputs, enhancing the system robustness, and improving the laser performance metrics. In conclusion, the resonant-cavity control agent is crucial for the design, intelligent diagnosis, and state stabilization of future complex laser systems. Furthermore, it is expected to be applicable to the AI diagnosis and maintenance of laser systems in harsh environments such as deep seas and outer space.
Get Citation
Copy Citation Text
Jingyu Li, Zongzhe Zhang, Jing Yang, Lin Han, Hao Wang, Yunping Wang, Hongwei Gao, Xiaojun Wang, Zuyan Xu. Stabilization of Intelligent Laser Cavity Based on Deep Reinforcement Learning Algorithm[J]. Chinese Journal of Lasers, 2025, 52(3): 0301001
Category: laser devices and laser physics
Received: Apr. 9, 2024
Accepted: Jun. 3, 2024
Published Online: Jan. 14, 2025
The Author Email: Yang Jing (yangjing@mail.ipc.ac.cn)
CSTR:32183.14.CJL240755