[1] Chapman H N. X-ray free-electron lasers for the structure and dynamics of macromolecules[J]. Annual Review of Biochemistry, 88, 35-58(2019).

[2] Coffee R N, Cryan J P, Duris J et al. Development of ultrafast capabilities for X-ray free-electron lasers at the linac coherent light source[J]. Philosophical Transactions A, 377, 20180386(2019).

[3] Marangos J P. The measurement of ultrafast electronic and structural dynamics with X-rays[J]. Philosophical Transactions A, 377, 20170481(2019).

[4] Liu Z Y, Mu C X, Sun C Y. An overview on algorithms and applications of deep reinforcement learning[J]. Chinese Journal of Intelligent Science and Technology, 2, 314-326(2020).

[5] Sliver D, Lever G, Heess N et al. Deterministic policy gradient algorithms[C], 387-395(2014).

[6] Lillicrap T P, Hunt J J, Pritzel A et al. Continuous control with deep reinforcement learning[EB/OL]. https://arxiv.org/abs/1509.02971

[7] Yang S M, Shan Z, Ding Y et al. Survey of research on deep reinforcement learning[J]. Computer Engineering, 47, 19-29(2021).

[8] Fujimoto S, van Hoof H, Meger D. Addressing function approximation error in actor-critic methods[EB/OL]. https://arxiv.org/abs/1802.09477

[9] Haarnoja T, Zhou A, Abbeel P et al. Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor[EB/OL]. https://arxiv.org/abs/1801.01290

[10] Haarnoja T, Zhou A, Hartikainen K et al. Soft actor-critic algorithms and applications[EB/OL]. https://arxiv.org/abs/1812.05905

[11] Evans R, Gao J. DeepMind AI reduces energy used for cooling google data centers by40%[EB/OL]. https://blog.google/outreach-initiatives/environment/deepmind-ai-reduces-energy-used-for/

[12] Wu J, Huang X, Raubenheimer T et al. Recent on-line taper optimization on LCLS[EB/OL]. https://accelconf.web.cern.ch/fel2017/papers/tub04.pdf

[13] Edelen A L, Milton S V, Biedron S G et al. Using a neural network control policy for rapid switching between beam parameters in an fel[R](2017).

[14] Bruchon N, Fenu G. Free-electron laser optimization with reinforcement learning[C], 1122-1126(2020).

[15] Ramirez L V, Mertens T, Mueller R et al. Adding machine learning to the analysis and optimization toolsets at the light source BESSY II[C], 5-11(2019).

[16] O’Shea F, Bruchon N, Gaio G. Policy gradient methods for free-electron laser and terahertz source optimization and stabilization at the FERMI free-electron laser at Elettra[J]. Physical Review Accelerators and Beams, 23, 122802(2020).

[17] Kain V, Hirlander S, Goddard B et al. Sample-efficient reinforcement learning for CERN accelerator control[J]. Physical Review Accelerators and Beams, 23, 124801(2020).

[18] Hirlaender S, Bruchon N. Model-free and Bayesian ensembling model-based deep reinforcement learning for particle accelerator control demonstrated on the FERMI FEL[EB/OL]. https://arxiv.org/abs/2012.09737

[19] Feng C, Deng H X. Review of fully coherent free-electron lasers[J]. Nuclear Science and Techniques, 29, 160(2018).

[20] Zhou K S. Physical study of ultra-high brightness X-ray free electron laser[D](2018).

[21] Reiche S. GENESIS 1.3: a fully 3D time-dependent FEL simulation code[J]. Nuclear Instruments and Methods in Physics Research Section A, 429, 243-248(1999).