[1] [1] Federal Communications Commission. Notice of proposed rule making and order[R]. ET Docket No. 03-322. 2003.

[2] [2] AKYILDIZ I F, LEE W Y, VURAN M C, et al. Next generation/dynamic spectrum access/cognitive radio wireless networks: a survey[J]. Computer Networks, 2006,50(13):2127-2159.

[3] [3] MITOLA J. Software radios: survey, critical evaluation and future directions[J]. IEEE Aerospace and Electronic Systems Magazine, 1993,8(4):25-36.

[4] [4] BKASSINY M,LI Y,JAYAWEERA S K. A survey on machine-learning techniques in cognitive radios[J]. IEEE Communications Surveys & Tutorials, 2012,15(3):1136-1159.

[5] [5] NGUYENY T,MARK B L,EPHRAIM Y. Hidden Markov process based dynamic spectrum access for cognitive radio[C]// 2011 45th Annual Conference on Information Sciences and Systems. Baltimore,MD,USA:IEEE, 2011:1-6.

[6] [6] ELTOM H, KANDEEPAN S, LIANG Y C, et al. HMM based cooperative spectrum occupancy prediction using hard fusion[C]//2016 IEEE International Conference on Communications Workshops(ICC). Kuala Lumpur,Malaysia:IEEE, 2016:669-675.

[7] [7] ELTOM H,KANDEEPAN S,LIANG Y C,et al. Cooperative soft fusion for HMM-based spectrum occupancy prediction[J]. IEEE Communications Letters, 2018,22(10):2144-2147.

[8] [8] MOSAVAT-JAHROMI H, LI Y, CAI L, et al. Prediction and modeling of spectrum occupancy for dynamic spectrum access systems[J]. IEEE Transactions on Cognitive Communications and Networking, 2021,7(3):715-728.

[9] [9] WANG S,LIU H,GOMES P H,et al. Deep reinforcement learning for dynamic multichannel access in wireless networks[J]. IEEE Transactions on Cognitive Communications and Networking, 2018,4(2):257-265.

[10] [10] YAN Z, CHENG P, CHEN Z, et al. Gaussian process reinforcement learning for fast opportunistic spectrum access[C]// 2019 IEEE Global Communications Conference(GLOBECOM). Waikoloa,HI,USA:IEEE, 2019:1-6.

[11] [11] SONG H,LIU L, ASHDOWN J,et al. A deep reinforcement learning framework for spectrum management in dynamic spectrum access[J]. IEEE Internet of Things Journal, 2021,8(14):11208-11218.

[12] [12] ALBINSAID H,SINGH K,BISWAS S,et al. Multi-agent reinforcement learning based distributed dynamic spectrum access[J]. IEEE Transactions on Cognitive Communications and Networking, 2022,8(2):1174-1185.

[13] [13] XIAO L,LI Y,LIU J,et al. Power control with reinforcement learning in cooperative cognitive radio networks against jamming[J]. Journal of Supercomputing, 2015(71):3237-3257.

[14] [14] RUTAGEMWA H,GHASEMI A,LIU S. Dynamic spectrum assignment for land mobile radio with deep recurrent neural networks[C]// 2018 IEEE International Conference on Communications Workshops(ICC Workshops). Kansas City,MO,USA:IEEE, 2018:1-6.

[15] [15] KAUR A,KUMAR K. A comprehensive survey on machine learning approaches for dynamic spectrum access in cognitive radio networks[J]. Journal of Experimental & Theoretical Artificial Intelligence, 2022,34(1):1-40.

[16] [16] CHO K, VAN-MERRIENBOER B, GULCEHRE C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]// Conference on Empirical Methods in Natural Language Processing(EMNLP 2014). Doha, Qatar:ACL, 2014:1724-1734.

[17] [17] HOCHREITER S,SCHMIDHUBER J. Long Short-Term Memory[J]. Neural Computation, 1997,9(8):1735-1780.

[18] [18] HE K,ZHANG X,REN S,et al. Deep residual learning for image recognition[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas,NV,USA:IEEE, 2016:770-778.