Infrared and Laser Engineering, Volume. 51, Issue 3, 20210253(2022)
High efficient activation function design for CNN model image classification task
[1] Hassell M P, Lawton J H, Beddington J R. Sigmoid functional responses by invertebrate predators and parasitoids[J]. The Journal of Animal Ecology, 249-262(1977).
[2] [2] Kalman B L, Kwasny S C. Why tanh: Choosing a sigmoidal function[C]Proceedings 1992IJCNN International Joint Conference on Neural wks. IEEE, 1992, 4: 578581.
[3] Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks[J]. Communications of the ACM, 60, 84-90(2017).
[4] [4] Dubey A K, Jain V. Comparative study of convolution neural wk’s relu leakyrelu activation functions[M]Applications of Computing, Automation Wireless Systems in Electrical Engineering, 2019: 873880.
[5] [5] He K, Zhang X, Ren S, et al. Delving deep into rectifiers: Surpassing humanlevel perfmance on image classification[C]Proceedings of the IEEE International Conference on Computer Vision. 2015: 10261034.
[6] Clevert D A, Unterthiner T, Hochreiter S. Fast and accurate deep network learning by exponential linear units (elus)[J]. arXiv preprint arXiv, 1511.07289(2015).
[7] [7] Shi Qi. Research verification of image classification optimization algithm based on convolutional neural wk[D]. Beijing: Beijing Jiaotong University, 2017. (in Chinese)
[8] Wang Hongxia, Zhou Jiaqi, Gu Chenghao, et al. Design of activation functions in convolutional neural networks for image classification[J]. Journal of Zhejiang University (Engineering Science), 53, 1363-1373(2019).
[9] [9] Zhang X, Zou Y, Shi W. Dilated convolution neural wk with LeakyReLU f environmental sound classification[C]2017 22nd International Conference on Digital Signal Processing (DSP). IEEE, 2017: 15.
[10] [10] Xu L, Choy C, Li Y W. Deep sparse rectifier neural wks f speech denoising[C]2016 IEEE International Wkshop on Acoustic Signal Enhancement (IWAENC). IEEE, 2016: 15.
[11] Liu Jun. Analysis of algorithm design and algorithm time complexity[J]. Computer Knowledge and Technology, 2, 878-879(2008).
[12] Liu X, Zhang Y, Bao F. Kernel-blending connection approximated by a neural network for image classification[J]. Computational Visual Media, 6, 467-476(2020).
[13] [13] Carrier P L, Courville A, Mirza M, et al. Challenges in representation learning: A rept on three machine learning contests[C]International Conference on Neural Infmation Processing, 2013: 117124.
[14] Wang H, Zhou J, Gu C, et al. Design of activation function in CNN for image classification[J]. Journal of ZheJiang University (Engineering Science), 53, 1363-1373(2019).
Get Citation
Copy Citation Text
Shengjie Du, Xiaofen Jia, Yourui Huang, Yongcun Guo, Baiting Zhao. High efficient activation function design for CNN model image classification task[J]. Infrared and Laser Engineering, 2022, 51(3): 20210253
Category: Image processing
Received: Dec. 10, 2021
Accepted: --
Published Online: Apr. 8, 2022
The Author Email: