Journal of Terahertz Science and Electronic Information Technology , Volume. 22, Issue 5, 549(2024)

High-precision gesture recognition based on data enhancement algorithm and CNN-LSTM

TANG Gaopeng*... LI Congsheng and WU Tongning |Show fewer author(s)
Author Affiliations
  • [in Chinese]
  • show less
    References(17)

    [1] [1] JIANG Wen, REN Yihui, LIU Ying,et al. Recognition of dynamic hand gesture based on mm-wave FMCW radar micro-Doppler signatures[C]// IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP). Toronto,Canada:Institute of Electrical and Electronics Engineers, 2021:4905-4909. doi:10. 1109/ICASSP39728.2021.9414837.

    [4] [4] LEE B G, LEE S M. Smart wearable hand device for sign language interpretation system with sensors fusion[J]. IEEE Sensors Journal, 2018, 18(3): 1224-1232. doi:10. 1109/JSEN.2017.2779466.

    [5] [5] TARANTA II E M,SIMONS T K,SUKTHANKAR R,et al. Exploring the benefits of context in 3D gesture recognition for game-based virtual environments[J]. ACM Transactions on Interactive Intelligent Systems, 2015,5( 1): 1-34. doi:10. 1145/2656345.

    [6] [6] KHAN F, LEEM S K, CHO S H. Hand-based gesture recognition for vehicular applications using IR-UWB radar[J]. Sensors, 2017, 17(4):833. doi:10.3390/s 17040833.

    [7] [7] GUPTA H P, CHUDGAR H S, MUKHERJEE S, et al. A continuous hand gestures recognition technique for human-machine interaction using accelerometer and gyroscope sensors[J]. IEEE Sensors Journal, 2016, 16( 16): 6425-6432. doi: 10. 1109/JSEN.2016.2581023.

    [8] [8] REN Zhou, MENG Jingjing, YUAN Junsong. Depth camera based hand gesture recognition and its applications in human- computer-interaction[C]// 2011 the 8th International Conference on Information, Communications & Signal Processing Singapore:IEEE, 2011: 1-5. doi:10. 1109/ICICS.2011.6173545.

    [9] [9] OHN-BAR E, TRIVEDI M M. Hand gesture recognition in real time for automotive interfaces: a multimodal vision-based approach and evaluations[J]. IEEE Transactions on Intelligent Transportation Systems, 2014, 15(6): 2368-2377. doi: 10. 1109/ TITS.2014.2337331.

    [10] [10] KIM Y, TOOMAJIAN B. Hand gesture recognition using micro-Doppler signatures with convolutional neural network[J]. IEEE Access, 2016(4):7125-7130. doi:10. 1109/ACCESS.2016.2617282.

    [12] [12] MOLCHANOV P, GUPTA S, KIM K, et al. Hand gesture recognition with 3D convolutional neural networks[C]// 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops(CVPRW). Boston, USA: Institute of Electrical and Electronics Engineers, 2015: 1-7. doi:10. 1109/CVPRW.2015.7301342.

    [13] [13] LIEN J, GILLIAN N, EMRE-KARAGOZLER M, et al. Soli: ubiquitous gesture sensing with millimeter wave radar[J]. ACM Transactions on Graphics, 2016,35(4): 1-19. doi:10. 1145/2897824.2925953.

    [14] [14] CHOI J W, RYU S J, KIM J H. Short-range radar based real-time hand gesture recognition using LSTM encoder[J]. IEEE Access, 2019(7):33610-33618. doi:10. 1109/ACCESS.2019.2903586.

    [15] [15] XIA Zhaoyang, LUO Meiyixiang,ZHOU Chenglong, et al. Multidimensional feature representation and learning for robust hand- gesture recognition on commercial millimeter-wave radar[J]. IEEE Transactions on Geoscience and Remote Sensing, 2021, 59(6):4749-4764.) doi:10. 1109/TGRS.2020.3010880.

    [17] [17] ANSARI F, TABAN M R, GAZOR S. A novel sequential algorithm for clutter and direct signal cancellation in passive bistatic radars[J]. EURASIP Journal on Advances in Signal Processing, 2016( 1): 134. doi:10. 1186/s 13634-016-0431-2.

    [18] [18] LEI Wentai, LIANG Qiong, TAN Qianying. A new ground penetrating radar signal denoising algorithm based on automatic reversed-phase correction and kurtosis value comparison[J]. Journal of Radars, 2018,7(3):294-302. doi:10. 12000/JR17113.

    [19] [19] NALLABOLU P, ZHANG Li, HONG Hong, et al. Human presence sensing and gesture recognition for smart home applications with moving and stationary clutter suppression using a 60 GHz digital beamforming FMCW radar[J]. IEEE Access, 2021(9): 72857-72866. doi:10. 1109/ACCESS.2021.3080655.

    [20] [20] LEI Wentai, JIANG Xinyue, TAN Qianying, et al. A TD-CF preprocessing method of FMCW radar for dynamic hand gesture recognition[C]// 2019 IEEE International Conference on Signal, Information and Data Processing(ICSIDP). Chongqing, China: Institute of Electrical and Electronics Engineers, 2019: 1-5. doi:10. 1109/ICSIDP47821.2019.9173196.

    [23] [23] ZHANG Guiyuan, LAN Shengchang, ZHANG Kang, et al. Temporal-range-Doppler features interpretation and recognition of hand gestures using MMW FMCW radar sensors[C]// 2020 the 14th European Conference on Antennas and Propagation (EuCAP). Copenhagen, Denmark:Institute of Electrical and Electronics Engineers, 2020: 1-4. doi: 10.23919/EuCAP48036.2020. 9135694.

    Tools

    Get Citation

    Copy Citation Text

    TANG Gaopeng, LI Congsheng, WU Tongning. High-precision gesture recognition based on data enhancement algorithm and CNN-LSTM[J]. Journal of Terahertz Science and Electronic Information Technology , 2024, 22(5): 549

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Apr. 28, 2022

    Accepted: --

    Published Online: Aug. 22, 2024

    The Author Email: Gaopeng TANG (tgp1072564908@163.com.)

    DOI:10.11805/tkyda2022097

    Topics