Infrared and Laser Engineering, Volume. 52, Issue 10, 20230051(2023)

Speech enhancement method of laser microphone based on ResUnet and TFGAN network

Xinxue Dai1,2, Songtao Fan1, and Yan Zhou1,2
Author Affiliations
  • 1Optoelectronics System Laboratory, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    Figures & Tables(11)
    Schematic diagram of network training and prediction
    ResUnet network structure
    Network structure of generator
    Discriminators in the time and frequency domains
    Network structure of time domain and frequency domain discriminator
    Schematic diagram of experimental apparatus
    The four objects used in the experiment (A4 sheet, A4 box, corrugated box, PET plastic bottle)
    The frequency response of the target (yellow: A4 sheet; purple: A4 box; green: Corrugated box; orange: PET plastic bottle)
    Spectrogram. (a) Clear original voice saved in SD card; (b) Laser speech collected by laser microphone; (c) Nonlinear function harmonic reconstruction method; (d) DNN+nonlinear harmonic reconstruction method; (e) Method of this article; 1-4: A4 sheets, A4 box, corrugated box, PET plastic bottles
    Calculation diagram of PESQ
    Objective evaluation trsults of speech quality. (a) PESQ method; (b) SNRseg method. Degraded: laser speech collected by laser microphone; harm_rec: nonlinear function harmonic reconstru-ction method; DNN+harm_rec: DNN+harmonic reconstruction method; ours: the method proposed in this paper
    Tools

    Get Citation

    Copy Citation Text

    Xinxue Dai, Songtao Fan, Yan Zhou. Speech enhancement method of laser microphone based on ResUnet and TFGAN network[J]. Infrared and Laser Engineering, 2023, 52(10): 20230051

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Lasers & Laser optics

    Received: Feb. 4, 2023

    Accepted: --

    Published Online: Nov. 21, 2023

    The Author Email:

    DOI:10.3788/IRLA20230051

    Topics