NUCLEAR TECHNIQUES, Volume. 46, Issue 9, 090505(2023)

Application of multi-head attention mechanism with embedded positional encoding in amplitude estimation of stacked pulses

Lin TANG1,2,3, Shuang ZHOU1, Yong LI1, Xianli LIAO1、*, and Yuepeng LI1,4
Author Affiliations
  • 1College of Electronic Information and Electrical Engineering, Chengdu University, Chengdu 610106, China
  • 2National Engineering Research Center for Agro-Ecological Big Data Analysis & Application, Anhui University, Hefei 230039, China
  • 3School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore
  • 4School of Nuclear Technology and Automation Engineering, Chengdu University of Technology, Chengdu 610059, China
  • show less

    Background

    The calculation error of the stacked pulse amplitude generated by traditional pulse shaping methods leads to distortion in the X-ray fluorescence spectrum; thus, it is difficult to accurately analyze the spectrum measured in a high-stacking rate background.

    Purpose

    This study aims to propose a transformer model based on deep learning for the pulse amplitude estimation of radiation measurements using high-performance silicon drift detectors.

    Methods

    Firstly, multi-head attention was applied to the transformer model, and an encoder-decoder structure with embedded positional encoding was employed to estimate the amplitude of stacked pulses. Then, a predefined mathematical model was used to simulate the pulse signal output by the detector for model training, and Gaussian noise corresponding to thermal noise and shot noise was added to the signal to simulate real nuclear pulses. Finally, experimental verifications were carried out on powdered iron ore samples and powdered rock samples, and relative error, corresponding to the accuracy of pulse amplitude estimation, was used as a model performance evaluation indicator.

    Results & Conclusions

    Experimental verification results show that the average relative error obtained for eight offline pulse sequences of powdered iron ore samples and powdered rock samples is 0.89%, which means that the model can accurately estimate the amplitude of stacked pulses.

    Tools

    Get Citation

    Copy Citation Text

    Lin TANG, Shuang ZHOU, Yong LI, Xianli LIAO, Yuepeng LI. Application of multi-head attention mechanism with embedded positional encoding in amplitude estimation of stacked pulses[J]. NUCLEAR TECHNIQUES, 2023, 46(9): 090505

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Mar. 23, 2023

    Accepted: --

    Published Online: Oct. 8, 2023

    The Author Email:

    DOI:10.11889/j.0253-3219.2023.hjs.46.090505

    Topics