Application of multi-head attention mechanism with embedded positional encoding in amplitude estimation of stacked pulses

Lin TANG; Shuang ZHOU; Yong LI; Xianli LIAO; Yuepeng LI

doi:10.11889/j.0253-3219.2023.hjs.46.090505

NUCLEAR TECHNIQUES, Volume. 46, Issue 9, 090505(2023)

Application of multi-head attention mechanism with embedded positional encoding in amplitude estimation of stacked pulses

Lin TANG^1,2,3, Shuang ZHOU¹, Yong LI¹, Xianli LIAO^1、*, and Yuepeng LI^1,4

Author Affiliations

¹College of Electronic Information and Electrical Engineering, Chengdu University, Chengdu 610106, China

²National Engineering Research Center for Agro-Ecological Big Data Analysis & Application, Anhui University, Hefei 230039, China

³School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore

⁴School of Nuclear Technology and Automation Engineering, Chengdu University of Technology, Chengdu 610059, China

show less

Abstract Get PDF(in Chinese)

References(20)

[1] Ishikawa D, Baron A Q R. Practical measurement of the energy resolution for meV-resolved inelastic X-ray scattering[J]. Journal of Synchrotron Radiation, 28, 804-811(2021).

[2] Wu H X, Di R J, Liu Y J et al. Application on straight-line shaping method for energy spectrum measurement in TXRF spectrometer based on SDD detector[J]. Spectroscopy and Spectral Analysis, 41, 2148-2152(2021).

[3] Regadío A, Sánchez-Prieto S, Tabero J et al. Synthesis of optimal digital shapers with arbitrary noise using a genetic algorithm[J]. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 795, 115-121(2015).

[4] Zhong X D, Chen L, Wang B C et al. A spectrometer with baseline correction and fast pulse pile-up rejection for prompt gamma neutron activation analysis technology[J]. The Review of Scientific Instruments, 89, 123504(2018).

[5] Kafaee M, Moussavi-Zarandi A. Baseline restoration and pile-up correction based on bipolar cusp-like shaping for high-resolution radiation spectroscopy[J]. Journal of the Korean Physical Society, 68, 960-964(2016).

[6] Usman S, Patil A. Radiation detector deadtime and pile up: a review of the status of science[J]. Nuclear Engineering and Technology, 50, 1006-1016(2018).

[7] Tang L, Yu J, Zhou J B et al. A new method for removing false peaks to obtain a precise X-ray spectrum[J]. Applied Radiation and Isotopes, 135, 171-176(2018).

[8] Tang L, Zhou J B, Fang F et al. Counting-loss correction for X-ray spectra using the pulse-repairing method[J]. Journal of Synchrotron Radiation, 25, 1760-1767(2018).

[9] Regadio A, Esteban L, Sanchez-Prieto S. Unfolding using deep learning and its application on pulse height analysis and pile-up management[J]. Nuclear Instruments & Methods in Physics Research Section A: Accelerators Spectrometers Detectors and Associated Equipment, 1005, 165403(2021).

[10] Ai P, Deng Z, Wang Y et al. Universal uncertainty estimation for nuclear detector signals with neural networks and ensemble learning[J]. Journal of Instrumentation, 17, P02032(2022).

[11] Ma X K, Huang H Q, Huang B R et al. X-ray spectra correction based on deep learning CNN-LSTM model[J]. Measurement, 199, 111510(2022).

[12] Dong Y, Zhou S Z, Xing L et al. Deep learning methods may not outperform other machine learning methods on analyzing genomic studies[J]. Frontiers in Genetics, 13, 992070(2022).

[13] Alwan N A S, Hussain Z M. Deep learning for robust adaptive inverse control of nonlinear dynamic systems: improved settling time with an autoencoder[J]. Sensors, 22, 5935(2022).

[14] Cheng N T, Fu J, Chen D J et al. An antibody-free liver cancer screening approach based on nanoplasmonics biosensing chips via spectrum-based deep learning[J]. NanoImpact, 21, 100296(2021).

[15] Touch M, Clark D P, Barber W et al. A neural network-based method for spectral distortion correction in photon counting X-ray CT[J]. Physics in Medicine and Biology, 61, 6132-6153(2016).

[16] Feng C Q, Kang K J, Xing Y X. Fully connected neural network for virtual monochromatic imaging in spectral computed tomography[J]. Journal of Medical Imaging, 6, 011006(2018).

[17] Kumar P, Kumar R, Gupta G P et al. A blockchain-orchestrated deep learning approach for secure data transmission in IoT-enabled healthcare system[J]. Journal of Parallel and Distributed Computing, 172, 69-83(2023).

[18] Vaswani A, Shazeer N, Parmar N et al. Attention is all You need[EB/OL](2017). https://arxiv.org/abs/1706.03762

[19] Gehring J, Auli M, Grangier D et al. Convolutional sequence to sequence learning[EB/OL](2017). https://arxiv.org/abs/1705.03122

[20] TANG Lin, ZHAO Weidong, YU Songke et al. Optimization design of X-ray spectrum data processing platform[J]. Spectrosc Spectr Anal, 41, 763(2021).

Tools

Get Citation

Copy Citation Text

Lin TANG, Shuang ZHOU, Yong LI, Xianli LIAO, Yuepeng LI. Application of multi-head attention mechanism with embedded positional encoding in amplitude estimation of stacked pulses[J]. NUCLEAR TECHNIQUES, 2023, 46(9): 090505

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Research Articles

Received: Mar. 23, 2023

Accepted: --

Published Online: Oct. 8, 2023

The Author Email:

DOI:10.11889/j.0253-3219.2023.hjs.46.090505

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology