Optoelectronics Letters, Volume. 21, Issue 8, 507(2025)

Dual-branch spatial-temporal decoupled fusion transformer for safety action recognition in smart grid substation

Yu HAO, Hao ZHENG, Tongwen WANG, Yu WANG, Wei SUN, and Shujuan ZHANG

Smart grid substation operations often take place in hazardous environments and pose significant threats to the safety of power personnel. Relying solely on manual supervision can lead to inadequate oversight. In response to the demand for technology to identify improper operations in substation work scenarios, this paper proposes a substation safety action recognition technology to avoid the misoperation and enhance the safety management. In general, this paper utilizes a dual-branch transformer network to extract spatial and temporal information from the video dataset of operational behaviors in complex substation environments. Firstly, in order to capture the spatial-temporal correlation of people's behaviors in smart grid substation, we devise a sparse attention module and a segmented linear attention module that are embedded into spatial branch transformer and temporal branch transformer respectively. To avoid the redundancy of spatial and temporal information, we fuse the temporal and spatial features using a tensor decomposition fusion module by a decoupled manner. Experimental results indicate that our proposed method accurately detects improper operational behaviors in substation work scenarios, outperforming other existing methods in terms of detection and recognition accuracy.

Tools

Get Citation

Copy Citation Text

HAO Yu, ZHENG Hao, WANG Tongwen, WANG Yu, SUN Wei, ZHANG Shujuan. Dual-branch spatial-temporal decoupled fusion transformer for safety action recognition in smart grid substation[J]. Optoelectronics Letters, 2025, 21(8): 507

Download Citation

EndNote(RIS)BibTexPlain Text
Save article for my favorites
Paper Information

Received: Jan. 2, 2024

Accepted: Jul. 24, 2025

Published Online: Jul. 24, 2025

The Author Email:

DOI:10.1007/s11801-025-4002-3

Topics