Multi-Feature Fusion Real-Time Action Recognition Based on 2D to 3D Skeleton

Method	Direct	Disc	Eat	Greet	Phone	Photo	Pose	Purch.	Sit	SitD	Smoke	Wait	Avgrage
Ref.[12]	52.8	54.2	54.3	61.8	53.1	53.6	71.7	86.7	61.5	53.4	67.2	54.8	60.4
Ref.[11]	49.2	51.6	47.6	50.5	51.8	48.5	51.7	61.5	70.9	53.7	60.3	48.9	53.9
Ref.[9]	37.7	44.4	40.3	42.1	48.2	54.9	44.4	42.1	54.6	58.0	45.1	46.4	47.3
Ref.[16]	43.2	38.1	40.8	44.4	51.8	43.7	38.4	50.8	52.0	42.1	42.2	44.0	44.3
Ours	44.6	39.5	39.7	41.2	51.1	42.9	40.8	42.9	50.6	40.8	44.6	42.9	43.4

Table 2. Accuracy of the network after enhancing the data set
View table
Table 2. Accuracy of the network after enhancing the data set
Expansion ratio Without treatment 20% 40% 60% 80% 100%
Accuracy /% 82.2 85.1 85.9 86.5 87.9 88.2

Table 3. Accuracy of different methods on the NTU-RGB+D 60 verification data set unit: %
View table
Table 3. Accuracy of different methods on the NTU-RGB+D 60 verification data set unit: %
Method Year CS CV
RA^[28] 2018 85.9 93.5
AS^[29] 2019 86.8 94.2
2s-AGCN^[30] 2019 88.5 95.1
Two-stream TL-GCN^[31] 2020 89.2 95.4
2s-SGCN^[32] 2021 90.1 96.2
Ours 2021 88.2 95.6

Table 4. Effect of motion estimation and multi feature fusion on recognition accuracy on NTU RGB + D 60 data set unit: %
View table
Table 4. Effect of motion estimation and multi feature fusion on recognition accuracy on NTU RGB + D 60 data set unit: %
CS After preprocessing of motion estimation network Using NTU RGB + D 60
With 2D feature fusion 88.2 86.2
Without 2D feature fusion 82.5 81.1

Tools

Get Citation

Copy Citation Text

Guoyin Ren, Xiaoqi Lü, Yuhao Li. Multi-Feature Fusion Real-Time Action Recognition Based on 2D to 3D Skeleton[J]. Laser & Optoelectronics Progress, 2021, 58(24): 2410010

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Image Processing

Received: Jan. 18, 2021

Accepted: Mar. 9, 2021

Published Online: Nov. 29, 2021

The Author Email: Xiaoqi Lü (1712152231@qq.com)

DOI:10.3788/LOP202158.2410010

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology

Table 1. Action estimation errors of different methods on the Human3.6M data set unit: mm

Table 1. Action estimation errors of different methods on the Human3.6M data set unit: mm

Table 2. Accuracy of the network after enhancing the data set

Table 2. Accuracy of the network after enhancing the data set

Table 3. Accuracy of different methods on the NTU-RGB+D 60 verification data set unit: %

Table 3. Accuracy of different methods on the NTU-RGB+D 60 verification data set unit: %

Table 4. Effect of motion estimation and multi feature fusion on recognition accuracy on NTU RGB + D 60 data set unit: %

Table 4. Effect of motion estimation and multi feature fusion on recognition accuracy on NTU RGB + D 60 data set unit: %