행동 인식을 위한 시공간 앙상블 기법
Spatial-temporal Ensemble Method for Action Recognition
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
As deep learning technology has been developed and applied to various fields, it is gradually changing from an existing single image based application to a video based application having a time base in order to recognize human behavior. However, unlike 2D CNN in a single image, 3D CNN in a video has a very high amount of computation and parameter increase due to the addition of a time axis, so improving accuracy in action recognition technology is more difficult than in a single image. To solve this problem, we investigate and analyze various techniques to improve performance in 3D CNN-based image recognition without additional training time and parameter increase. We propose a time base ensemble using the time axis that exists only in the videos and an ensemble in the input frame. We have achieved an accuracy improvement of up to 7.1% compared to the existing performance with a combination of techniques. It also revealed the trade-off relationship between computational and accuracy.
Abstract
As deep learning technology has been developed and applied to various fields, it is gradually changing from an existing single image based application to a video based application having a time base in order to recognize human behavior. However, unlike 2D CNN in a single image, 3D CNN in a video has a very high amount of computation and parameter increase due to the addition of a time axis, so improving accuracy in action recognition technology is more difficult than in a single image. To solve this problem, we investigate and analyze various techniques to improve performance in 3D CNN-based image recognition without additional training time and parameter increase. We propose a time base ensemble using the time axis that exists only in the videos and an ensemble in the input frame. We have achieved an accuracy improvement of up to 7.1% compared to the existing performance with a combination of techniques. It also revealed the trade-off relationship between computational and accuracy.
참고문헌 (17)
- O. Russakovsky, "Imagenet large scale visualrecognition challenge", International Journal of Computer Vision, 115, pp.211~252 (2015)[DOI]
- K. He, "Deep residual learning for imagerecognition", 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.770~778 (2016)
- C. Dong, "Image superresolution using deepconvolutional networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(2), pp.295~307 (2015)[DOI]
- S. Ren, "Faster r-cnn : Towards real-time object detection with region proposal networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), pp.1137~1149 (2017)[DOI]
- L. -C. Chen, "Encoder-decoder with atrous separableconvolution for semantic image segmentation", European Conference on Computer Vision, pp.833~851 (2018)
- J. Carreira, "Quo vadis, action recognition?", 2017IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)
- H. Kuehne, "HMDB : a large video database forhuman motion recognition", 2011 International Conference on Computer Vision (2011)
- K. Hara, "Can spatiotemporal 3d cnns retrace the history of 2d cnns and imagenet?", 2018 IEEE, 2018, ~
- A. Karpathy, "Large-scale video classification with convolutionalneural networks", 2014 IEEE Conference on Computer Vision and Pattern Recognition (2014)
- J. Yue-Hei Ng, "Beyond short snippets : Deep networks for video classification", 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
- J. Donahue, "Long-term recurrentconvolutional networks for visual recognition and description", 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
- S. Ji, "3d convolutional neural networks for human action recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(1), pp.221~231 (2013)[DOI]
- G. W. Taylor, "Convolutional learning of spatio-temporal features", European Conference on Computer Vision, pp.140~153 (2010)
- D. Tran, "Learning spatiotemporal features with 3d convolutional networks", 2015 IEEE International Conference on Computer Vision (ICCV) (2015)
- G. Varol, "Long-term temporal convolutions for action recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence (2017)[DOI]
- A. Wedel, "Statistical and Geometrical Approaches to Visual Motion Analysis", pp.23~45 (2009)
- N. Crasto, "MARS : Motion-augmented RGB stream for action recognition", 2019 IEEE, 2019, ~