Welcome to Journal of Beijing Institute of Technology
Volume 27Issue 4
.
Turn off MathJax
Article Contents
Gensheng Hu, Min Li, Dong Liang, Mingzhu Wan, Wenxia Bao. Recognition of Group Activities Using Complex Wavelet Domain Based Cayley-Klein Metric Learning[J]. JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY, 2018, 27(4): 592-603. doi: 10.15918/j.jbit1004-0579.17120
Citation: Gensheng Hu, Min Li, Dong Liang, Mingzhu Wan, Wenxia Bao. Recognition of Group Activities Using Complex Wavelet Domain Based Cayley-Klein Metric Learning[J].JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY, 2018, 27(4): 592-603.doi:10.15918/j.jbit1004-0579.17120

Recognition of Group Activities Using Complex Wavelet Domain Based Cayley-Klein Metric Learning

doi:10.15918/j.jbit1004-0579.17120
  • Received Date:2017-11-02
  • A group activity recognition algorithm is proposed to improve the recognition accuracy in video surveillance by using complex wavelet domain based Cayley-Klein metric learning. Non-sampled dual-tree complex wavelet packet transform (NS-DTCWPT) is used to decompose the human images in videos into multi-scale and multi-resolution. An improved local binary pattern (ILBP) and an inner-distance shape context (IDSC) combined with bag-of-words model is adopted to extract the decomposed high and low frequency coefficient features. The extracted coefficient features of the training samples are used to optimize Cayley-Klein metric matrix by solving a nonlinear optimization problem. The group activities in videos are recognized by using the method of feature extraction and Cayley-Klein metric learning. Experimental results on behave video set, group activity video set, and self-built video set show that the proposed algorithm has higher recognition accuracy than the existing algorithms.
  • loading
  • [1]
    Amer M R, Todorovic S. A chains model for localizing participants of group activities in videos[C]//2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain, 2011.
    [2]
    Sethi R J, Roy-Chowdhury A K. Individuals, groups, and crowds:Modelling complex, multi-object behaviour in phase space[C]//2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 2011.
    [3]
    Ibrahim M S, Muralidharan S, Deng Z, et al. A hierarchical deep temporal model for group activity recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 2016:1971-1980.
    [4]
    Yin Y, Yang G, Xu J, et al. Small group human activity recognition[C]//19th IEEE International Conference on Image Processing, Orlando, USA, 2012.
    [5]
    Azorin-Lopez J, Saval-Calvo M, Fuster-Guillo A, et al. Group activity description and recognition based on trajectory analysis and neural networks[C]//2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, Canada, 2016.
    [6]
    Kim Y J, Cho N G, Lee S W. Group activity recognition with group interaction zone[C]//22nd International Conference on Pattern Recognition (ICPR), Stockholm, Sweden, 2014:3517-3521.
    [7]
    Antic B, Ommer B. Learning latent constituents for recognition of group activities in video[C]//13th Europeon Conference on Computer Vision (ECCV), Zurich, Switzerland, 2014.
    [8]
    Deng Z, Zhai M, Chen L, et al. Deep structured models for group activity recognition[C]//British Machine Vision Conference, Swansea, UK, 2015.
    [9]
    Deng Z, Vahdat A, Hu H, et al. Structure inference machines:Recurrent neural networks for analyzing relations in group activity recognition [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 2016.
    [10]
    Choi W, Shahid K, Savarese S. Learning context for collective activity recognition[C]//2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, USA, 2011.
    [11]
    Nabi M, Del Bue A, Murino V. Temporal poselets for collective activity detection and recognition[C]//2013 IEEE International Conference on Computer Vision Workshops, Sydney, Australia, 2013.
    [12]
    Stephens K, Bors A G. Group activity recognition on outdoor scenes[C]//13th IEEE International Conference on Advanced Video and Signal Based Surveillance, Colorado Springs, USA, 2016.
    [13]
    Zhang C, Yang X, Lin W, et al. Recognizing human group behaviors with multi-group causalities[C]//2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology (WI-IAT), Macau, 2012.
    [14]
    Kingsbury N. Image processing with complex wavelets[J]. Philosophical Transactions:Mathematical, Physical and Engineering Sciences, 1999, 357(1760):2543-2560.
    [15]
    Kingsbury N G. The dual-tree complex wavelet transform:a new technique for shift invariance and directional filters[C]//Proceeding of the 8th IEEE DSP Workshop, Bryce Canyon, USA,1998:86-89.
    [16]
    Selesnick I W, Baraniuk R G, Kingsbury N C. The dual-tree complex wavelet transform[J]. IEEE Signal Processing Magazine, 2005, 22(6):123-151.
    [17]
    Bayram I, Selesnick I W. On the dual-tree complex wavelet packet and m-band transforms[J]. IEEE Transactions on Signal Processing, 2008, 56(6):2298-2310.
    [18]
    Bi Y H, Fan B, Wu F C. Beyond Mahalanobis metric:Cayley-Klein metric learning[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, USA, 2015:2339-2347.
    [19]
    Chang C, Lin C. Training v-support vector classifiers:Theory and algorithms[J].Neural computation, 2001, 13(9):2119-2147.
    [20]
    Song H, Xiao B, Hu Q, et al. Integrating local binary patterns into normalized moment of inertia for updating tracking templates[J]. Chinese Journal of Electronics, 2016, 25(4):706-710.
    [21]
    Lu F, Huang J. An improved local binary pattern operator for texture classification[C]//2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, 2016.
    [22]
    Flusser J, Suk T, Boldyš J, et al. Projection operators and moment invariants to image blurring[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(4):786-802.
    [23]
    Belongie S, Malik J, Puzicha J. Shape matching and object recognition using shape contexts[J]. IEEE Transation on Pattern Analysis and Machine Intelligence, 2002, 24(4):509-522.
    [24]
    Ling H, Jacobs D W. Shape classification using the inner-distance[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(2):286-299.
  • 加载中

Catalog

    通讯作者:陈斌, bchen63@163.com
    • 1.

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (326) PDF downloads(1414) Cited by()
    Proportional views
    Related

    /

      Return
      Return
        Baidu
        map