Search

Article

x

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

Calibration of D-RGB camera networks by skeleton-based viewpoint invariance transformation

Han Yun Chung Sheng-Luen Yeh Jeng-Sheng Chen Qi-Jun

Citation:

Calibration of D-RGB camera networks by skeleton-based viewpoint invariance transformation

Han Yun, Chung Sheng-Luen, Yeh Jeng-Sheng, Chen Qi-Jun
PDF
Get Citation

(PLEASE TRANSLATE TO ENGLISH

BY GOOGLE TRANSLATE IF NEEDED.)

  • Combining depth information and color image, D-RGB cameras provide a ready detection of human and associated 3D skeleton joints data, facilitating, if not revolutionizing, conventional image centric researches in, among others, computer vision, surveillance, and human activity analysis. Applicability of a D-RBG camera, however, is restricted by its limited range of frustum of depth in the range of 0.8 to 4 meters. Although a D-RGB camera network, constructed by deployment of several D-RGB cameras at various locations, could extend the range of coverage, it requires precise localization of the camera network: relative location and orientation of neighboring cameras. By introducing a skeleton-based viewpoint invariant transformation (SVIT), which derives the relative location and orientation of a detected humans upper torso to a D-RGB camera, this paper presents a reliable automatic localization technique without the need for additional instrument or human intervention. By respectively applying SVIT to two neighboring D-RGB cameras on a commonly observed skeleton, the respective relative position and orientation of the detected humans skeleton for these two cameras can be obtained before being combined to yield the relative position and orientation of these two cameras, thus solving the localization problem. Experiments have been conducted in which two Kinects are situated with bearing differences of about 45 degrees and 90 degrees; the coverage can be extended by up to 70% with the installment of an additional Kinect. The same localization technique can be applied repeatedly to a larger number of D-RGB cameras, thus extending the applicability of D-RGB cameras to camera networks in making human behavior analysis and context-aware service in a larger surveillance area.
    • Funds: Project supported by the International ST Cooperation Projects of China (Grant No. 2010DFA12210), the Shanghai Science and Technology Talent Project, China (Grant No. 11XD1404800), and the Key Program for Basic Research of Science and Technology Commission Foundation of Shanghai, China (Grant No. 12JC1408800).
    [1]

    Xu Y N, Zhao Y, Liu L P, Zhang Y, Sun X D 2010 Acta Phys. Sin. 59 980 (in Chinese) [许元男, 赵远, 刘丽萍, 张宇, 孙秀冬2010 物理学报59 980]

    [2]

    Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese)[张伟, 成波, 张波2012 物理学报61 060701]

    [3]
    [4]

    Sung J, Ponce C, Selman B, Saxena A 2012 IEEE International Conference on Robotics and Automation Saint Paul, USA, May 14-18 2012 p842

    [5]
    [6]
    [7]

    Xia L, Chen C C, Aggarwal J K 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops Providence, United states, June 16-21, 2012 p8

    [8]

    Yun K, Honorio J, Chattopadhyay D, Berg T L, Samaras D 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops Providence, United states, June 16-21, 2012 p28

    [9]
    [10]

    Zhang Z Y 1999 Proceedings of the IEEE International Conference on Computer Vision Kerkyra, Greece, September 20-27, 1999 p666

    [11]
    [12]

    Tsai R Y 1986 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Miami Beach, United states, June 22-26, 1986 p364

    [13]
    [14]
    [15]

    Jia Q Q, Wang B X, Shi H, Luo X Z 2009 Journal of Tsinghua University 49 676 (in Chinese) [贾倩倩, 王伯雄, 史辉, 罗秀芝2009 清华大学学报49 676]

    [16]
    [17]

    Zhang Z Y 2004 IEEE Transactions on Pattern Analysis and Machine Intelligence 26 892

    [18]

    Thomas E, Andreas S 2012 7th German Conference on RoboticsMunich, Germany, May 21-22 2012 p1

    [19]
    [20]
    [21]

    Han Y, Chung S L, Yeh J S, Chen Q J 2013 IEEE International Conference on Systems, Man, and Cybernetics Manchester, UK, October 13-16, 2013 p1525

    [22]

    Mi T, An P, Liu S X, Zhang Z Y 2008 Journal of Image and Graphics 13 1921

    [23]
    [24]

    Zhang T N, Meng C N, Liu R B, Chang S J 2013 Acta Phys. Sin. 62 134204 (in Chinese)[张太宁, 孟春宁, 刘润蓓, 常胜2013 物理学报62 134204]

    [25]
    [26]
    [27]

    Grimson W E L 1985 IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-7 17

    [28]

    Wang F, Zhao X, Yang Y, Fang Z L, Yuan X C 2012 Acta Phys. Sin. 61 084212 (in Chinese)[王芳, 赵星, 杨勇, 方志良, 袁小聪2012 物理学报61 084212]

    [29]
    [30]
    [31]

    Atiya S, Hager G D 1993 IEEE Transactions on Robotics and Automation 9 785[17] Hoppen P, Knieriemen T, von Puttkamer E 1990 IEEE International Conference on Robotics and Automation Cincinnati, USA, May 13-18 1990 p948

    [32]
    [33]

    Hoppen P, Knieriemen T, von Puttkamer E 1990 IEEE International Conference on Robotics and Automation Cincinnati, USA, May 1318 1990 p948

    [34]

    Weiss A, Hirshberg D, Black M J 2011 IEEE International Conference on Computer Vision Barcelona, Spain, November 6-13, 2011 p1951

    [35]
    [36]

    Moeslund T B, Hilton A, Krger V 2006 Computer Vision and Image Understanding 104 90

    [37]
    [38]

    Poppe R 2007 Computer Vision and Image Understanding 108 4

    [39]
    [40]

    Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A 2011 IEEE Conference on Computer Vision and Pattern Recognition Colorado Springs, United states, June 20-25, 2011 p1297

    [41]
    [42]
    [43]

    PrimeSense www. primesense. com [June 5, 2013]

    [44]
    [45]

    Han J G, Shao L, Xu D, Shotton J 2013 IEEE Transactions on Cybernetics 43 1318

  • [1]

    Xu Y N, Zhao Y, Liu L P, Zhang Y, Sun X D 2010 Acta Phys. Sin. 59 980 (in Chinese) [许元男, 赵远, 刘丽萍, 张宇, 孙秀冬2010 物理学报59 980]

    [2]

    Zhang W, Cheng B, Zhang B 2012 Acta Phys. Sin. 61 060701 (in Chinese)[张伟, 成波, 张波2012 物理学报61 060701]

    [3]
    [4]

    Sung J, Ponce C, Selman B, Saxena A 2012 IEEE International Conference on Robotics and Automation Saint Paul, USA, May 14-18 2012 p842

    [5]
    [6]
    [7]

    Xia L, Chen C C, Aggarwal J K 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops Providence, United states, June 16-21, 2012 p8

    [8]

    Yun K, Honorio J, Chattopadhyay D, Berg T L, Samaras D 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops Providence, United states, June 16-21, 2012 p28

    [9]
    [10]

    Zhang Z Y 1999 Proceedings of the IEEE International Conference on Computer Vision Kerkyra, Greece, September 20-27, 1999 p666

    [11]
    [12]

    Tsai R Y 1986 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Miami Beach, United states, June 22-26, 1986 p364

    [13]
    [14]
    [15]

    Jia Q Q, Wang B X, Shi H, Luo X Z 2009 Journal of Tsinghua University 49 676 (in Chinese) [贾倩倩, 王伯雄, 史辉, 罗秀芝2009 清华大学学报49 676]

    [16]
    [17]

    Zhang Z Y 2004 IEEE Transactions on Pattern Analysis and Machine Intelligence 26 892

    [18]

    Thomas E, Andreas S 2012 7th German Conference on RoboticsMunich, Germany, May 21-22 2012 p1

    [19]
    [20]
    [21]

    Han Y, Chung S L, Yeh J S, Chen Q J 2013 IEEE International Conference on Systems, Man, and Cybernetics Manchester, UK, October 13-16, 2013 p1525

    [22]

    Mi T, An P, Liu S X, Zhang Z Y 2008 Journal of Image and Graphics 13 1921

    [23]
    [24]

    Zhang T N, Meng C N, Liu R B, Chang S J 2013 Acta Phys. Sin. 62 134204 (in Chinese)[张太宁, 孟春宁, 刘润蓓, 常胜2013 物理学报62 134204]

    [25]
    [26]
    [27]

    Grimson W E L 1985 IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-7 17

    [28]

    Wang F, Zhao X, Yang Y, Fang Z L, Yuan X C 2012 Acta Phys. Sin. 61 084212 (in Chinese)[王芳, 赵星, 杨勇, 方志良, 袁小聪2012 物理学报61 084212]

    [29]
    [30]
    [31]

    Atiya S, Hager G D 1993 IEEE Transactions on Robotics and Automation 9 785[17] Hoppen P, Knieriemen T, von Puttkamer E 1990 IEEE International Conference on Robotics and Automation Cincinnati, USA, May 13-18 1990 p948

    [32]
    [33]

    Hoppen P, Knieriemen T, von Puttkamer E 1990 IEEE International Conference on Robotics and Automation Cincinnati, USA, May 1318 1990 p948

    [34]

    Weiss A, Hirshberg D, Black M J 2011 IEEE International Conference on Computer Vision Barcelona, Spain, November 6-13, 2011 p1951

    [35]
    [36]

    Moeslund T B, Hilton A, Krger V 2006 Computer Vision and Image Understanding 104 90

    [37]
    [38]

    Poppe R 2007 Computer Vision and Image Understanding 108 4

    [39]
    [40]

    Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A 2011 IEEE Conference on Computer Vision and Pattern Recognition Colorado Springs, United states, June 20-25, 2011 p1297

    [41]
    [42]
    [43]

    PrimeSense www. primesense. com [June 5, 2013]

    [44]
    [45]

    Han J G, Shao L, Xu D, Shotton J 2013 IEEE Transactions on Cybernetics 43 1318

  • [1] Zhou Jiang-Ping, Zhou Yuan-Yuan, Zhou Xue-Jun. Improved parameter optimization method for measurement device independent protocol. Acta Physica Sinica, 2023, 72(12): 120303. doi: 10.7498/aps.72.20230179
    [2] Wu Wen-Bin, Peng Shi-Xiang, Zhang Ai-Lin, Zhou Hai-Jing, Ma Teng-Hao, Jiang Yao-Xiang, Li Kai, Cui Bu-Jian, Guo Zhi-Yu, Chen Jia-Er. Global model of miniature electron cyclotron resonance ion source. Acta Physica Sinica, 2022, 71(14): 145204. doi: 10.7498/aps.71.20212250
    [3] Wang Feng-Yang, Hu Ren-Zhi, Xie Pin-Hua, Wang Yi-Hui, Chen Hao, Zhang Guo-Xian, Liu Wen-Qing. Calibration source for OH radical based on synchronous photolysis. Acta Physica Sinica, 2020, 69(9): 090701. doi: 10.7498/aps.69.20200153
    [4] Tan Suo-Yi, Qi Ming-Ze, Wu Jun, Lu Xin. Link predictability of complex network from spectrum perspective. Acta Physica Sinica, 2020, 69(8): 088901. doi: 10.7498/aps.69.20191817
    [5] Yue Xiao-Le, Xiang Yi-Lin, Zhang Ying. Global analysis of crises in shape memory thin plate system. Acta Physica Sinica, 2019, 68(18): 180501. doi: 10.7498/aps.68.20190155
    [6] Gu Wen-Yuan, Zhao Shang-Hong, Dong Chen, Wang Xing-Yu, Yang Ding. Reference-frame-independent measurement-device-independent quantum key distribution under reference frame fluctuation. Acta Physica Sinica, 2019, 68(24): 240301. doi: 10.7498/aps.68.20191364
    [7] Gao Yan-Li, Chen Shi-Ming. A global homogenizing coupled pattern of interdependent networks. Acta Physica Sinica, 2016, 65(14): 148901. doi: 10.7498/aps.65.148901
    [8] ShangGuan Dan-Hua, Deng Li, Li Gang, Zhang Bao-Yin, Ma Yan, Fu Yuan-Guang, Li Rui, Hu Xiao-Li. Algorithm researches for efficient global tallying in criticality calculation of Monte Carlo method. Acta Physica Sinica, 2016, 65(6): 062801. doi: 10.7498/aps.65.062801
    [9] Lu Lei, Qu Shao-Bo, Shi Hong-Yu, Zhang An-Xue, Xia Song, Xu Zhuo, Zhang Jie-Qiu. A broadband transmission absorption polarization-independent metamaterial absorber. Acta Physica Sinica, 2014, 63(2): 028103. doi: 10.7498/aps.63.028103
    [10] Zhao Gu-Hao, Zhao Shang-Hong, Yao Zhou-Shi, Hao Chen-Lu, Meng Wen, Wang Xiang, Zhu Zhi-Hang, Liu Feng. Experimental study on polarization-independent reflector structure based on magneto-optical crystal and two mirrors. Acta Physica Sinica, 2013, 62(13): 134201. doi: 10.7498/aps.62.134201
    [11] Meng Chun-Ning, Bai Jin-Jun, Zhang Tai-Ning, Liu Run-Bei, Chang Sheng-Jiang. Eye movement analysis for activity recognition based on one web camera. Acta Physica Sinica, 2013, 62(17): 174203. doi: 10.7498/aps.62.174203
    [12] Lü Ling, Li Gang, Zhang Meng, Li Yu-Shan, Wei Lin-Ling, Yu Miao. Parameter identification and synchronization of spatiotemporal chaos in globally coupled network. Acta Physica Sinica, 2011, 60(9): 090505. doi: 10.7498/aps.60.090505
    [13] Sun Chang-Chun, Fang Bo, Huang Wen-Hu. Global control of chaotic systems based on linear state feedback. Acta Physica Sinica, 2011, 60(11): 110503. doi: 10.7498/aps.60.110503
    [14] Luo Shi-Yu, Shao Ming-Zhu, Luo Xiao-Hua. The global bifurcation and chaotic behaviours for the crystalline undulator radiation. Acta Physica Sinica, 2010, 59(4): 2685-2690. doi: 10.7498/aps.59.2685
    [15] Zhong Wen-Zhen, He Ke-Jing, Zhou Zhao-Yao, Xia Wei, Li Yuan-Yuan. Calibration of damping coefficient in discrete element method simulation. Acta Physica Sinica, 2009, 58(8): 5155-5161. doi: 10.7498/aps.58.5155
    [16] Wang Zhan-Shan, Zhang Hua-Guang, Wang Zhi-Liang. Global synchronization of a class of chaotic neural networks. Acta Physica Sinica, 2006, 55(6): 2687-2693. doi: 10.7498/aps.55.2687
    [17] Luo Shi-Yu, Shao Ming-Zhu, Wei Luo-Xia, Liu Zeng-Rong. Dynamics of dislocation and global bifurcation for a system. Acta Physica Sinica, 2004, 53(6): 1940-1945. doi: 10.7498/aps.53.1940
    [18] GOU KE-XIN, LIU PING. CRITERION OF PRIMITIVE SOLUTIONS IN THE AUTOMATIC INDEXING OF ELECTRON DIFFRACTION PATTERNS. Acta Physica Sinica, 1980, 29(8): 1080-1083. doi: 10.7498/aps.29.1080
    [19] GUO KE-XIN. ON THE EXTINCTION PROBLEM IN THE AUTOMATIC INDEXING OF ELECTRON DIFFRACTION PATTERNS. Acta Physica Sinica, 1978, 27(4): 473-475. doi: 10.7498/aps.27.473
    [20] GUO KE-XIN. REDUCED CELLS AND THE INDEXING OF ELECTRON DIFFRACTION PATTERNS. Acta Physica Sinica, 1978, 27(2): 160-168. doi: 10.7498/aps.27.160
Metrics
  • Abstract views:  5023
  • PDF Downloads:  1401
  • Cited By: 0
Publishing process
  • Received Date:  23 October 2013
  • Accepted Date:  27 November 2013
  • Published Online:  05 April 2014

/

返回文章
返回