Moving object detection based on optical flow field analysis in dynamic scenes

Cui Zhi-Gao; Wang Hua; Li Ai-Hua; Wang Tao; Li Hui

doi:10.7498/aps.66.084203

Abstract

To overcome the limitation of existing algorithms for detecting moving objects from the dynamic scenes, a foreground detection algorithm based on optical flow field analysis is proposed. Firstly, the object boundary information is determined by detecting the differences in optical flow gradient magnitude and optical flow vector direction between foreground and background. Then, the pixels inside the objects are obtained based on the point-in-polygon problem from computational geometry. Finally, the superpixels per frame are acquired by over-segmenting method. And taking the superpixels as nodes, the Markov Random field model is built, in which the appearance information fitted by Gaussian Mixture Model is combined with spatiotemporal constraints of each superpixel. The final foreground detection result is obtained by finding the minimum value of the energy function. The proposed algorithm does not need any priori assumptions, and can effectively realize the moving object detection in dynamic and stationary background. The experimental results show that the proposed algorithm is superior to the existing state-of-the-art algorithms in the detection accuracy, robustness and time consuming.

Keywords:

Authors and contacts

1.
The Rocket Force of Engineering University, Xi'an 710025, China;
2.
Department of Automation, Tsinghua University, Beijing 100084, China

Corresponding author: Cui Zhi-Gao, cuizg10@tsinghua.edu.cn

Funds: Project supported by the National Natural Science Foundation of China (Grant No. 61501470).

References

[1]	Radke R, Andra S, Kofahi A, Roysam B 2005 IEEE Trans. Image Process. 14 294
[2]	Ren Y, Chua C, Ho Y 2003 Mach. Vision Appl. 13 332
[3]	Sheikh Y, Javed O, Kanade T 2009 Conference. on Computer Vision and Pattern Recognition(CVPR) Miami, USA, June 20-25, 2009 p1219
[4]	Chen L, Zhu S, Li X 2015 International Symposium on Computers Informatics Beijing, China, January 17-18, 2015 p742
[5]	Bi G L, Xu Z J, Chen T, Wang J L, Zhang Y S 2015 Acta Phys. Sin. 64 150701 (in Chinese) [毕国玲, 续志军, 陈涛, 王建立, 张延坤 2015 物理学报 64 150701]
[6]	Sun S W, Wang Y F, Huang F, Liao H Y 2013 J. Visual. Commun. Image Represent 24 232
[7]	Li A H, Cui Z G 2016 Moving Object Detection in Videos (Beijing: Science Press) p15 (in Chinese) [李艾华, 崔智高 2016 视频序列运动目标检测技术 (北京: 科学出版社) 第15页]
[8]	Lee Y, Kim J, Grauman K 2011 International Conference on Computer Vision(ICCV) Barcelona, Spain, November 6-13, 2011 p1995
[9]	Li W T, Chang H S, Lien K C, Chang H T, Wang Y C 2011 IEEE Trans. Image Proc. 22 2600
[10]	Zhang D, Javed O, Shah M 2013 Conference on Computer Vision and Pattern Recognition(CVPR) Oregon, Portland, June 25-27, 2013 p682
[11]	Elqursh A, Elgammal A 2012 European Conference on Computer Vision (ECCV) Florence, Italy, October 7-13, 2012 p228
[12]	Gao W, Tang Y, Zhu M 2014 Acta Phys Sin. 63 094204 (in Chinese) [高文, 汤洋, 朱明 2014 物理学报 63 094204]
[13]	Cui Z G, Li A H, Feng G Y 2015 Journal of Computer-Aided Design Computer Graphics 27 621 (in Chinese) [崔智高, 李艾华, 冯国彦 2015 计算机辅助设计与图形学学报 27 621]
[14]	Wang J, Adelson E 1994 IEEE Trans. Image Process. 3 625
[15]	Cremers D, Soatto S 2004 Int. J. Comput Vison 62 249
[16]	Yoon S, Park S, Kang S 2005 Pattern Recognit. Lett. 26 2221
[17]	Adhyapak S, Kehtarnavaz N, Nadin M 2007 J. Electron. Imaging 16 13012
[18]	Di S, Mattoccia S, Tombari F 2005 International Workshop on Computer Architecture for Machine Perception Palermo, Italy, July 4-6, 2005 p193
[19]	Bouguet J 2001 Intel Corporation 5 10
[20]	Brox T, Malik J 2010 European Conference on Computer Vision (ECCV) Crete, Greece, September 5-11, 2010 p282
[21]	Achanta R, Shaji A, Smith K 2012 IEEE Trans. Pattern Anal. Mach. Intell. 34 2274
[22]	Achanta R, Shaji A 2010 EPFL Technical Report 1 149
[23]	Vazquez A, Avidan S, Pfister H 2010 European Conference on Computer Vision (ECCV) Crete, Greece, September 5-11, 2010 p268
[24]	Fulkerson B, Vedaldi A, Soatto S 2009 International Conference on Computer Vision (ICCV) Kyoto, Japan, September 27-October 4, 2009 p670
[25]	Boykov Y, Veksler O, Zabih R 2001 IEEE Trans. Pattern Anal. Mach. Intell. 23 1222
[26]	Boykov Y, Funka L 2006 Int. J. Comput. Vison. 70 109
[27]	Tron R, Vidal R 2007 Conference on Computer Vision and Pattern Recognition (CVPR) Minneapolis, USA, June 18-23 2007 p1
[28]	Sand P, Teller S 2008 Int. J. Comput. Vison. 80 72
[29]	Goyette N, Jodoin P, Porikil F 2012 Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) Providence, Rhode Island, June 16-21, 2012 p1
[30]	Cui X, Huang J, Zhang S, Metaxas D 2012 European Conference on Computer Vision (ECCV) Florence, Italy, October 7-13, 2012 p612
[31]	Sundaram N, Brox T, Keutzer K 2010 European Conference on Computer Vision (ECCV) Crete, Greece, September 5-11, 2010 p438

Cited By

[1]	Radke R, Andra S, Kofahi A, Roysam B 2005 IEEE Trans. Image Process. 14 294
[2]	Ren Y, Chua C, Ho Y 2003 Mach. Vision Appl. 13 332
[3]	Sheikh Y, Javed O, Kanade T 2009 Conference. on Computer Vision and Pattern Recognition(CVPR) Miami, USA, June 20-25, 2009 p1219
[4]	Chen L, Zhu S, Li X 2015 International Symposium on Computers Informatics Beijing, China, January 17-18, 2015 p742
[5]	Bi G L, Xu Z J, Chen T, Wang J L, Zhang Y S 2015 Acta Phys. Sin. 64 150701 (in Chinese) [毕国玲, 续志军, 陈涛, 王建立, 张延坤 2015 物理学报 64 150701]
[6]	Sun S W, Wang Y F, Huang F, Liao H Y 2013 J. Visual. Commun. Image Represent 24 232
[7]	Li A H, Cui Z G 2016 Moving Object Detection in Videos (Beijing: Science Press) p15 (in Chinese) [李艾华, 崔智高 2016 视频序列运动目标检测技术 (北京: 科学出版社) 第15页]
[8]	Lee Y, Kim J, Grauman K 2011 International Conference on Computer Vision(ICCV) Barcelona, Spain, November 6-13, 2011 p1995
[9]	Li W T, Chang H S, Lien K C, Chang H T, Wang Y C 2011 IEEE Trans. Image Proc. 22 2600
[10]	Zhang D, Javed O, Shah M 2013 Conference on Computer Vision and Pattern Recognition(CVPR) Oregon, Portland, June 25-27, 2013 p682
[11]	Elqursh A, Elgammal A 2012 European Conference on Computer Vision (ECCV) Florence, Italy, October 7-13, 2012 p228
[12]	Gao W, Tang Y, Zhu M 2014 Acta Phys Sin. 63 094204 (in Chinese) [高文, 汤洋, 朱明 2014 物理学报 63 094204]
[13]	Cui Z G, Li A H, Feng G Y 2015 Journal of Computer-Aided Design Computer Graphics 27 621 (in Chinese) [崔智高, 李艾华, 冯国彦 2015 计算机辅助设计与图形学学报 27 621]
[14]	Wang J, Adelson E 1994 IEEE Trans. Image Process. 3 625
[15]	Cremers D, Soatto S 2004 Int. J. Comput Vison 62 249
[16]	Yoon S, Park S, Kang S 2005 Pattern Recognit. Lett. 26 2221
[17]	Adhyapak S, Kehtarnavaz N, Nadin M 2007 J. Electron. Imaging 16 13012
[18]	Di S, Mattoccia S, Tombari F 2005 International Workshop on Computer Architecture for Machine Perception Palermo, Italy, July 4-6, 2005 p193
[19]	Bouguet J 2001 Intel Corporation 5 10
[20]	Brox T, Malik J 2010 European Conference on Computer Vision (ECCV) Crete, Greece, September 5-11, 2010 p282
[21]	Achanta R, Shaji A, Smith K 2012 IEEE Trans. Pattern Anal. Mach. Intell. 34 2274
[22]	Achanta R, Shaji A 2010 EPFL Technical Report 1 149
[23]	Vazquez A, Avidan S, Pfister H 2010 European Conference on Computer Vision (ECCV) Crete, Greece, September 5-11, 2010 p268
[24]	Fulkerson B, Vedaldi A, Soatto S 2009 International Conference on Computer Vision (ICCV) Kyoto, Japan, September 27-October 4, 2009 p670
[25]	Boykov Y, Veksler O, Zabih R 2001 IEEE Trans. Pattern Anal. Mach. Intell. 23 1222
[26]	Boykov Y, Funka L 2006 Int. J. Comput. Vison. 70 109
[27]	Tron R, Vidal R 2007 Conference on Computer Vision and Pattern Recognition (CVPR) Minneapolis, USA, June 18-23 2007 p1
[28]	Sand P, Teller S 2008 Int. J. Comput. Vison. 80 72
[29]	Goyette N, Jodoin P, Porikil F 2012 Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) Providence, Rhode Island, June 16-21, 2012 p1
[30]	Cui X, Huang J, Zhang S, Metaxas D 2012 European Conference on Computer Vision (ECCV) Florence, Italy, October 7-13, 2012 p612
[31]	Sundaram N, Brox T, Keutzer K 2010 European Conference on Computer Vision (ECCV) Crete, Greece, September 5-11, 2010 p438

[1]	Xu Ming-Wei, Du Kang, Li Ke, Wang Fei-Xiang, Xiao Ti-Qiao. High sensitivity tracking of free-moving targets in time-varying complex backgrounds. Acta Physica Sinica, 2023, 72(15): 150701. doi: 10.7498/aps.72.20230360
[2]	Xu Yan, Wang Pei-Guang, Yang Qing, Dong Jiang-Tao. Moving target detection algorithm based on spatiotemporal correlation multi-channel clustering. Acta Physica Sinica, 2019, 68(16): 164203. doi: 10.7498/aps.68.20190161
[3]	Jia Hui, Luo Xiu-Juan, Zhang Yu, Lan Fu-Yang, Liu Hui, Chen Ming-Lai. All-optical imaging and tracking technology for rectilinear motion targets through scattering media. Acta Physica Sinica, 2018, 67(22): 224202. doi: 10.7498/aps.67.20180955
[4]	Luo Jia-Qi, Duan Yan-Hui, Xia Zhen-Hua. Transonic flow reconstruction by an adaptive proper orthogonal decomposition hybrid model. Acta Physica Sinica, 2016, 65(12): 124702. doi: 10.7498/aps.65.124702
[5]	Liang Xiao, Qian Zhi-Hong, Tian Hong-Liang, Wang Xue. Markov decision model based handoff selection algorithm for heterogeneous wireless networks. Acta Physica Sinica, 2016, 65(23): 236402. doi: 10.7498/aps.65.236402
[6]	Xing Hong-Yan, Zhang Qiang, Xu Wei. Fractal property of sea clutter FRFT spectrum for small target detection. Acta Physica Sinica, 2015, 64(11): 110502. doi: 10.7498/aps.64.110502
[7]	Bi Guo-Ling, Xu Zhi-Jun, Chen Tao, Wang Jian-Li, Zhang Yan-Kun. Complex background model and foreground detection based on random aggregation. Acta Physica Sinica, 2015, 64(15): 150701. doi: 10.7498/aps.64.150701
[8]	Wang Yan, Zou Nan, Fu Jin, Liang Guo-Long. Estimation of single hydrophone target motion parameter based on cepstrum analysis. Acta Physica Sinica, 2014, 63(3): 034302. doi: 10.7498/aps.63.034302
[9]	Hou Wang, Yu Qi-Feng, Lei Zhi-Hui, Liu Xiao-Chun. A block-based improved recursive moving-target-indication algorithm. Acta Physica Sinica, 2014, 63(7): 074208. doi: 10.7498/aps.63.074208
[10]	Yin Wen-Ye, He Wei-Ji, Gu Guo-Hua, Chen Qian. A new full waveform analysis approach using simulated tempering Markov chain Monte Carlo method. Acta Physica Sinica, 2014, 63(16): 164205. doi: 10.7498/aps.63.164205
[11]	Gao Wen, Tang Yang, Zhu Ming. Study on the cascade classifier in target detection under complex background. Acta Physica Sinica, 2014, 63(9): 094204. doi: 10.7498/aps.63.094204
[12]	Zhong Jian, Fei Jian-Fang, Huang Si-Xun, Huang Xiao-Gang, Cheng Xiao-Ping. Application of the multi-parameters error model in cyclone wind retrieval with scatterometer data. Acta Physica Sinica, 2013, 62(15): 159302. doi: 10.7498/aps.62.159302
[13]	Xie Wen-Xian, Xu Peng-Fei, Cai Li, Li Dong-Ping. Non-Markovian diffusion of the stochastic system with a biexponentical dissipative memory kernel. Acta Physica Sinica, 2013, 62(8): 080503. doi: 10.7498/aps.62.080503
[14]	Wei Wei, Lu Lu-Yi, Gu Zhao-Lin. Modeling and simulation of electrification of wind-blown-sand two-phase flow. Acta Physica Sinica, 2012, 61(15): 158301. doi: 10.7498/aps.61.158301
[15]	Xing Hong-Yan, Gong Ping, Xu Wei. Small target detection in the background of sea clutter using fractal method. Acta Physica Sinica, 2012, 61(16): 160504. doi: 10.7498/aps.61.160504
[16]	Cai Cheng-Jun, Fang Mao-Fa, Xiao Xing, Huang Jiang. Atomic entropy squeezing of the Jaynes-Cummings model driven by classical fields in non-Markovian environment. Acta Physica Sinica, 2012, 61(21): 210303. doi: 10.7498/aps.61.210303
[17]	Zheng Li-Ming, Liu Song-Hao, Wang Fa-Qiang. Geometric phase evolution of atom under non-Markovian environment. Acta Physica Sinica, 2009, 58(4): 2430-2434. doi: 10.7498/aps.58.2430
[18]	Fei Rong, Cui Du-Wu. Moving object in Markov stochastic processes: spacial characteristic analysis and approximate approach research. Acta Physica Sinica, 2009, 58(8): 5133-5141. doi: 10.7498/aps.58.5133
[19]	Jiang Bin, Wang Hong-Qiang, Li Xiang, Guo Gui-Rong. A novel method of target detection based on the sea clutter. Acta Physica Sinica, 2006, 55(8): 3985-3991. doi: 10.7498/aps.55.3985
[20]	Ruan Hang-Yu, Chen Yi-Xin. HIGHER DIMENSIONAL PAINLEVé INTEGRABLE MODELSWITH REAL PHYSICAL SIGNIFICATION. Acta Physica Sinica, 2001, 50(4): 577-585. doi: 10.7498/aps.50.577

Catalog

Vol. 66, Issue 8 - 2017-04-20

Metrics

Abstract views: 8002
PDF Downloads: 341
Cited By: 0

姓名
邮箱
手机号码
标题
留言内容
验证码

Search

Article

留言板