Nonlinear prediction of small scale network traffic based on local relevance vector machine regression model

Meng Qing-Fang; Chen Yue-Hui; Feng Zhi-Quan; Wang Feng-Lin; Chen Shan-Shan

doi:10.7498/aps.62.150509

Abstract

Based on the nonlinear time series local prediction method and the relevance vector machine regression model, the local relevance vector machine prediction method is proposed and applied to predict the small scale traffic measurement data, and the BIC-based neighbor point selection method is used to choose the number of nearest-neighbor points for the local relevance vector machine regression model. We also compare the performance of the local relevance vector machine regression model with the feed-forward neural network optimized by particle swarm optimization for the same problem. Experimental results show that the local relevance vector machine prediction method whose neighboring points have been optimized can effectively predict the small scale traffic measurement data, can reproduce the statistical features of real small scale traffic measurements, and the prediction accuracy of the local relevance vector machine regression model is superior to that of the feedforward neural network optimized by PSO and the local linear prediction method.

Keywords:

Authors and contacts

1.
School of Information Science and Engineering, University of Jinan, Jinan 250022, China; Shandong Provincial Key laboratory of Network Based Intelligent Computing, Jinan 250022
Funds: Project supported by the National Natural Science Foundation of China (Grant Nos. 61201428, 61070130, 61173079), the Natural Science Foundation of Shandong Province, China (Grant Nos. ZR2010FQ020, ZR2011FZ003), the Shandong Distinguished Middle-aged and Young Scientist Encourage and Reward Foundation, China (Grant No. BS2009SW003), and the China Postdoctoral Science Foundation (Grant No. 20100470081).

References

[1]	Orosz G, Krauskopf B, Wilson R E 2005 Physica D 211 277
[2]	Orosz G, Wilson R E, Krauskopf B 2004 Phys. Rev. E 70 026207
[3]	Gasser I, Sirito G, Werner B 2004 Physica D 197 222
[4]	Doulamis A D, Doulamis N D, Kollias S D 2003 IEEE Trans. on Neur. Netw. 14 150
[5]	Xie Y B, Wang W X, Wang B H 2007 Phys. Rev. E 75 026111
[6]	Zhang Z L, Ribeiro V J, Mooon S, Diot C 2003 IEEE INFOCOM 3 1826
[7]	Uglig S 2004 ACM SIGCOMM computer communications review 34
[8]	Kantz H, Schreiber T 2003 Nonlinear Time Series Analysis (Second Edition) (Cambridge: Cambridge University Press)
[9]	Small M, Tse C K 2002 Phys. Rev. E 66 066701
[10]	Karunasinghe D S K, Liong S Y 2006 Journal of Hydrology 323 92
[11]	Ma Q L, Zheng Q L, Peng H, Zhong T W, Qin J W 2008 Chin. Phys. B 17 536
[12]	Ma Q L, Zheng Q L, Peng H, Qin J W 2009 Acta Phys. Sin. 58 1410 (in Chinese) [马千里, 郑启伦, 彭宏, 覃姜维 2009 物理学报 58 1410]
[13]	Liu H, Liu D, Deng L F 2006 Chin. Phys. 15 1196
[14]	Chen Q, Ren X M 2010 Acta Phys. Sin. 59 2310 (in Chinese) [陈强, 任雪梅 2010 物理学报 59 2310]
[15]	Farmer J D, Sidorowich J J 1987 Phys. Rev. Lett. 59 845
[16]	Giona M, Lentini F, Cimagalli V 1991 Phys. Rev. A 44 3496
[17]	Kugiumtzis D, Lingjarde O C, Christophersen N 1998 Physica D 112 344
[18]	Ragwitz M, Kantz H 2002 Phys. Rev. E 65 056201
[19]	Meng Q F, Peng Y H 2007 Phys. Lett. A 370 465
[20]	Li H C, Zhang J S 2005 Chin. Phys. Lett. 22 2776
[21]	Zhang J S, Dang J L, Li H C 2007 Acta Phys. Sin. 56 67 (in Chinese) [张家树, 党建亮, 李恒超 2007 物理学报 56 67]
[22]	Du J, Cao Y J, Liu Z J, Xu L J, Jiang Q Y, Guo C X, Lu J G 2009 Acta Phys. Sin. 58 5997 (in Chinese) [杜杰, 曹一家, 刘志坚, 徐立中, 江全元, 郭创新, 陆金桂 2009 物理学报 58 5997]
[23]	Meng Q F, Peng Y H, Qu H J, Han M 2008 Acta Phys. Sin. 57 1423 (in Chinese) [孟庆芳, 彭玉华, 曲怀敬, 韩民 2008 物理学报 57 1423]
[24]	Shang P, Li X, Kamae S 2005 Chaos Solitons Fractals 25 121
[25]	Shang P, Li X, Kamae S 2006 Phys. Lett. A 357 314
[26]	Akritas P, Akishin P G, Antoniou I, Bonushkina A Y, Drossinos I 2002 Chaos Solit. and Frac. 14 595
[27]	Chen Y H, Yang B, Dong J W, Abraham A 2005 Information Sciences 174 219
[28]	Chen Y H, Yang B, Abraham A 2007 Neurocomputing 70 697
[29]	Chen Y H, Yang B, Meng Q F 2012 Applied Soft Computing 12 274
[30]	Tipping M E 2001 Journal of Machine Learning Research 3 211
[31]	Zio E, Maio F D 2012 Expert Systems with Applications 39 10681
[32]	Han M, Zhao Y, Yang X L, Lin D 2011 Control Theory and Applications 28 343 (in Chinese) [韩敏, 赵耀, 杨溪林, 林东 2011 控制理论与应用 28 343]

Cited By

[1]	Orosz G, Krauskopf B, Wilson R E 2005 Physica D 211 277
[2]	Orosz G, Wilson R E, Krauskopf B 2004 Phys. Rev. E 70 026207
[3]	Gasser I, Sirito G, Werner B 2004 Physica D 197 222
[4]	Doulamis A D, Doulamis N D, Kollias S D 2003 IEEE Trans. on Neur. Netw. 14 150
[5]	Xie Y B, Wang W X, Wang B H 2007 Phys. Rev. E 75 026111
[6]	Zhang Z L, Ribeiro V J, Mooon S, Diot C 2003 IEEE INFOCOM 3 1826
[7]	Uglig S 2004 ACM SIGCOMM computer communications review 34
[8]	Kantz H, Schreiber T 2003 Nonlinear Time Series Analysis (Second Edition) (Cambridge: Cambridge University Press)
[9]	Small M, Tse C K 2002 Phys. Rev. E 66 066701
[10]	Karunasinghe D S K, Liong S Y 2006 Journal of Hydrology 323 92
[11]	Ma Q L, Zheng Q L, Peng H, Zhong T W, Qin J W 2008 Chin. Phys. B 17 536
[12]	Ma Q L, Zheng Q L, Peng H, Qin J W 2009 Acta Phys. Sin. 58 1410 (in Chinese) [马千里, 郑启伦, 彭宏, 覃姜维 2009 物理学报 58 1410]
[13]	Liu H, Liu D, Deng L F 2006 Chin. Phys. 15 1196
[14]	Chen Q, Ren X M 2010 Acta Phys. Sin. 59 2310 (in Chinese) [陈强, 任雪梅 2010 物理学报 59 2310]
[15]	Farmer J D, Sidorowich J J 1987 Phys. Rev. Lett. 59 845
[16]	Giona M, Lentini F, Cimagalli V 1991 Phys. Rev. A 44 3496
[17]	Kugiumtzis D, Lingjarde O C, Christophersen N 1998 Physica D 112 344
[18]	Ragwitz M, Kantz H 2002 Phys. Rev. E 65 056201
[19]	Meng Q F, Peng Y H 2007 Phys. Lett. A 370 465
[20]	Li H C, Zhang J S 2005 Chin. Phys. Lett. 22 2776
[21]	Zhang J S, Dang J L, Li H C 2007 Acta Phys. Sin. 56 67 (in Chinese) [张家树, 党建亮, 李恒超 2007 物理学报 56 67]
[22]	Du J, Cao Y J, Liu Z J, Xu L J, Jiang Q Y, Guo C X, Lu J G 2009 Acta Phys. Sin. 58 5997 (in Chinese) [杜杰, 曹一家, 刘志坚, 徐立中, 江全元, 郭创新, 陆金桂 2009 物理学报 58 5997]
[23]	Meng Q F, Peng Y H, Qu H J, Han M 2008 Acta Phys. Sin. 57 1423 (in Chinese) [孟庆芳, 彭玉华, 曲怀敬, 韩民 2008 物理学报 57 1423]
[24]	Shang P, Li X, Kamae S 2005 Chaos Solitons Fractals 25 121
[25]	Shang P, Li X, Kamae S 2006 Phys. Lett. A 357 314
[26]	Akritas P, Akishin P G, Antoniou I, Bonushkina A Y, Drossinos I 2002 Chaos Solit. and Frac. 14 595
[27]	Chen Y H, Yang B, Dong J W, Abraham A 2005 Information Sciences 174 219
[28]	Chen Y H, Yang B, Abraham A 2007 Neurocomputing 70 697
[29]	Chen Y H, Yang B, Meng Q F 2012 Applied Soft Computing 12 274
[30]	Tipping M E 2001 Journal of Machine Learning Research 3 211
[31]	Zio E, Maio F D 2012 Expert Systems with Applications 39 10681
[32]	Han M, Zhao Y, Yang X L, Lin D 2011 Control Theory and Applications 28 343 (in Chinese) [韩敏, 赵耀, 杨溪林, 林东 2011 控制理论与应用 28 343]

[1]	Tian Zhong-Da, Gao Xian-Wen, Shi Tong. Combination kernel function least squares support vector machine for chaotic time series prediction. Acta Physica Sinica, 2014, 63(16): 160508. doi: 10.7498/aps.63.160508
[2]	Tang Zhou-Jin, Peng Tao, Wang Wen-Bo. A local least square support vector machine prediction algorithm of small scale network traffic based on correlation analysis. Acta Physica Sinica, 2014, 63(13): 130504. doi: 10.7498/aps.63.130504
[3]	Zhao Yong-Ping, Zhang Li-Yan, Li De-Cai, Wang Li-Feng, Jiang Hong-Zhang. Chaotic time series prediction using filtering window based least squares support vector regression. Acta Physica Sinica, 2013, 62(12): 120511. doi: 10.7498/aps.62.120511
[4]	Yu Yan-Hua, Song Jun-De. Redundancy-test-based hyper-parameters selection approach for support vector machines to predict time series. Acta Physica Sinica, 2012, 61(17): 170516. doi: 10.7498/aps.61.170516
[5]	Song Tong, Li Han. Chaotic time series prediction based on wavelet echo state network. Acta Physica Sinica, 2012, 61(8): 080506. doi: 10.7498/aps.61.080506
[6]	Li He, Yang Zhou, Zhang Yi-Min, Wen Bang-Chun. Methodology of estimating the embedding dimension in chaos time series based on the prediction performance of radial basis function neural networks. Acta Physica Sinica, 2011, 60(7): 070512. doi: 10.7498/aps.60.070512
[7]	Du Jie, Cao Yi-Jia, Liu Zhi-Jian, Xu Li-Zhong, Jiang Quan-Yuan, Guo Chuang-Xin, Lu Jin-Gui. Local higher-order Volterra filter multi-step prediction model of chaotic time series. Acta Physica Sinica, 2009, 58(9): 5997-6005. doi: 10.7498/aps.58.5997
[8]	Meng Qing-Fang, Peng Yu-Hua, Qu Huai-Jing, Han Min. The neighbor point selection method for local prediction based on information criterion. Acta Physica Sinica, 2008, 57(3): 1423-1430. doi: 10.7498/aps.57.1423
[9]	Zhang Jun-Feng, Hu Shou-Song. Chaotic time series prediction based on multi-kernel learning support vector regression. Acta Physica Sinica, 2008, 57(5): 2708-2713. doi: 10.7498/aps.57.2708
[10]	Wang Ge-Li, Yang Pei-Cai, Mao Yu-Qing. On the application of non-stationary time series prediction based on the SVM method. Acta Physica Sinica, 2008, 57(2): 714-719. doi: 10.7498/aps.57.714
[11]	. Prediction of chaotic time series based on selective support vector machine ensemble. Acta Physica Sinica, 2007, 56(12): 6820-6827. doi: 10.7498/aps.56.6820
[12]	Zhang Jia-Shu, Dang Jian-Liang, Li Heng-Chao. Local support vector machine prediction of spatiotemporal chaotic time series. Acta Physica Sinica, 2007, 56(1): 67-77. doi: 10.7498/aps.56.67
[13]	Yu Zhen-Hua, Cai Yuan-Li. Prediction of chaotic time-series based on online wavelet support vector regression. Acta Physica Sinica, 2006, 55(4): 1659-1665. doi: 10.7498/aps.55.1659
[14]	Hu Yu-Xia, Gao Jin-Feng. A neuro-fuzzy method for predicting the chaotic time series. Acta Physica Sinica, 2005, 54(11): 5034-5038. doi: 10.7498/aps.54.5034
[15]	Ye Mei-Ying, Wang Xiao-Dong, Zhang Hao-Ran. Chaotic time series forecasting using online least squares support vector machine regression. Acta Physica Sinica, 2005, 54(6): 2568-2573. doi: 10.7498/aps.54.2568
[16]	Cui Wan-Zhao, Zhu Chang-Chun, Bao Wen-Xing, Liu Jun-Hua. Prediction of the chaotic time series using support vector machines for fuzzy rule-based modeling. Acta Physica Sinica, 2005, 54(7): 3009-3018. doi: 10.7498/aps.54.3009
[17]	Lei Ming, Han Chong-Zhao, Guo Wen-Yan, Wen Xiao-Qin. A novel subband forecast method for nonlinear time series using wavelet transform. Acta Physica Sinica, 2005, 54(5): 1988-1993. doi: 10.7498/aps.54.1988
[18]	Wang Hong-Wei, Ma Guang-Fu. Prediction of chaotic time series based on fuzzy model. Acta Physica Sinica, 2004, 53(10): 3293-3297. doi: 10.7498/aps.53.3293
[19]	Cui Wan-Zhao, Zhu Chang-Chun, Bao Wen-Xing, Liu Jun-Hua. Prediction of the chaotic time series using support vector machines. Acta Physica Sinica, 2004, 53(10): 3303-3310. doi: 10.7498/aps.53.3303
[20]	ZHANG JIA-SHU, XIAO XIAN-CI. PREDICTION OF CHAOTIC TIME SERIES BY USING ADAPTIVE HIGHER-ORDER NONLINEAR FOUR IER INFRARED FILTER. Acta Physica Sinica, 2000, 49(7): 1221-1227. doi: 10.7498/aps.49.1221

Catalog

Vol. 62, Issue 15 - 2013-08-05

Metrics

Abstract views: 3400
PDF Downloads: 970
Cited By: 0

HTML

Reference (32)

[1]	Orosz G, Krauskopf B, Wilson R E 2005 Physica D 211 277
[2]	Orosz G, Wilson R E, Krauskopf B 2004 Phys. Rev. E 70 026207
[3]	Gasser I, Sirito G, Werner B 2004 Physica D 197 222
[4]	Doulamis A D, Doulamis N D, Kollias S D 2003 IEEE Trans. on Neur. Netw. 14 150
[5]	Xie Y B, Wang W X, Wang B H 2007 Phys. Rev. E 75 026111
[6]	Zhang Z L, Ribeiro V J, Mooon S, Diot C 2003 IEEE INFOCOM 3 1826
[7]	Uglig S 2004 ACM SIGCOMM computer communications review 34
[8]	Kantz H, Schreiber T 2003 Nonlinear Time Series Analysis (Second Edition) (Cambridge: Cambridge University Press)
[9]	Small M, Tse C K 2002 Phys. Rev. E 66 066701
[10]	Karunasinghe D S K, Liong S Y 2006 Journal of Hydrology 323 92
[11]	Ma Q L, Zheng Q L, Peng H, Zhong T W, Qin J W 2008 Chin. Phys. B 17 536
[12]	Ma Q L, Zheng Q L, Peng H, Qin J W 2009 Acta Phys. Sin. 58 1410 (in Chinese) [马千里, 郑启伦, 彭宏, 覃姜维 2009 物理学报 58 1410]
[13]	Liu H, Liu D, Deng L F 2006 Chin. Phys. 15 1196
[14]	Chen Q, Ren X M 2010 Acta Phys. Sin. 59 2310 (in Chinese) [陈强, 任雪梅 2010 物理学报 59 2310]
[15]	Farmer J D, Sidorowich J J 1987 Phys. Rev. Lett. 59 845
[16]	Giona M, Lentini F, Cimagalli V 1991 Phys. Rev. A 44 3496
[17]	Kugiumtzis D, Lingjarde O C, Christophersen N 1998 Physica D 112 344
[18]	Ragwitz M, Kantz H 2002 Phys. Rev. E 65 056201
[19]	Meng Q F, Peng Y H 2007 Phys. Lett. A 370 465
[20]	Li H C, Zhang J S 2005 Chin. Phys. Lett. 22 2776
[21]	Zhang J S, Dang J L, Li H C 2007 Acta Phys. Sin. 56 67 (in Chinese) [张家树, 党建亮, 李恒超 2007 物理学报 56 67]
[22]	Du J, Cao Y J, Liu Z J, Xu L J, Jiang Q Y, Guo C X, Lu J G 2009 Acta Phys. Sin. 58 5997 (in Chinese) [杜杰, 曹一家, 刘志坚, 徐立中, 江全元, 郭创新, 陆金桂 2009 物理学报 58 5997]
[23]	Meng Q F, Peng Y H, Qu H J, Han M 2008 Acta Phys. Sin. 57 1423 (in Chinese) [孟庆芳, 彭玉华, 曲怀敬, 韩民 2008 物理学报 57 1423]
[24]	Shang P, Li X, Kamae S 2005 Chaos Solitons Fractals 25 121
[25]	Shang P, Li X, Kamae S 2006 Phys. Lett. A 357 314
[26]	Akritas P, Akishin P G, Antoniou I, Bonushkina A Y, Drossinos I 2002 Chaos Solit. and Frac. 14 595
[27]	Chen Y H, Yang B, Dong J W, Abraham A 2005 Information Sciences 174 219
[28]	Chen Y H, Yang B, Abraham A 2007 Neurocomputing 70 697
[29]	Chen Y H, Yang B, Meng Q F 2012 Applied Soft Computing 12 274
[30]	Tipping M E 2001 Journal of Machine Learning Research 3 211
[31]	Zio E, Maio F D 2012 Expert Systems with Applications 39 10681
[32]	Han M, Zhao Y, Yang X L, Lin D 2011 Control Theory and Applications 28 343 (in Chinese) [韩敏, 赵耀, 杨溪林, 林东 2011 控制理论与应用 28 343]

姓名
邮箱
手机号码
标题
留言内容
验证码

Search

Article

留言板