-
在认知无线电网络中, 传输层端到端(TCP)吞吐率是衡量网络性能的重要指标. 前期相关研究大都具有以下两方面缺点: 第一, 大部分研究只考虑了协议底层参数来优化物理链路性能, 对传输层性能有所忽略; 第二, 目前的研究大都基于马尔可夫决策过程建模, 这需要网络具有完全知识, 使得这类模型的应用受到很大限制. 针对以上问题, 本文提出一种新的算法: 网络中每个节点通过联合配置物理层调制方式、发射功率、 链路层信道接入和TCP拥塞控制因子来找到传输层端到端近似最优吞吐率. 由于无线设备对环境感知存在误差, 本文将网络模型建模为部分可观测马尔可夫决策过程, 并将其转换成信念状态马尔可夫决策过程, 采用Q值迭代找到近似最优策略. 仿真分析表明, 提出的算法能在动态无线环境下以一定的误差限收敛于最优策略, 能在功率受限条件下, 有效提高传输层端到端吞吐率.
-
关键词:
- 认知无线电网络 /
- 传输层吞吐率 /
- 信念状态马尔可夫决策过程 /
- Q学习
In cognitive radio network (CRN), TCP end to end throughput is one of the key issues to measure its performance. However, most of existing research efforts devoted to TCP performance improvement have two weaknesses as follows. First, most of them only consider the underlying parameters to optimize the physical performance, but the TCP performance is neglected. Second, they are largely formulated as a Markov decision process (MDP), which requires a complete knowledge of network and cannot be directly applied to CRNs. To solve the above problems, a Q-BMDP algorithm is proposed in this paper. Each user in CRN combines modulation type and transmitting power at the physical layer, access channels at the media access control layer and TCP congestion control factor to maximize the TCP throughput. Due to the existence of perception error of environment, this issue is formulated as a partial observable Markov decision process (POMDP) which is then converted to belief state MDP, with Q-value iteration to find the approximately optimal strategy. Simulation and analysis results show that the proposed algorithm can be approximately converged to optimal strategy under a maximum error limit, and can effectively improve TCP throughput in a dynamic wireless network under the premise of the limited power consumption.[1] Wang B B, Liu K, Ray J 2011 IEEE J. Sel. Top. Sign. Proces. 5 5
[2] Zu Y X, Zhou J 2011 Acta Phys. Sin. 60 079501 (in Chinese) [俎云宵, 周杰 2011 物理学报 60 079501]
[3] Zhao Z J, Xu S Y, Zheng S L, Yang X N 2009 Acta Phys. Sin. 58 5118 (in Chinese) [赵知劲, 徐世宇, 郑世链, 杨小牛 2009 物理学报 58 5118]
[4] Mwangoka J W, Letaief K B, Cao Z G 2009 PHYCOM 2 103
[5] Shiang H P, van der Schaar M 2007 IEEE J. Sel. Areas Commun. 25 770
[6] Fu F W, van der Schaar M 2010 IEEE Trans. Signal Process. 58 1401
[7] Zhang Y, Fu F W, van der Schaar M 2010 IEEE Trans. Signal Process. 58 3108
[8] Lin Z C, van der Schaar M 2011 IEEE Trans. Wireless Commun. 1 102
[9] Zhao Q, Lang T, Ananthram, Chen Y X 2007 IEEE J. Sel. Areas Commun. 25 589
[10] Wang Y C, Ren P Y, Su Z 2011 IEICE Trans. Commun. E94-B 1621
[11] Lou C Q, Yu F R, Ji H, Leung V C M 2010 IEEE Trans. Veh. Technol. 59 2485
[12] Wei Y F, Yu F R, Song M, Zhang Y 2011 IET Commun. 5 2257
[13] Luo C Q, Yu F R, Ji H, Leung V C M 2011 Wirel. Netw. 17 479
[14] Kwon W Y, Suh I H, Lee S 2011 Int. J. Control, Automat. Syst. 9 328
[15] Maskery M, Krishnamurthy V, Zhao Q 2009 IEEE Trans. Commun. 57 459
[16] Krishnaswamy D 2002 Proceedings of the 56th IEEE Conference on Vehicular Technology Vancouver, BC, Canada, September 24-28, 2002 p1312
[17] Lu J, Letaief K B, Chuang J C I, Liou M L 1999 IEEE Trans. Commun. 47 181
[18] Parvez N, Mahanti A, Williamson C 2010 IEEE/ACM Trans. Networking 18 448
[19] Wiering M A, Kooi T 2010 Proceedings of the IEEE International Joint Conference on Neural Networks Barcelona, Spain, July 18-23, 2010 p1
-
[1] Wang B B, Liu K, Ray J 2011 IEEE J. Sel. Top. Sign. Proces. 5 5
[2] Zu Y X, Zhou J 2011 Acta Phys. Sin. 60 079501 (in Chinese) [俎云宵, 周杰 2011 物理学报 60 079501]
[3] Zhao Z J, Xu S Y, Zheng S L, Yang X N 2009 Acta Phys. Sin. 58 5118 (in Chinese) [赵知劲, 徐世宇, 郑世链, 杨小牛 2009 物理学报 58 5118]
[4] Mwangoka J W, Letaief K B, Cao Z G 2009 PHYCOM 2 103
[5] Shiang H P, van der Schaar M 2007 IEEE J. Sel. Areas Commun. 25 770
[6] Fu F W, van der Schaar M 2010 IEEE Trans. Signal Process. 58 1401
[7] Zhang Y, Fu F W, van der Schaar M 2010 IEEE Trans. Signal Process. 58 3108
[8] Lin Z C, van der Schaar M 2011 IEEE Trans. Wireless Commun. 1 102
[9] Zhao Q, Lang T, Ananthram, Chen Y X 2007 IEEE J. Sel. Areas Commun. 25 589
[10] Wang Y C, Ren P Y, Su Z 2011 IEICE Trans. Commun. E94-B 1621
[11] Lou C Q, Yu F R, Ji H, Leung V C M 2010 IEEE Trans. Veh. Technol. 59 2485
[12] Wei Y F, Yu F R, Song M, Zhang Y 2011 IET Commun. 5 2257
[13] Luo C Q, Yu F R, Ji H, Leung V C M 2011 Wirel. Netw. 17 479
[14] Kwon W Y, Suh I H, Lee S 2011 Int. J. Control, Automat. Syst. 9 328
[15] Maskery M, Krishnamurthy V, Zhao Q 2009 IEEE Trans. Commun. 57 459
[16] Krishnaswamy D 2002 Proceedings of the 56th IEEE Conference on Vehicular Technology Vancouver, BC, Canada, September 24-28, 2002 p1312
[17] Lu J, Letaief K B, Chuang J C I, Liou M L 1999 IEEE Trans. Commun. 47 181
[18] Parvez N, Mahanti A, Williamson C 2010 IEEE/ACM Trans. Networking 18 448
[19] Wiering M A, Kooi T 2010 Proceedings of the IEEE International Joint Conference on Neural Networks Barcelona, Spain, July 18-23, 2010 p1
计量
- 文章访问数: 5498
- PDF下载量: 399
- 被引次数: 0
下载:
