Knowledge Management System of Shenyang Institute of Automation, CAS
| Pricing Scheme based Nash Q-learning Flow Control for Multi-user Network | |
Li X(李鑫); Yu HB(于海斌)
| |
| Department | 工业信息学研究室 |
| Conference Name | International Conference on Materials, Mechatronics and Automation (ICMMA 2011) |
| Conference Date | JAN 15-16, 2011 |
| Conference Place | Melbourne, AUSTRALIA |
| Source Publication | Key Engineering Materials |
| Publisher | TRANS TECH PUBLICATIONS LTD |
| Publication Place | STAFA-ZURICH, Switzerland |
| 2011 | |
| Pages | 847-852 |
| Indexed By | EI ; CPCI（ISTP） |
| EI Accession number | 20111113753558 |
| WOS ID | WOS:000303364700158 |
| Contribution Rank | 1 |
| ISSN | 1013-9826 |
| Keyword | Computer Simulation Controllers Costs Flow Control High Speed Networks Mechatronics Quality Of Service Time Varying Networks Traffic Congestion |
| Abstract | For the congestion problems with multi-user existing in high-speed networks, a pricing scheme based Nash Q-learning flow controller is proposed. It considers a network with a single service provider, and some non-cooperative users. The pricing scheme is introduced to the design of the reward function in the learning process of Q-learning. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for high-speed networks. The Nash Q-learning, which is independent of mathematic model, shows particular superiority. It obtains the Nash Q-values through trial-and-error and interaction with the environment to improve its behavior policy. By means of learning process, the proposed controller can learn to take the best actions to regulate source flow with the features of high quality of service. Simulation results show that the proposed controller can promote the performance of the networks and avoid the occurrence of congestion effectively. |
| Language | 英语 |
| Citation statistics | |
| Document Type | 会议论文 |
| Identifier | http://ir.sia.cn/handle/173321/7091 |
| Collection | 工业信息学研究室 |
| Corresponding Author | Li X(李鑫) |
| Affiliation | Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, Liaoning, 110016, China |
| Recommended Citation GB/T 7714 | Li X,Yu HB. Pricing Scheme based Nash Q-learning Flow Control for Multi-user Network[C]. STAFA-ZURICH, Switzerland:TRANS TECH PUBLICATIONS LTD,2011:847-852. |
| Files in This Item: | ||||||
| File Name/Size | DocType | Version | Access | License | ||
| YWQK000239.pdf（231KB） | 会议论文 | 开放获取 | CC BY-NC-SA | View Application Full Text | ||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment