Load Balancing Models based on Reinforcement Learning for Self-Optimized Macro-Femto LTE-Advanced Heterogeneous Network
Keywords:
Load Balancing, LTE-A HetNet, Small Cells, Reinforcement Learning,Abstract
Heterogeneous Long Term Evolution-Advanced (LTE-A) network (HetNet) utilizes small cells to enhance its capacity and coverage. The intensive deployment of small cells such as pico- and femto-cells to complement macro-cells resulted in unbalanced distribution of traffic-load among cells. Machine learning techniques are employed in cooperation with Self-Organizing Network (SON) features to achieve load balancing between highly loaded Macro cells and underlay small cells such as Femto cells. In this paper, two algorithms have been proposed to balance the traffic load between Macro and Femto cells. The two proposed algorithms are named as Load Balancing based on Reinforcement Learning of end-user SINR (LBRL-SINR) and Load Balancing based on Reinforcement Learning of Macro cell-throughput (LBRL-T). Both of the proposed algorithms utilize Reinforcement Learning (RL) technique to control the reference signal power of each Femto cell that underlays a highly loaded Macro cell. At the same time, the algorithm monitors any degradation in the performance metrics of both Macro and its neighbor Femto cells and reacts to troubleshoot the degradation in real time. The simulation results showed that both of the proposed algorithms are able to off-load end-users from highly loaded Macro cell and redistribute the traffic load fairly with its neighbor Femto cells. As a result, both of call drop rate and call block rate of a highly loaded Macro cell are decreased.References
T. Nakamura, S. Nagata, A. Benjebbour, Y. Kishiyama, T. Hai, S. Xiaodong, et al., "Trends in small cell enhancements in LTE advanced," IEEE Communications Magazine, vol. 51, pp. 98-105, 2013.
M. Peng, D. Liang, Y. Wei, J. Li, and H. H. Chen, "Self-configuration and self-optimization in LTE-advanced heterogeneous networks," IEEE Communications Magazine, vol. 51, pp. 36-45, 2013.
L. Jorguseski, A. Pais, F. Gunnarsson, A. Centonza, and C. Willcock, "Self-organizing networks in 3GPP: standardization and future trends," IEEE Communications Magazine, vol. 52, pp. 28-34, 2014.
W. Wang, J. Zhang, and Q. Zhang, "Cooperative cell outage detection in Self-Organizing femtocell networks," in INFOCOM, 2013 Proceedings IEEE, 2013, pp. 782-790.
A. Aguilar-Garcia, S. Fortes, M. Molina-García, J. Calle-Sánchez, J.
I. Alonso, A. Garrido, et al., "Location-aware self-organizing methods in femtocell networks," Computer Networks, vol. 93, Part 1, pp. 25-140, 12/24/ 2015.
M. Behjati and J. Cosmas, "Self-organizing network interference coordination for future LTE-advanced networks," in 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), 2013, pp. 1-5.
S. Jia, W. Li, X. Zhang, Y. Liu, and X. Gu, "Advanced Load
Balancing Based on Network Flow Approach in LTE-A Heterogeneous Network," International Journal of Antennas and
Propagation, vol. 2014, p. 10, 2014.
Y. Khan, B. Sayrac, and E. Moulines, "Centralized self-optimization in LTE-A using Active Antenna Systems," in Wireless Days (WD), 2013 IFIP, 2013, pp. 1-3.
Z. Altman, S. Sallem, R. Nasri, B. Sayrac, and M. Clerc, "Particle swarm optimization for Mobility Load Balancing SON in LTE networks," in Wireless Communications and Networking Conference Workshops (WCNCW), 2014 IEEE, 2014, pp. 172-177.
A. L. Yusof, M. A. Zainali, M. T. M. Nasir, and N. Ya'acob,
"Handover adaptation for load balancing scheme in femtocell Long Term Evolution (LTE) network," in Control and System Graduate Research Colloquium (ICSGRC), 2014 IEEE 5th, 2014, pp. 242-246.
K. Lee, S. Kim, S. Lee, and J. Ma, "Load balancing with transmission power control in femtocell networks," in Advanced Communication Technology (ICACT), 2011 13th International Conference on, 2011, pp. 519-522.
L. Bu, oniu, R. B. $$ka, and B. D. Schutter, "A Comprehensive Survey of Multiagent Reinforcement Learning," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 38, pp. 156-172, 2008.
E. Bikov and D. Botvich, "Multi-agent Learning for Resource Allocationn Dense Heterogeneous 5G Network," in 2015 International Conference on Engineering and Telecommunication (EnT), 2015, pp. 1-6.
I. S. Com, x015F, M. Aydin, S. Zhang, P. Kuonen, and J. F. Wagen, "Reinforcement learning based radio resource scheduling in LTEadvanced," in Automation and Computing (ICAC), 2011 7th International Conference on, 2011, pp. 219-224.
J. Moysen and L. Giupponi, "A Reinforcement Learning Based Solution for Self-Healing in LTE Networks," in 2014 IEEE 80th Vehicular Technology Conference (VTC2014-Fall), 2014, pp. 1-6.
O. Iacoboaiea, B. Sayrac, S. B. Jemaa, and P. Bianchi, "SON Coordination for parameter conflict resolution: A reinforcement learning framework," in Wireless Communications and Networking Conference Workshops (WCNCW), 2014 IEEE, 2014, pp. 196-201.
A. Giovanidis, L. Qi, and S. Stańczaky, "A distributed interferenceaware load balancing algorithm for LTE multi-cell networks," in 2012 International ITG Workshop on Smart Antennas (WSA), 2012, pp. 28-35.
H. Zhang, X. s. Qiu, L. m. Meng, and X. d. Zhang, "Achieving distributed load balancing in self-organizing LTE radio access network with autonomic network management," in 2010 IEEE Globecom Workshops, 2010, pp. 454-459.
K. M. Ronoh, A., "Load Balancing in Heterogeneous LTE-A
Networks," Linköping University, 2012.
A. Lobinger, S. Stefanski, T. Jansen, and I. Balan, "Load Balancing in Downlink LTE Self-Optimizing Networks," in 2010 IEEE 71st Vehicular Technology Conference, 2010, pp. 1-5.
Z. Li, H. Wang, Z. Pan, N. Liu, and X. You, "Joint optimization on load balancing and network load in 3GPP LTE multi -cell networks," in 2011 International Conference on Wireless Communications and Signal Processing (WCSP), 2011, pp. 1-5.
3GPP, "“Small cell enhancements for E-UTRA and E-UTRAN —Physical layer aspects (Release 12)”," 3GPP, vol. TR 36.872
(v12.1.0), Dec. 2013.
Downloads
Published
How to Cite
Issue
Section
License
TRANSFER OF COPYRIGHT AGREEMENT
The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):
- All proprietary right other than copyright, such as patent rights
- The right to make further copies of all or part of the published article for my use in classroom teaching
- The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
- The right to make copies of the published work for internal distribution within the institution that employs me
I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.
