Load Balancing Models based on Reinforcement Learning for Self-Optimized Macro-Femto LTE-Advanced Heterogeneous Network

Authors

  • Sameh Musleh Department of Electrical, Electronics and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600, Bangi, Selangor, Malaysia
  • Mahamod Ismail Department of Electrical, Electronics and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600, Bangi, Selangor, Malaysia
  • Rosdiadee Nordin Department of Electrical, Electronics and Systems Engineering, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, 43600, Bangi, Selangor, Malaysia

Keywords:

Load Balancing, LTE-A HetNet, Small Cells, Reinforcement Learning,

Abstract

Heterogeneous Long Term Evolution-Advanced (LTE-A) network (HetNet) utilizes small cells to enhance its capacity and coverage. The intensive deployment of small cells such as pico- and femto-cells to complement macro-cells resulted in unbalanced distribution of traffic-load among cells. Machine learning techniques are employed in cooperation with Self-Organizing Network (SON) features to achieve load balancing between highly loaded Macro cells and underlay small cells such as Femto cells. In this paper, two algorithms have been proposed to balance the traffic load between Macro and Femto cells. The two proposed algorithms are named as Load Balancing based on Reinforcement Learning of end-user SINR (LBRL-SINR) and Load Balancing based on Reinforcement Learning of Macro cell-throughput (LBRL-T). Both of the proposed algorithms utilize Reinforcement Learning (RL) technique to control the reference signal power of each Femto cell that underlays a highly loaded Macro cell. At the same time, the algorithm monitors any degradation in the performance metrics of both Macro and its neighbor Femto cells and reacts to troubleshoot the degradation in real time. The simulation results showed that both of the proposed algorithms are able to off-load end-users from highly loaded Macro cell and redistribute the traffic load fairly with its neighbor Femto cells. As a result, both of call drop rate and call block rate of a highly loaded Macro cell are decreased.

References

T. Nakamura, S. Nagata, A. Benjebbour, Y. Kishiyama, T. Hai, S. Xiaodong, et al., "Trends in small cell enhancements in LTE advanced," IEEE Communications Magazine, vol. 51, pp. 98-105, 2013.

M. Peng, D. Liang, Y. Wei, J. Li, and H. H. Chen, "Self-configuration and self-optimization in LTE-advanced heterogeneous networks," IEEE Communications Magazine, vol. 51, pp. 36-45, 2013.

L. Jorguseski, A. Pais, F. Gunnarsson, A. Centonza, and C. Willcock, "Self-organizing networks in 3GPP: standardization and future trends," IEEE Communications Magazine, vol. 52, pp. 28-34, 2014.

W. Wang, J. Zhang, and Q. Zhang, "Cooperative cell outage detection in Self-Organizing femtocell networks," in INFOCOM, 2013 Proceedings IEEE, 2013, pp. 782-790.

A. Aguilar-Garcia, S. Fortes, M. Molina-García, J. Calle-Sánchez, J.

I. Alonso, A. Garrido, et al., "Location-aware self-organizing methods in femtocell networks," Computer Networks, vol. 93, Part 1, pp. 25-140, 12/24/ 2015.

M. Behjati and J. Cosmas, "Self-organizing network interference coordination for future LTE-advanced networks," in 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), 2013, pp. 1-5.

S. Jia, W. Li, X. Zhang, Y. Liu, and X. Gu, "Advanced Load

Balancing Based on Network Flow Approach in LTE-A Heterogeneous Network," International Journal of Antennas and

Propagation, vol. 2014, p. 10, 2014.

Y. Khan, B. Sayrac, and E. Moulines, "Centralized self-optimization in LTE-A using Active Antenna Systems," in Wireless Days (WD), 2013 IFIP, 2013, pp. 1-3.

Z. Altman, S. Sallem, R. Nasri, B. Sayrac, and M. Clerc, "Particle swarm optimization for Mobility Load Balancing SON in LTE networks," in Wireless Communications and Networking Conference Workshops (WCNCW), 2014 IEEE, 2014, pp. 172-177.

A. L. Yusof, M. A. Zainali, M. T. M. Nasir, and N. Ya'acob,

"Handover adaptation for load balancing scheme in femtocell Long Term Evolution (LTE) network," in Control and System Graduate Research Colloquium (ICSGRC), 2014 IEEE 5th, 2014, pp. 242-246.

K. Lee, S. Kim, S. Lee, and J. Ma, "Load balancing with transmission power control in femtocell networks," in Advanced Communication Technology (ICACT), 2011 13th International Conference on, 2011, pp. 519-522.

L. Bu, oniu, R. B. $$ka, and B. D. Schutter, "A Comprehensive Survey of Multiagent Reinforcement Learning," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 38, pp. 156-172, 2008.

E. Bikov and D. Botvich, "Multi-agent Learning for Resource Allocationn Dense Heterogeneous 5G Network," in 2015 International Conference on Engineering and Telecommunication (EnT), 2015, pp. 1-6.

I. S. Com, x015F, M. Aydin, S. Zhang, P. Kuonen, and J. F. Wagen, "Reinforcement learning based radio resource scheduling in LTEadvanced," in Automation and Computing (ICAC), 2011 7th International Conference on, 2011, pp. 219-224.

J. Moysen and L. Giupponi, "A Reinforcement Learning Based Solution for Self-Healing in LTE Networks," in 2014 IEEE 80th Vehicular Technology Conference (VTC2014-Fall), 2014, pp. 1-6.

O. Iacoboaiea, B. Sayrac, S. B. Jemaa, and P. Bianchi, "SON Coordination for parameter conflict resolution: A reinforcement learning framework," in Wireless Communications and Networking Conference Workshops (WCNCW), 2014 IEEE, 2014, pp. 196-201.

A. Giovanidis, L. Qi, and S. Stańczaky, "A distributed interferenceaware load balancing algorithm for LTE multi-cell networks," in 2012 International ITG Workshop on Smart Antennas (WSA), 2012, pp. 28-35.

H. Zhang, X. s. Qiu, L. m. Meng, and X. d. Zhang, "Achieving distributed load balancing in self-organizing LTE radio access network with autonomic network management," in 2010 IEEE Globecom Workshops, 2010, pp. 454-459.

K. M. Ronoh, A., "Load Balancing in Heterogeneous LTE-A

Networks," Linköping University, 2012.

A. Lobinger, S. Stefanski, T. Jansen, and I. Balan, "Load Balancing in Downlink LTE Self-Optimizing Networks," in 2010 IEEE 71st Vehicular Technology Conference, 2010, pp. 1-5.

Z. Li, H. Wang, Z. Pan, N. Liu, and X. You, "Joint optimization on load balancing and network load in 3GPP LTE multi -cell networks," in 2011 International Conference on Wireless Communications and Signal Processing (WCSP), 2011, pp. 1-5.

3GPP, "“Small cell enhancements for E-UTRA and E-UTRAN —Physical layer aspects (Release 12)”," 3GPP, vol. TR 36.872

(v12.1.0), Dec. 2013.

Downloads

Published

2017-01-01

How to Cite

Musleh, S., Ismail, M., & Nordin, R. (2017). Load Balancing Models based on Reinforcement Learning for Self-Optimized Macro-Femto LTE-Advanced Heterogeneous Network. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(1), 47–54. Retrieved from https://jtec.utem.edu.my/jtec/article/view/1050

Most read articles by the same author(s)

Similar Articles

You may also start an advanced similarity search for this article.