Open Access Paper
24 May 2022 Max-min fairness energy efficiency optimization for cognitive networks based on unsupervised deep learning
Yao Huang, Anming Dong, Jiguo Yu, Jing Qiu, Tong Zhang, You Zhou
Author Affiliations +
Proceedings Volume 12260, International Conference on Computer Application and Information Security (ICCAIS 2021); 122600P (2022) https://doi.org/10.1117/12.2637688
Event: International Conference on Computer Application and Information Security (ICCAIS 2021), 2021, Wuhan, China
Abstract
This paper aims to study the power control method for fairness energy efficiency (EE) improvement in cognitive radio networks (CRN) with interference channels, among one primary user (PU) shares the spectrum to multiple secondary users (SUs). The objective is to control the transmit power to maximize the minimum EE among all users subject to the quality of service (QoS) constraints. An extremely challenging non-convex max-min fraction optimization issue given due consideration. This work aims at developing an adaptive solving method based on deep learning (DL) techniques for the max-min EE optimization problem. To achieve such an objective, we construct a deep neural network (DNN), with the channel state information (CSI) being the input of DNN and the transmit power being the output of DNN. However, this faces two challenges. On the one hand, it is difficult to obtain label data. On the other hand, when DNNs are applied, it is very important to consider that QoS constraints should be met. These difficulties are circumvented in our work by designing an unsupervised learning strategy, in which a loss function is devised by combining the max-min EE objective and the QoS constraints via the barrier function method. The effectiveness of our proposed algorithm is ultimately demonstrated by the simulation results.

1.

INTRODUCTION

Due to the ever-growing demand for wireless data transmission, more spectrums are expected to satisfy the future need. However, the scarcity of the spectrum resource poses considerable challenges to spectrum resource allocation and government. To overcome such spectrum shortage problem, the cognitive radio (CR) was introduced to improve the spectrum efficiency by sharing the spectrum resources among multiple users1-3. In general, underlay, overlay and interweave are three different paradigms of CR. They can avail of accessing the spectrum of licensed users simultaneously or the unused spectrum holes opportunistically4-6.

While CR is a promising solution for alleviating the spectrum shortage, its intrinsic characteristics raise some new challenges, the most important of which are the quality of service (QoS) provision and the energy efficiency (EE) improvement7. The challenge of QoS provision is originated partly from the dynamic and random nature of the available spectrum. The sharing of the spectrum of multiple users, especially in underlay mode where shared users transmit data simultaneously on the same spectrum band, will not only raise uncertainty to QoS but also deteriorate the EE. Therefore, special consideration should be given to meeting QoS objectives while maintaining high EE within the transmit power restriction. At present, the objectives of most topics on these EE maximization problems are to optimize global energy efficiency (GEE). Although a high GEE can be obtained after the optimization, the EE distribution among the users is obviously different. Some users gain a sensible lower EE performance compared with others8.

Recently, deep learning (DL) has received great attention in the area of wireless communication9. Although the DL method used9 can effectively improve SE and EE while reducing time complexity, it is more challenging to obtain label data because the DL methods used are all supervised learning. Unsupervised learning does not require label data, which can further improve the feasibility of the algorithm. An unsupervised learning method to maximize the rate is studied10. Experimental results show that it is superior to existing power control methods. Similarly, the DL method is also used in the fairness of wireless communication11-12. They also used unsupervised learning to obtain max-min SE and max-min EE, respectively, and finally, the proposed algorithm can reach the baseline level.

In this paper, a DL-based max-min EE unsupervised learning algorithm in cognitive radio network (CRN) was proposed by us. Expressly, we set SE QoS constraints in PU and SUs, and on this basis, max-min EE. Furthermore, the max-min EE issue under consideration is non-convex as well as challenging to solve. For this reason, a DL-based solution has been proposed by us. A new target function that adds SE constraints to the target term was constructed using our barrier function. The optimized power is output adaptively by inputting CSI. Finally, its effectiveness is verified by simulation.

2.

SYSTEM MODEL, PROBLEM DESCRIPTION AND FORMULATION

2.1

System model

As shown in Figure 1, CRN-based uplink scenario was taken into account. In this scenario, we consider K base stations and K users sharing spectrum in underlay mode. Among them, the base stations and users are single antennae. A user only communicates with a base station, and other links are the interference link. In the CRN we are considering, the primary network is made up of a primary base station together with a PU, and the secondary network is composed of K -1 SUs with K -1 secondary base stations. We use an instantaneous CSI. yk is defined by us as the received discrete-time baseband signal of the k -th base station, in the meanwhile, its representation can be given as

00193_psisdg12260_122600p_page_2_2.jpg

Figure 1.

CRN System model.

00193_psisdg12260_122600p_page_2_1.jpg

among them, k =1 means PU or primary base station. k = 2,…,K represents SUs or secondary base stations. The channel gain is then defined as hkk for the direct link from the k -th user to the k -th base station. Furthermore, the channel gain hkj of the cross-link is expressed as the channel gain from the j -th user towards the k -th base station. The transmission signal of the k -th user is denoted as xk, the received noise of the k -th base station is denoted as 00193_psisdg12260_122600p_page_2_4.jpg. σ2 represents the noise power. The fact that the noise of PU and SUs follows the same distribution is taken into account. The block fading channel is considered by us. The channel coefficient remains constant over a time slot. The difference, however, are that the channel coefficients will vary individually from one-time period to the next. In the underlay model that we take into account, the SU can access the spectrum when the PU can satisfy the threshold.

2.2

Problem description and formulation

Since the application scenario of this article is a CRN, it is necessary to consider the SE constraints of the PU and the SUs to meet QoS. According to equation (1), the SE for the k -th user could by us then be denoted as

00193_psisdg12260_122600p_page_3_1.jpg

Where 00193_psisdg12260_122600p_page_3_2.jpg, the transmitted power of the k -th user could be given as pk ∈ {p1,p2,…,pk}.

The ratio of SEk to power consumption Qk is taken as the definition of the EE from the k -th user, which is given by

00193_psisdg12260_122600p_page_3_4.jpg

among them, ζ ∈ (0,1] represents the power amplifier factor. Pc represents static power consumption.

In this study, the issue of optimizing max-min EE in CRNs is taken into account by us. We try to find the optimal power satisfying the constraint conditions to max-min EE. The problem is defined as

00193_psisdg12260_122600p_page_3_5.jpg

among them, i = argmin(EEj), j = 1,2,…,K. The minimum SE constraint from the k -th user is denoted as SEk,min. Pmax denotes the maximum allowed transmitting power for all users.

In principle, equation (4) is a nonconvex optimization issue13, where obtaining a globally optimal solution to equation (4) is NP-hard. Some traditional optimization algorithms are limited in their use due to their high complexity14. A DL-based algorithm was developed by us to overcome the shortcomings of traditional global optimization to address the max-min EE issue in CRN.

3.

PROPOSED DL-BASED METHOD

3.1

Problem refactoring

In order to solve the equation (4), we rephrase it as

00193_psisdg12260_122600p_page_3_7.jpg

We use the obstacle method as proposed13, and use the SE constraint in (5) as the implicit part of the goal to solve this problem. Specifically, we redefine (5) as15

00193_psisdg12260_122600p_page_4_1.jpg

among them, λ1 and λ2 are the positive control parameters of training. The hyperbolic tangent function is denoted by us as tanh(∙), whose equation expression is 00193_psisdg12260_122600p_page_4_2.jpg. The differentiable function tanh(∙) is employed by us to construct the loss function of the DNN. [∙]+ represent max(∙,0).

3.2

Model design

We use a DNN to solve the equation (6). As shown in Figure 2, we employ multilayer fully connected layers for building the DNN.

Figure 2.

DNN model.

00193_psisdg12260_122600p_page_4_3.jpg

The input layer of the DNN is K * K dimension H, and the output layer output is a K dimensional P. In addition to the input and output layers, there is an L layers hidden layer, which is located between the input as well as the output layers. We use xl–1 to represent the input of l, where l = 1,2,…,L. Output layer with output node number defined as NL+1. xl can be defined as

00193_psisdg12260_122600p_page_4_5.jpg

among them, the weight term, as well as the bias term for the l -th layer from the DNN, are denoted as 00193_psisdg12260_122600p_page_4_6.jpg and 00193_psisdg12260_122600p_page_4_7.jpg respectively. The l -th layer of non-linear activation functions is given as fl. The output layer uses the Sigmoid function to control the output of the DNN from 0 to 1. The output xL+1 of DNN is given as follows

00193_psisdg12260_122600p_page_4_8.jpg

among them, 00193_psisdg12260_122600p_page_4_9.jpg. Equation (6) contains a transmission power constraint, and the transmit power must be limited to [0, Pmax]. Finally, the transmission power Pi of user i is Pi = PmaxxL+1.

3.3

Model training

In addition, the parameters in the DNN need to be adjusted in such a way that the DNN could learn the relationship between the input and output, and Keras could be employed to automate the gradient descent of the DNN as well as to automatically adjust the parameters.

Due to the high complexity of label data acquisition, we use unsupervised learning to build DNN. We redefine the equation (4) to be solved as equation (6), and use a DNN to obtain a sub-optimal solution with less time complexity than traditional methods. In this method, the input CSI of the DNN is 00193_psisdg12260_122600p_page_5_1.jpg, and the output is the power control vector 00193_psisdg12260_122600p_page_5_2.jpg.

According to equation (6), we define the loss function 𝓛(p) of the DNN as

00193_psisdg12260_122600p_page_5_4.jpg

We hope max-min EE because the loss value of DNN needs to be constantly reduced and finally converges, so the negative value of max-min EE is adopted. For the QoS constraint, we use the barrier function. When it meets the QoS constraint, the value of this part is 0. When the QoS constraint is not met, this part will produce a more significant positive value. λ1 and λ2 determine which is more important to max-min EE or satisfy the SE constraint. However, when the value of λ1 is much larger than λ2, it may result in the DNN failing to satisfy the SE constraint. Adam was employed by us as a method of gradient descent for DNN.

4.

SIMULATION AND EXPERIMENTAL RESULTS

The independent identically distributed complex Gaussian distribution was taken into account as the distribution to which the CSI was generated, i.e. 00193_psisdg12260_122600p_page_5_5.jpg. Noise power normalized σ2 = 1. K =4. Both the user side and the base station side are single antenna which is taken into account. Transmission circuit power consumption Pc = 33dBm, maximum transmit power Pmax = 30dBm. Power amplifier efficiency ζ = 0.35. SE threshold SEmin = [0.3,0.1,0.1,0.1] bit/s/Hz. The Adam gradient descent method we employ has the default values of Keras for the parameters β1=0.9, β2 =0.999 and =1e-7, except for the learning rate, which is set to 0.000002. An instantaneous CSI is repeated 104 times to construct a training set, the batch size is set to 50, and it goes through 1000 iterations. λ1 and λ2are set to 1.0 and 1.1 respectively. The number from hidden layers is given as L = 5.50*K is defined as the number of nodes in each layer of the hidden layer in the DNN. All layers except the output layer employ Relu as the activation function. The output layer applies Sig(∙) as the activation function employed to control the output power at [0,1], the value of the output layer output multiplied by Pmax yields the final user transmit power.

After 1000 iterations, the DNN finally converged. Figure 3 represents the min-EE change curve of DNN under different batch sizes. As seen in Figure 3, the min-EE converges fastest when the batch size is 25, and the slowest when the batch size is 200. Figure 4 shows the min-EE performance of the comparative experiment of different algorithms. As seen in Figure 4, there is not much difference between the min-EE obtained from full power and random power. The min-EE obtained by the algorithm aiming at maximizing the SE and maximizing GEE is not as good as other algorithms, and the min-EE is declining. The min-EE of the DNN algorithm we proposed can finally converge to the same level as PSO16. The min-EE converges to around 0.0719 bps/Hz/Joule. The SE of our proposed algorithm when it finally converges is [0.3015 0.1535 0.3490 0.1994] bit/s/Hz. The SE constraint of our proposed algorithm is finally satisfied.

Figure 3.

Convergence curves of min-EE under different batch size.

00193_psisdg12260_122600p_page_5_6.jpg

Figure 4.

Min-EE comparison of different algorithms when K=4.

00193_psisdg12260_122600p_page_5_7.jpg

5.

CONCLUSION

This paper studied the power control method to improve the fairness of EE in the CR interference channel networks, where one PU and multiple SUs share spectrum resources in the underlying model. We propose a fair EE optimization problem that maximizes the minimum EE among all users while satisfying the QoS constraints of the SE. To overcome the difficulty in obtaining the labeled data, we relied on the unsupervised learning strategy when designing the deep learning networks. To train the constructed neural network, we transformed the QoS constraint into a fraction for the loss function through the employment for barrier function approach. The efficiency for the presented algorithm was validated through simulation, indicating that our presented deep learning-based approach achieved similar performance to traditional algorithms.

ACKNOWLEDGMENTS

This work was supported in part by the National Natural Science Foundation of China (NSFC) under Grants 61701269, 61832012 and 61771289, the Program for Youth Innovative Research Team in University of Shandong Province under 2019KJN010, the Fundamental Research Enhancement Program of Computer Science and Technology in Qilu University of Technology (Shandong Academy of Sciences) under Grant 2021JC02014,the Talent Cultivation Promotion Program of Computer Science and Technology in Qilu University of Technology (Shandong Academy of Sciences) under Grant 2021PY05001,the Opening Project of Shanghai Trusted Industrial Control Platform under Grant TICPSH202103018-ZC.

REFERENCES

[1] 

Mitola, J. and Maguire, G. Q., “Cognitive radio: Making software radios more personal,” IEEE Personal Communications, 6 (4), 13 –18 (1999). https://doi.org/10.1109/98.788210 Google Scholar

[2] 

Sboui, L., Rezki, Z. and Alouini, M. S., “Achievable rates of cognitive radio networks using multilayer coding with limited CSI,” IEEE Transactions on Vehicular Technology, 66 (1), 395 –405 (2016). Google Scholar

[3] 

Sboui, L., Ghazzai, H., Rezki, Z., et al, “Precoder design and power allocation for MIMO cognitive radio two-way relaying systems,” IEEE Transactions on Communications, 64 (10), 4111 –4120 (2016). Google Scholar

[4] 

Goldsmith, A., Jafar, S. A., Maric, I., et al, “Breaking spectrum gridlock with cognitive radios: An information theoretic perspective,” in Proceedings of the IEEE, 894 –914 (2009). Google Scholar

[5] 

Hedhly, W., Amin, O. and Alouini, M. S., “Benefits of improper Gaussian signaling in interweave cognitive radio with full and partial CSI,” IEEE Transactions on Cognitive Communications and Networking, 6 (4), 1256 –1268 (2020). https://doi.org/10.1109/TCCN.6687307 Google Scholar

[6] 

Gupta, N. and Jagannatham, A. K., “Transceiver optimization for unicast/multicast MIMO cognitive overlay/underlay networks,” IEEE Signal Processing Letters, 22 (10), 1556 –1560 (2015). https://doi.org/10.1109/LSP.2015.2413940 Google Scholar

[7] 

Jiang, Q., Leung, V. C. M., Pourazad, M. T., et al, “Energy-efficient adaptive transmission of scalable video streaming in cognitive radio communications,” IEEE Systems Journal, 10 (2), 761 –772 (2015). https://doi.org/10.1109/JSYST.2015.2432674 Google Scholar

[8] 

He, S., Huang, Y, Jin, S., et al, “Max-min energy efficient beamforming for multicell multiuser joint transmission systems,” IEEE Communications Letters, 17 (10), 1956 –1959 (2013). https://doi.org/10.1109/LCOMM.2013.082613.131540 Google Scholar

[9] 

Saetan, W. and Thipchaksurat, S., “Power allocation for sum rate maximization in 5G NOMA system with imperfect SIC: A deep learning approach,” in 2019 4th Inter. Conf. on Information Technology (InCIT) IEEE, 195 –198 (2019). Google Scholar

[10] 

Liang, F., Shen, C., Yu, W. and Wu, F., “Power control for interference management via ensembling deep neural networks,” in 2019 IEEE/CIC Inter. Conf. on Communications in China (ICCC) IEEE, 237 –242 (2019). Google Scholar

[11] 

Rajapaksha, N., Manosha, K. B., Rajatheva, N., et al, “Deep learning-based power control for cell-free massive MIMO,” (2021). https://doi.org/10.1109/ICC42927.2021.9500734 Google Scholar

[12] 

Lee, H., Jang, H. S. and Jung, B. C., “Improving energy efficiency fairness of wireless networks: A deep learning approach,” Energies, 12 (22), 4300 (2019). https://doi.org/10.3390/en12224300 Google Scholar

[13] 

Boyd, S., Boyd, S. P. and Vandenberghe, L., “Convex Optimization,” Cambridge University Press, Cambridge (2014). Google Scholar

[14] 

Nguyen, K. G., Tran, L. N., Tervo, O., et al, “Achieving energy efficiency fairness in multicell MISO downlink,” IEEE Communications Letters, 19 (8), 1426 –1429 (2015). https://doi.org/10.1109/LCOMM.2015.2436382 Google Scholar

[15] 

Lee, W., Kim, M. and Cho, D. H., “Transmit power control using deep neural network for underlay device-to-device communication,” IEEE Wireless Communications Letters, 8 (1), 141 –144 (2018). https://doi.org/10.1109/LWC.2018.2864099 Google Scholar

[16] 

Eberhart, R. and Kennedy, J., “A new optimizer using particle swarm theory,” in MHS’95 Proc. of the Sixth Inter. Symp. on Micro Machine and Human Science, 39 –43 (1995). Google Scholar
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Yao Huang, Anming Dong, Jiguo Yu, Jing Qiu, Tong Zhang, and You Zhou "Max-min fairness energy efficiency optimization for cognitive networks based on unsupervised deep learning", Proc. SPIE 12260, International Conference on Computer Application and Information Security (ICCAIS 2021), 122600P (24 May 2022); https://doi.org/10.1117/12.2637688
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Machine learning

Energy efficiency

Computer science

Optimization (mathematics)

Neural networks

Wireless communications

Back to Top