Channel assignment and power allocation for throughput improvement with PPO in B5G heterogeneous edge networks

In Beyond the Fifth Generation(B5G)heterogeneous edge networks,numerous users are multiplexed on a channel or served on the same frequency resource block,in which case the transmitter applies coding and the receiver uses interference cancellation.Unfortunately,uncoordinated radio resource allocation can reduce system throughput and lead to user inequity,for this reason,in this paper,channel allocation and power allocation problems are formulated to maximize the system sum rate and minimum user achievable rate.Since the construction model is non-convex and the response variables are high-dimensional,a distributed Deep Reinforcement Learning(DRL)framework called distributed Proximal Policy Optimization(PPO)is proposed to allocate or assign resources.Specifically,several simulated agents are trained in a heterogeneous environment to find robust behaviors that perform well in channel assignment and power allocation.Moreover,agents in the collection stage slow down,which hinders the learning of other agents.Therefore,a preemption strategy is further proposed in this paper to optimize the distributed PPO,form DP-PPO and successfully mitigate the straggler problem.The experimental results show that our mechanism named DP-PPO improves the performance over other DRL methods.

Power Allocation for SE Maximization in Uplink Massive MIMO System Under Minimum Rate Constraint

In this paper,we optimize the spectrum efficiency(SE)of uplink massive multiple-input multiple-output(MIMO)system with imperfect channel state information(CSI)over Rayleigh fading channel.The SE optimization problem is formulated under the constraints of maximum power and minimum rate of each user.Then,we develop a near-optimal power allocation(PA)scheme by using the successive convex approximation(SCA)method,Lagrange multiplier method,and block coordinate descent(BCD)method,and it can obtain almost the same SE as the benchmark scheme with lower complexity.Since this scheme needs three-layer iteration,a suboptimal PA scheme is developed to further reduce the complexity,where the characteristic of massive MIMO(i.e.,numerous receive antennas)is utilized for convex reformulation,and the rate constraint is converted to linear constraints.This suboptimal scheme only needs single-layer iteration,thus has lower complexity than the near-optimal scheme.Finally,we joint design the pilot power and data power to further improve the performance,and propose an two-stage algorithm to obtain joint PA.Simulation results verify the effectiveness of the proposed schemes,and superior SE performance is achieved.

A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Formany years,researchers have explored power allocation(PA)algorithms driven bymodels in wireless networks where multiple-user communications with interference are present.Nowadays,data-driven machine learning methods have become quite popular in analyzing wireless communication systems,which among them deep reinforcement learning(DRL)has a significant role in solving optimization issues under certain constraints.To this purpose,in this paper,we investigate the PA problem in a k-user multiple access channels(MAC),where k transmitters(e.g.,mobile users)aim to send an independent message to a common receiver(e.g.,base station)through wireless channels.To this end,we first train the deep Q network(DQN)with a deep Q learning(DQL)algorithm over the simulation environment,utilizing offline learning.Then,the DQN will be used with the real data in the online training method for the PA issue by maximizing the sumrate subjected to the source power.Finally,the simulation results indicate that our proposedDQNmethod provides better performance in terms of the sumrate compared with the available DQL training approaches such as fractional programming(FP)and weighted minimum mean squared error(WMMSE).Additionally,by considering different user densities,we show that our proposed DQN outperforms benchmark algorithms,thereby,a good generalization ability is verified over wireless multi-user communication systems.

Channel Capacity and Power Allocation of MIMO Visible Light Communication System

In this paper,the channel capacity of the multiple-input multiple-output(MIMO)visible light communication(VLC)system is investigated under the peak,average optical and electrical power constraints.Finding the channel capacity of MIMO VLC is shown to be a mixed integer programming problem.To address this open problem,we propose an inexact gradient projection method to find the channel capacity-achieving discrete input distribution and the channel capacity of MIMO VLC.Also we derive both upper and lower bounds of the capacity of MIMO VLC with the closed-form expressions.Furthermore,by considering practical discrete constellation inputs,we develop the optimal power allocation scheme to maximize transmission rate of MIMO VLC system.Simulation results show that more discrete points are needed to achieve the channel capacity as SNR increases.Both the upper and lower bounds of channel capacity are tight at low SNR region.In addition,comparing the equal power allocation,the proposed power allocation scheme can significantly increase the rate for the low-order modulation inputs.

Joint target assignment and power allocation in the netted C-MIMO radar when tracking multi-targets in the presence of self-defense blanket jamming

The netted radar system(NRS)has been proved to possess unique advantages in anti-jamming and improving target tracking performance.Effective resource management can greatly ensure the combat capability of the NRS.In this paper,based on the netted collocated multiple input multiple output(CMIMO)radar,an effective joint target assignment and power allocation(JTAPA)strategy for tracking multi-targets under self-defense blanket jamming is proposed.An architecture based on the distributed fusion is used in the radar network to estimate target state parameters.By deriving the predicted conditional Cramer-Rao lower bound(PC-CRLB)based on the obtained state estimation information,the objective function is formulated.To maximize the worst case tracking accuracy,the proposed JTAPA strategy implements an online target assignment and power allocation of all active nodes,subject to some resource constraints.Since the formulated JTAPA is non-convex,we propose an efficient two-step solution strategy.In terms of the simulation results,the proposed algorithm can effectively improve tracking performance in the worst case.

Power Allocation and Antenna Selection for Heterogeneous Cellular Networks

In this paper,we investigate the system performance of a heterogeneous cellular network consisting of a macro cell and a small cell,where each cell has one user and one base station with multiple antennas.The macro base station(MBS)and the small base station(SBS)transmit their confidential messages to the macro user(MU)and the small user(SU)over their shared spectrum respectively.To enhance the system sum rate(SSR)of MBS-MU and SBS-SU transmission,we propose joint antenna selection combined with optimal power allocation(JAS-OPA)scheme and independent antenna selection combined with optimal power allocation(IAS-OPA)scheme.The JAS-OPA scheme requires to know the channel state information(CSI)of transmission channels and interference channels,while the IAS-OPA scheme only needs to know the CSI of transmission channels.In addition,we carry out the analysis for conventional round-robin antenna selection combined with optimal power allocation(RR-OPA)as a benchmark scheme.We formulate the SSR maximization problem through the power allocation between MBS and SBS and propose iterative OPA algorithms for JAS-OPA,IAS-OPA and RR-OPA schemes,respectively.The results show that the OPA schemes outperform the equal power allocation in terms of SSR.Moreover,we provide the closed-form expression of the system outage probability(SOP)for IAS scheme and RR scheme,it shows the SOP performance can be significantly improved by our proposed IAS scheme compared with RR scheme.

An RVT-based power allocation method for dynamic LEO-MEO links

Optimizing the power resources allocation method of low earth orbit(LEO)satellites to medium earth orbit(MEO)satellite'links is a significant way to construct efficient satellite constellations for satellite communication.A game theory power allocation method based on remaining visible time(RVT)of LEO-MEO satellites is proposed.Firstly,one LEO-MEO satellite network is classified as a cluster in which the RVT of LEO satellites is modeled.Secondly,the cost function of RVT concerning the character of orbit and throughput in each LEO satellite is mainly designed,which gives greater punishment of utility value to LEO satellites with less RVT and is an essential part of the reasonable utility function applied in diverse motion scenes.Meanwhile,the existence of Nash equilibrium for the proposed utility function in game theory area is proved.Thirdly,an off-cluster scheme for LEO satellites through the proposed threshold is raised to ensure the overall utility value of the whole LEO satellites in cluster.Finally,the performance improvement of the proposed algorithm to the baseline algorithm is verified through simulations in different scenarios.

Joint UAV 3D deployment and sensor power allocation for energy-efficient and secure data collection

Unmanned aerial vehicles(UAVs) are advantageous for data collection in wireless sensor networks(WSNs) due to its low cost of use,flexible deployment,controllable mobility,etc. However,how to cope with the inherent issues of energy limitation and data security in the WSNs is challenging in such an application paradigm. To this end,based on the framework of physical layer security,an optimization problem for maximizing secrecy energy efficiency(EE) of data collection is formulated,which focuses on optimizing the UAV’s positions and the sensors’ transmit power. To overcome the difficulties in solving the optimization problem,the methods of fractional programming and successive convex approximation are then adopted to gradually transform the original problem into a series of tractable subproblems which are solved in an iterative manner. As shown in simulation results,by the joint designs in the spatial domain of UAV and the power domain of sensors,the proposed algorithm achieves a significant improvement of secrecy EE and rate.

Cooperative Relaying in a Three User Downlink NOMA System Using Dynamic Power Allocation

Non-orthogonal multiple access(NOMA)represents the latest addition to the array of multiple access techniques,enabling simultaneous servicing of multiple users within a singular resource block in terms of time,frequency,and code.A typical NOMA configuration comprises a base station along with proximate and distant users.The proximity users experience more favorable channel conditions in contrast to distant users,resulting in a compromised performance for the latter due to the less favorable channel conditions.When cooperative communication is integrated with NOMA,the overall system performance,including spectral efficiency and capacity,is further elevated.This study introduces a cooperative NOMA setup in the downlink,involving three users,and employs dynamic power allocation(DPA).Within this framework,User 2 acts as a relay,functioning under the decode-and-forward protocol,forwarding signals to both User 1 and User 3.This arrangement aims to bolster the performance of the user positioned farthest from the base station,who is adversely affected by weaker channel conditions.Theoretical and simulation outcomes reveal enhancements within the system’s performance.

Energy Efficient Power Allocation for Relay-Aided D2D Communications in 5G Networks

As one of the key technologies for the fifth generation(5G) wireless networks,device-to-device(D2D) communications allow user equipment(UE) in close proximity to communicate with each other directly.Forwarded by a relay,the relay-aided D2D(RA-D2D) communications can not only be applied to communications in much longer distance but also achieve a high quality of service(Qo S) .In this paper,we first propose a two-layer system model allowing RA-D2 D links to underlay traditional cellular uplinks.Then we maximize the energy efficiency of the RA-D2 D link while satisfying the minimum data-rate of the cellular link.The optimal transmit power at both D2 D transmitter and D2 D relay sides is obtained by transforming the nonlinear fractional programming into a nonlinear parameter programming.Simulation results show that our proposed power allocation method is more energy efficient than the existing works,and the proposed RA-D2 D scheme outperformed direct D2 D scheme when the distance between two D2 D users is longer.

Power Allocation and Performance Analysis of the Collaborative NOMA Assisted Relaying Systems in 5G

Serving multiple cell-edge mobile terminals poses multifaceted challenges due to the increased transmission power and interferences, which could be overcome by relay communications. With the recent advancement of 5G technologies, non-orthogonal multiple access(NOMA) has been used at relay node to transmit multiple messages simultaneously to multiple cell-edge users. In this paper, a Collaborative NOMA Assisted Relaying(CNAR) system for 5G is proposed by enabling the collaboration of source-relay(S-R) and relay-destination(R-D) NOMA links. The relay node of the CNAR decodes the message for itself from S-R NOMA signal and transmits the remaining messages to the multiple cell-edge users in R-D link. A simplified-CNAR(S-CNAR) system is then developed to reduce the relay complexity. The outage probabilities for both systems are analyzed by considering outage behaviors in S-R and R-D links separately. To guarantee the data rate, the optimal power allocation among NOMA users is achieved by minimizing the outage probability. The ergodic sum capacity in high SNR regime is also approximated. Our mathematical analysis and simulation results show that CNAR system outperforms existing transmission strategies and S-CNAR reaches similar performance with much lower complexity.

Spectral Efficiency and Power Allocation for Mixed-ADC Massive MIMO System

This paper investigates the achievable uplink spectral efficiency(SE) of a massive multi-input multi-output(MIMO) system with a mixed analog-to-digital converter(ADC) receiver architecture, in which some antennas are equipped with full-resolution ADCs while others are deployed with low-resolution ADCs. We derive the theoretical results and corresponding approximate expressions of the achievable SE in multi-cell systems with maximum ratio combining(MRC) detector and in single-cell systems with zero-forcing(ZF) detector. Based on approximated results, the effects of physical parameters, including the transmit power, the number of antennas, the proportion of full-resolution ADCs and the quantization precision of the low-resolution ADCs on the achievable SE are revealed. Furthermore, we propose the power allocation algorithms based on the lower bound and upper bound of approximate achievable SE. Our results show that the total achievable SE improves by increasing the number of BS antennas, the signal-to-noise ratio(SNR), and the quantization precision. Results showcase that proposed power allocation algorithms remarkably improve the total achievable SE comparing to the equal power allocation algorithm, which verifies the effectiveness of our proposed schemes.

User Association and Power Allocation for UAV-Assisted Networks: A Distributed Reinforcement Learning Approach

Unmanned aerial vehicles(UAVs)can be employed as aerial base stations(BSs)due to their high mobility and flexible deployment.This paper focuses on a UAV-assisted wireless network,where users can be scheduled to get access to either an aerial BS or a terrestrial BS for uplink transmission.In contrast to state-of-the-art designs focusing on the instantaneous cost of the network,this paper aims at minimizing the long-term average transmit power consumed by the users by dynamically optimizing user association and power allocation in each time slot.Such a joint user association scheduling and power allocation problem can be formulated as a Markov decision process(MDP).Unfortunately,solving such an MDP problem with the conventional relative value iteration(RVI)can suffer from the curses of dimensionality,in the presence of a large number of users.As a countermeasure,we propose a distributed RVI algorithm to reduce the dimension of the MDP problem,such that the original problem can be decoupled into multiple solvable small-scale MDP problems.Simulation results reveal that the proposed algorithm can yield lower longterm average transmit power consumption than both the conventional RVI algorithm and a baseline algorithm with myopic policies.

Optimal Power Allocation with Limited Feedback of Channel State Information in Multi-User MIMO Systems

In this paper,an expression for the user’s achievable data rate in the multi-user multiple-input multiple-output(MU-MIMO)system with limited feedback(LF)of channel state information(CSI)is derived.The energy efficiency(EE)is optimized through power allocation under quality of service(QoS)constraints.Based on mathematical equivalence and Lagrange multiplier approach,an energy-efficient unequal power allocation(EEUPA)with LF of CSI scheme is proposed.The simulation results show that as the number of transmitting antennas increases,the EE also increases which is promising for the next generation wireless communication networks.Moreover,it can be seen that the QoS requirement has an effect on the EE of the system.Ultimately,the proposed EEUPA with LF of CSI algorithm performs better than the existing energy-efficient equal power allocation(EEEPA)with LF of CSI schemes.

Power Allocation for NOMA in D2D Relay Communications

Non-orthogonal multiple access(NOMA)is considered as one of the key technologies for the fifth generation(5G)wireless communications.The integration of NOMA and device-to-device(D2D)communications has recently attracted wide attention.In this paper,a relaying D2D communications assisted with cooperative relaying systems using NOMA(DRC-NOMA)is considered.We analyze the ergodic sum-rate for the proposed system and then derive the closed-form expressions.In addition,an optimal power allocation strategy maximizing the ergodic sum-rate is proposed based on these analysis results.Numerical results show the good agreement between the results of analysis and Monte Carlo method.The proposed DRC-NOMA has a great improvement of the ergodic sum-rate in the small regime of average channel gain of D2D pair.

Fair subcarrier-power allocation scheme for multiuser multicarrier systems

The main objective of multiuser orthogonal frequency division multiple access(MU-OFDM) is to maximize the total system capacity in wireless communication systems. Thus, the problem in MU-OFDM system is the adaptive allocation of the resources(subcarriers, bits and power) to different users subject to several restrictions to maximize the total system capacity. In this work, a proposed subcarrier allocation algorithm was presented to assign the subcarriers with highest channel gain to the users. After the subcarrier allocation, subcarrier gain-based power allocation(SGPA) was employed for power and bit loading. The simulation results show that the proposed subcarrier-power allocation scheme can achieve high total system capacity and good fairness in allocating the resources to the users with slightly high computational complexity compared to the existing subcarrier allocation algorithms.

Joint Power Allocation and Mode Selection for D2D Communications with Imperfect CSI

Device-to-device(D2D) communications can be underlaid with a cellular infrastructure to increase resource utilization, improve user throughput and save battery energy. In such networks, power allocation and mode selection are crucial problems. To address the joint optimization of power and mode selection under imperfect CSI, we propose an optimal, energy-aware joint power allocation and mode selection(JPAMS) scheme. First, we derive the closed-form solution for the power minimization for both D2 D and cellular links while satisfying different quality of service(Qo S) constraints. Second, we address the mode selection problem in presence of imperfect CSI, based on the derived power allocation. Moreover, the theoretical analysis and simulation results are presented to evaluate the proposed scheme for the D2 D communications.

Joint Optimal Sensing Threshold and Subcarrier Power Allocation in Wideband Cognitive Radio for Minimising Interference to Primary User

Cognitive Radio （CR） can use the fre- quency band allocated to a Primary User （PU） on the premise that it will prevent significant of avoiding causing great interference to the PU. In this paper, we consider a wideband CR system where the Secondary User （SU） mini- raises its interference to the PU by jointly al- locating the optimal sensing threshold and sub- carrier power. A multi-parameter optimization problem is formulated to obtain the joint opt- imal allocation by alternating direction opti- mization, which minimises the total interfer- ence to the PU over all of the subcarriers sub- ject to the constraints on the throughput, Bit Error Rate （BER） and maximal total power of the SU, the subcarrier rate and interference power of the PU, and the false alarm and mis- detection probabilities of each subcarrier. The simulation results show that the proposed joint allocation algorithm can achieve the desired mitigation on the interference to the PU at the different subcarrier gains.

Energy-Efficient Power Allocation for IoT Devices in CR-NOMA Networks

Non-orthogonal multiple access is a promising technique to meet the harsh requirements for the internet of things devices in cognitive radio networks.To improve the energy efficiency(EE)of the unlicensed secondary users(SU),a power allocation(PA)algorithm with polynomial complexity is investigated.We first establish the feasible range of power consumption ratio using Karush-Kuhn-Tucker optimality conditions to support each SU’s minimum quality of service and the effectiveness of successive interference cancellation.Then,we formulate the EE optimization problem considering the total transmit power requirements which leads to a non-convex fractional programming problem.To efficiently solve the problem,we divide it into an inner-layer and outer-layer optimization sub-problems.The inner-layer optimization which is formulated to maximize the sub-carrier PA coefficients can be transformed into the difference of convex programming by using the first-order Taylor expansion.Based on the solution of the inner-layer optimization sub-problem,the concave-convex fractional programming problem of the outer-layer optimization sub-problem may be converted into the Lagrangian relaxation model employing the Dinkelbach algorithm.Simulation results demonstrate that the proposed algorithm has a faster convergence speed than the simulated annealing algorithm,while the average system EE loss is only less than 2%.

SER analysis and power allocation for hybrid cooperative transmission system

The symbol-error-rate（SER） and power allocation for hybrid cooperative（HC） transmission system are investigated.Closed-form SER expression is derived by using the moment generating function（MGF）-based approach.However,the resultant SER contains an MGF of the harmonic mean of two independent random variables（RVs）,which is not tractable in SER analysis.We present a simple MGF expression of the harmonic mean of two independent RVs which avoids the hypergeometric functions used commonly in previous studies.Using the simple MGF,closed-form SER for HC system with M-ary phase shift keying（M-PSK） signals is provided.Further,an approximation as well as an upper bound of the SER is presented.It is shown that the SER approximation is asymptotically tight.Based on the tight SER approximation,the power allocation of the HC system is investigated.It is shown that the optimal power allocation does not depend on the fading parameters of the source-destination（SD） channel and it only depends on the source-relay（SR） and relay-destination（RD） channels.Moreover,the performance gain of the power allocation depends on the ratio of the channel quality between RD and SR.With the increase of this ratio,more performance gain can be acquired.