A Deep Reinforcement Learning-Based Power Control Scheme for the 5G Wireless Systems

In the fifth generation(5G)wireless system,a closed-loop power control(CLPC)scheme based on deep Q learning network(DQN)is introduced to intelligently adjust the transmit power of the base station(BS),which can improve the user equipment(UE)received signal to interference plus noise ratio(SINR)to a target threshold range.However,the selected power control(PC)action in DQN is not accurately matched the fluctuations of the wireless environment.Since the experience replay characteristic of the conventional DQN scheme leads to a possibility of insufficient training in the target deep neural network(DNN).As a result,the Q-value of the sub-optimal PC action exceed the optimal one.To solve this problem,we propose the improved DQN scheme.In the proposed scheme,we add an additional DNN to the conventional DQN,and set a shorter training interval to speed up the training of the DNN in order to fully train it.Finally,the proposed scheme can ensure that the Q value of the optimal action remains maximum.After multiple episodes of training,the proposed scheme can generate more accurate PC actions to match the fluctuations of the wireless environment.As a result,the UE received SINR can achieve the target threshold range faster and keep more stable.The simulation results prove that the proposed scheme outperforms the conventional schemes.

An Uplink Power Control Scheme in CDMA Mobile Communication System

A brief introduction of principles and algorithm realization of uplink power control in CDMA mobile communication system based on IS 95 are given, and then the blocking probability and Erlang capacity under the condition of perfect and imperfect uplink power control are presented and analyzed. Finally the uplink power control algorithms are simulated, and the optimum uplink power control algorithm that maximizes system Erlang capacity is acquired.

DS-CDMA system outer loop power control and improvement for multi-service

When a new user accesses the CDMA system, the load will change drastically, and therefore, the advanced outer loop power control （OLPC） technology has to be adopted to enrich the target signal interference ratio （Silt） and improve the system performance. The existing problems about DS-CDMA outer loop power control for multi-service are introduced and the power control theoretical model is analyzed. System simulation is adopted on how to obtain the theoretical performance and parameter optimization of the power control algorithm. The OLPC algorithm is improved and the performance comparisons between the old algorithm and the improved algorithm are given. The results show good performance of the improved OLPC algorithm and prove the validity of the improved method for multi-service.

Distributed robust power control in two-tier vehicle networks under uncertain channel environments

This paper proposes a novel optimization scheme to support stable and reliable vehicle-to-everything connections in two-tier networks,where the uplink channel of the cellular user is reused by underlay vehicle-to-vehicle communications.However,considering complex channel fading and high-speed vehicle movement,the cer-tainty assumption is impractical and fails to maintain power control strategy in reality in the traditional statical vehicular networks.Rather than the perfect channel state information assumption,the first-order Gauss-Markov process which is a probabilistic model affected by vehicle speed and fading is introduced to describe imperfect channel gains.Moreover,interference management is a major challenge in reusing communications,especially in uncertain channel environments.Power control is an effective way to realize interference management,and optimal power allocation can ensure that interference of the user meets the communication requirements.In this study,the sum-rate-oriented power control scheme and minimum-rate-oriented power control scheme were implemented to manage interference and satisfy different design objectives.Since both of these schemes are non-convex and intractable,the Bernstein approximation and successive convex approximation methods were adopted to transform the original problems into convex ones.Furthermore,a novel distributed robust power control al-gorithm was developed to determine the optimal solutions.The performance of the algorithm was evaluated through numerical simulations,and the results indicate that the proposed algorithm is effective in vehicular communication networks with uncertain channel environments.

A novel fractional uplink power control framework for self-organizing networks

Internet of things and network densification bring significant challenges to uplink management.Only depending on optimization algorithm enhancements is not enough for uplink transmission.To control intercell interference,Fractional Uplink Power Control(FUPC)should be optimized from network-wide perspective,which has to find a better traffic distribution model.Conventionally,traffic distribution is geographic-based,and ineffective due to tricky locating efforts.This paper proposes a novel uplink power management framework for Self-Organizing Networks(SON),which firstly builds up pathloss-based traffic distribution model and then makes the decision of FUPC based on the model.PathLoss-based Traffic Distribution(PLTD)aggregates traffic based on the propagation condition of traffic that is defined as the pathloss between the position generating the traffic and surrounding cells.Simulations show that the improvement in optimization efficiency of FUPC with PLTD can be up to 40%compared to conventional GeoGraphic-based Traffic Distribution(GGTD).

Development of a power control system for AUVs probing for underwater mineral resources

Valuable mineral resources are widely distributed throughout the seabed. autonomous underwater vehicles (AUVs) are preferable to remotely-operated vehicles (ROVs) when probing for such mineral resources as the extensive exploration area makes it difficult to maintain contact with operators. AUVs depend on batteries, so their power consumption should be reduced to extend exploration time. Power for conventional marine instrument systems is incorporated in their waterproof sealing. External intermittent control of this power source until termination of exploration is challenging due to limitations imposed by the underwater environment. Thus, the AUV must have a power control system that can improve performance and maximize use of battery capacity. The authors developed such a power control system with a three-step algorithm. It automatically detects underwater operational states and can limit power, effectively decreasing power consumption by about 15%.

Joint Power Control Algorithm for CDMA TDD System

Current uplink power control algorithm of code division multiple access （CDMA） time division duplex（TDD） system contains signal-to-interference-ratio（SIR） and interference measurement, which is based on history information. However, the adjustment of transmission power of one user equipment（UE） will affect SIR of the others, because the power control is done independently of the power adjustment of other UE＇s. So the convergence speed of power control is not fast and the system performance degrades. In the proposed algorithm, all UE＇s assigned in same time slot adjust their transmission power based on current information, which takes into account the adjustments of transmission power of all UE＇s. The simulation results indicated that the proposed algorithm outperforms the old algorithm.

Receiver Power Allocation and Transmitter Power Control Analysis for Multiple-Receiver Wireless Power Transfer Systems

As different power has its own receivers,this paper analyzes and designs a multiple-receiver wireless power transfer(WPT)system systematically.The equivalent circuit model of the system is established to analyze the key parameters including transmitter power,receiver power,transmission efficiency,and each receiver power allocation.A control circuit is proposed to achieve the maximum transmission efficiency and transmitter power control and arbitrary receiver power allocation ratios for different receivers.Through the proposed control circuit,receivers with different loads can allocate appropriate power according to its power demand,the transmitter power and system efficiency do not vary with the change of the number of receivers.Finally,this control circuit is validated using a 130-kHz WPT system with three receivers whose power received is 3:10:12,and the overall system efficiency can reach as high as 55.5%.

Design of power controller in CDMA system with power and SIR error minimization

In this paper, an uplink power control problem is considered for code division multiple access （CDMA） systems. A distributed algorithm is proposed based on linear quadratic optimal control theory. The proposed scheme minimizes the sum of the power and the error of signal-to-interference ratio （SIR）. A power controller is designed by constructing an optimization problem of a stochastic linear quadratic type in Krein space and solving a Kalman filter problem.

Joint power control based on service factor for code division multiple access system

An important feature of the traffic in mobile networks is burstiness. Drawbacks of conventional power control algorithms for time division duplex （TDD）-code division multiple access （CDMA） systems are analyzed. A joint power control algorithm based on service factor is presented to address the TDD-CDMA mobile services in the burst mode according to the Markov modulated Bernoulli process. The joint power control equation is derived. A function model is developed to verify the new algorithm and evaluate its performance. Simulation results show that the new power control algorithm can estimate interference strength more precisely, speed up convergence of power control, and enhance power efficiency and system capacity. It is shown that the proposed algorithm is more robust against link gain changes, and outperforms the reference algorithms.

Uplink Power Control for MIMO-OFDMA Cellular Systems

In this paper, we propose a novel uplink power control algorithm, SMST, for multiple-input multiple-output orthogonal frequency-division multiple access （MIMQ-OFDMA）.We perform an extensive system-level simulation to compare different uplink power control algorithms, including the FPC adopted in 3GPP LTE and LTE-Advanced. Simulations show that SMST adopted in IEEE 802.16m outperforms other algorithms in terms of spectral efficiency, cell-edge performance, interference control, and trade-off control between sector-accumulated throughput and cell-edge user throughput. The SMST performance gain over FPC can be more than 40%

A novel adaptive joint power control algorithm with channel estimation in a CDMA cellular system

Joint power control has advantages of multi-user detection and power control; and it can combat the multi-access interference and the near-far problem. A novel adaptive joint power control algorithm with channel estimation in a CDMA cellular system was designed. Simulation results show that the algorithm can control the power not only quickly but also precisely with a time change. The method is useful for increasing system capacity.

Power control scheme for multiple antenna systems with space-time coding in Rayleigh fading channels

Two optimal power control （PC） schemes under the power constraint for space-time coded multiple input multiple output systems over the flat Rayleigh fading channel with the imperfect channel state information （CSI） are presented. One is based on the minimization of a bit error rate （BER）, and the other is based on the maximization of a fuzzy signal-to-noise ratio. In these schemes, different powers are allocated to individual transmit an- tennas rather than equal power in the conventional one. For the first scheme, the optimal PC procedure is developed. It is shown that the Lagrange multiplier for the constrained optimization in the power control does exist and is unique. A practical iterative algorithm based on Newton＇s method for finding the Lagrange multiplier is proposed. In the second scheme, some existing schemes are included, and a suboptimal PC procedure is developed by means of the asymptotic performance analysis. With this suboptimal scheme, a simple PC calculation formula is provided, and thus the calculation of the PC will be straightforward. Moreover, the suboptimal scheme has the BER performance close to the optimal scheme. Simulation results show that the two PC schemes can provide BER lower than the equal PC and antenna selection scheme under the imperfect CSI.

Performance analysis of CDMA power control system based on fuzzy prediction

Power control is of paramount importance in combating the near-far problem and co-channel interference in a CDMA cellular system. Due to fast fading and ambient interference in a wireless channel, conventional fixed-step power control schemes have difficulty in compensating for the fast fading channel dynamically and in a timely manner. To acquire flexible power regulation in order to maintain required transmission capacity under the given transmission quality requirement, we propose a hybrid power control scheme which makes full use of the simple fuzzy inference rule refined by an operator in the fuzzy control and prediction property from related previous results in Generalized Prediction Control (GPC). In implementation of this strategy, we classify the fading zone into three levels according to the signal-to-noise-rate (SNR) requirement. In each level the power compensation amount varies with fading gradient and the compensation scheme varies as well. The digital results show that adoption of the fuzzy-GPC power regulation scheme has acquired a reasonable performance improvement when compared with fixed-step and fuzzy schemes. According to theoretic analysis and simulation results, we can conclude that under a variational transmission environment, a flexible power regulation scheme such as fuzzy-GPC is easy to adapt to the environment and thus overcomes the near-far effect and multi-access interference effectively.

Advanced in power control for distributed generation system using cooperative algorithms

To develop efficient power control strategies for a distributed generation system in order to improve the overall system efficiency, we propose a cooperative algorithm to analyze and design the controller, in which elements of conventional mathematical optimization algorithms are combined with adaptive dynamic elements drawn from intelligent control theory. In our design, the sequential quadratic programming algorithm was first utilized to obtain an optimal solution for power distribution among multiple units. Fuzzy system was then developed to implement the optimal strategies on the basis of optimal solution. In addition, parameters of the fuzzy system were adapted via a genetic algorithm. Tbe simulation results illustrate that the methodology described is useful for a range of control system designs.

Hierarchical power control for OFDM based LTE system

3 GPP LTE has approved uplink intra-cell power control and defined overload indicator （OI） for uplink inter-cell power contrQ1 to mitigate the inter-cell interference （ICI）, respectively. In this pa- per, we propose a hierarchical power control （ HPC ） scheme where intra-eell and inter-cell power controls interact with each other. The inter-cell power control eommand is generated by radio re- source management （RRM） entity according to the ICI-load model together with the current ICI and served load information. This ICI-load model is proposed as a guideline for coordination among cells to enable the system to approach its system specific interference over thermal noise （IoT） work area. Simulation results show that for HPC scheme, the system＇ s IoT is well controlled to fit its pre-de- fined work area and the power efficiency is improved significantly. Our proposed scheme is also ro- bust to different settings of its inter-cell power control period.

Effectiveness of Optimal Arrangement of the Residences Operated by Reactive Power Control for a Clustered Grid-Interconnected PV System

There is a danger of power generation efficiency decreasing due to voltage increase when clustered residential PV systems are grid-interconnected to a single distribution line. As a countermeasure, installation of the reactive power control of an inverter at each residence has been considered. However, there are not many types of inverters that can operate reactive power control because there are insufficient effects on a low voltage distribution line with low penetration PV with reactive power control. Therefore, it is necessary to consider how to increase generation efficiency with a lower number of inverters. In this paper, four Japanese standard distribution line structures, for example of a residential area on ＂C1＂, where 2,160 residential PV systems are grid-interconnected, are selected. The optimal setting of reactive power control at each residence is computed on the distribution lines with a greedy method.

Joint Centralized Power Control and Cell Sectoring for Interference Management in CDMA Cellular Systems in a 2D Urban Environment

The interference reduction capability of cell sectoring and power control algorithms have been considered separately as means to decrease the interference in Code Division Multiple Access (CDMA) cellular systems. In this paper, we present Switched-Beam (SB) and Rotatable Equal Sectoring (RES) techniques for CDMA cellular systems in a 2D urban environment. In the SB technique by using a number of fixed, independent, or directional antennas we increase the downlink capacity of the CDMA systems. Also in the RES method, the equal sectors of the base stations are rotating together to decrease the inter-cell and intra-cell interferences. Also in this paper we use centralized power control to overcome the near-far problem. Simulation results indicate that the proposed techniques considerably increase the capacity of the CDMA cellular systems compared to ordinary Equal Sectoring (ES) method.

Interference Management for DS-CDMA Systems through Closed-Loop Power Control, Base Station Assignment, and Beamforming

In this paper, we propose a smart step closed-loop power control (SSPC) algorithm and a base station assignment method based on minimizing the transmitter power (BSA-MTP) technique in a direct sequence-code division multiple access (DS-CDMA) receiver with frequency-selective Rayleigh fading. This receiver consists of three stages. In the first stage, with constrained least mean squared (CLMS) algorithm, the desired users’ signal in an arbitrary path is passed and the inter-path interference (IPI) is reduced in other paths in each RAKE finger. Also in this stage, the multiple access interference (MAI) from other users is reduced. Thus, the matched filter (MF) can use for more reduction of the IPI and MAI in each RAKE finger in the second stage. Also in the third stage, the output signals from the matched filters are combined according to the conventional maximal ratio combining (MRC) principle and then are fed into the decision circuit of the desired user. The simulation results indicate that the SSPC algorithm and the BSA-MTP technique can significantly reduce the network bit error rate (BER) compared to the other methods. Also, we observe that significant savings in total transmit power (TTP) are possible with our methods.

PCTRAN Westinghouse AP1000 Power Control of Pressurized Water Reactor Using Simulink of MATLAB

This paper introduces the simulation, and controls using Simulink of MATLAB for PCTRAN (Personal Computer Transient Analysis) of the power control system (PWR) type pressurized water reactor of PWR WESTINGHOUSE AP1000. The power controller model produces mathematical model description in nonlinear relation form in Simulink of MATLAB which is an important and popular program used at most universities for education. The power controller is described by a block diagram in this paper and some details introduce to clearly understand the work function. The results of action control compared with the PCTRAN programme in modes of automatic and manual control.