A Deep Reinforcement Learning-Based Power Control Scheme for the 5G Wireless Systems

In the fifth generation(5G)wireless system,a closed-loop power control(CLPC)scheme based on deep Q learning network(DQN)is introduced to intelligently adjust the transmit power of the base station(BS),which can improve the user equipment(UE)received signal to interference plus noise ratio(SINR)to a target threshold range.However,the selected power control(PC)action in DQN is not accurately matched the fluctuations of the wireless environment.Since the experience replay characteristic of the conventional DQN scheme leads to a possibility of insufficient training in the target deep neural network(DNN).As a result,the Q-value of the sub-optimal PC action exceed the optimal one.To solve this problem,we propose the improved DQN scheme.In the proposed scheme,we add an additional DNN to the conventional DQN,and set a shorter training interval to speed up the training of the DNN in order to fully train it.Finally,the proposed scheme can ensure that the Q value of the optimal action remains maximum.After multiple episodes of training,the proposed scheme can generate more accurate PC actions to match the fluctuations of the wireless environment.As a result,the UE received SINR can achieve the target threshold range faster and keep more stable.The simulation results prove that the proposed scheme outperforms the conventional schemes.

Single-Site Indoor Fingerprint Localization Based on MIMO-CSI

In order to achieve higher accuracy and lower cost of indoor localization,we propose a positioning method using multiple input and multiple output(MIMO)channel state information(CSI)as a fingerprint.The method can be divided into three stages,feature extraction,offline training and online localization.In the feature extraction,the segmented average and principal component analysis(PCA)are used to reduce the data dimension and decrease system complexity.In the offline training,the deep neural network(NN)model is trained to implement the position classification.In the online localization,the data are input into the trained NN model first,and then its output is further processed by weighted k-nearest neighbor(WKNN)technology to estimate the position.Experimental results show that the proposed method can significantly reduce the positioning error compared to other methods and the average error is 1.39m in a complex indoor environment.