A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Formany years,researchers have explored power allocation(PA)algorithms driven bymodels in wireless networks where multiple-user communications with interference are present.Nowadays,data-driven machine learning methods have become quite popular in analyzing wireless communication systems,which among them deep reinforcement learning(DRL)has a significant role in solving optimization issues under certain constraints.To this purpose,in this paper,we investigate the PA problem in a k-user multiple access channels(MAC),where k transmitters(e.g.,mobile users)aim to send an independent message to a common receiver(e.g.,base station)through wireless channels.To this end,we first train the deep Q network(DQN)with a deep Q learning(DQL)algorithm over the simulation environment,utilizing offline learning.Then,the DQN will be used with the real data in the online training method for the PA issue by maximizing the sumrate subjected to the source power.Finally,the simulation results indicate that our proposedDQNmethod provides better performance in terms of the sumrate compared with the available DQL training approaches such as fractional programming(FP)and weighted minimum mean squared error(WMMSE).Additionally,by considering different user densities,we show that our proposed DQN outperforms benchmark algorithms,thereby,a good generalization ability is verified over wireless multi-user communication systems.

An Achievable Rate Region for the Asynchronous Multiple Access Channel with Feedback

An achievable rate region for the asynchronous multiple access channel with feedback is established through the use of superposition coding, list decoding and time sharing. The calculation results demonstrate that lack of synchronization does not affect the achievable rate region when the code block length tends to infinity, and that if the length of the code word is finite, especially not sufficiently larger than a fixed maximal delay, the asynchronization will cause a loss of the rate region. The amount of such a loss with its explanation for the reason is given, and the difference between the losses for the asynchronous multiple access channel with and without feedback is also discussed in this paper.

Cooperative multiple access channels: Achievable rates and optimal resource allocation

We investigate the multiple access channels （MAC） where sources can cooperate via half-duplex relaying and refer to it as cooperative MAC channels （CMAC）. Assuming perfect channel state information （CSI） at the transmitters and the receivers, we determine the bounds on the achievable rate region of a Gaussian CMAC channel and an inner bound on the outage capacity region of a fading CMAC channel. Based on superposition modulation, a half-duplex cooperative relay scheme with optimal resource allocation is proposed to achieve the bounds of capacity region. Analytical results and simulation results show that the achievable rate region of a Gaussian CMAC channel is larger than that of a Gaussian MAC channel with direct transmission （DT） schemes. But they have the same achievable sum rate. Moreover, the proposed scheme can provide higher outage capacity region than DT schemes in a fading MAC channel due to the fact that sources can share the resources with each other to reduce outages.

Network coding with diversity and outdated channel state information

Physical-layer network coding （PNC） has the potential to significantly improve the throughput of wireless networks where the channels can be modeled as additive white Gaussian noise （AWGN） channel. As extending to mul- tiple channels, this technique requires both amplitude and phase compensation at each transmitter and will lead to inef- ficient systems yielding no diversity even with perfect channel state information （CSI）. In order to avoid these limita- tions, we apply network coding with diversity （NCD） to achieve a form of selection diversity and extend NCD to coop- erative multiple access channels in this paper. However, in practical wireless communication systems, the CSI could become outdated due to the difference between the CSI used in the relay selection and data transmission phases. Hence, the selected relay may not be the best one during data transmission phase due to the dynamic change in the wireless channels. Therefore, we first explore the relation between the present and past CSIs. Exploiting this relationship, the NCD scheme with outdated CSI is investigated based on the past CSI. To evaluate the performance of this scheme, an information-theoretic metric, namely the outage capacity, is studied under this condition.

Statistical-mechanical analysis of multiuser channel capacity with imperfect channel state information

In this paper, the effect of imperfect channel state information at the receiver, which is caused by noise and other interference, on the multi-access channel capacity is analysed through a statistical-mechanical approach. Replica analyses focus on analytically studying how the minimum mean square error （MMSE） channel estimation error appears in a multiuser channel capacity formula. And the relevant mathematical expressions are derived. At the same time, numerical simulation results are demonstrated to validate the Replica analyses. The simulation results show how the system parameters, such as channel estimation error, system load and signal-to-noise ratio, affect the channel capacity.

An Information Theory Approach to the Data Compression and Imaging System for Synthetic Aperture Radar （SAR）

Synthetic aperture radar (SAR) is portrayed as a multiple access channel. An information theory approach is applied to the SAR imaging system, and the information content about a target that can be extracted from its radar image is evaluated by the average mutual information measure. A conditional (transition) probability density function (PDF) of the SAR imaging system is derived by analyzing the system and a closed form of the information content is found. It is shown that the information content obtained by the SAR imaging system from an independent sample of echoes will decrease and the total information content obtained by the SAR imaging system will increase with an increase in the number of looks. Because the total average mutual information is also used to define a measure of radiometric resolution for radar images, it is shown that the radiometric resolution of a radar image of terrain will be improved by spatial averaging. In addition, the imaging process and the data compression process for SAR are each treated as an independent generalized communication channel. The effects of data compression upon radiometric resolution for SAR are studied and some conclusions are obtained.

On the MAC-BC duality of multiuser non-regenerative MIMO relay systems

Multiple input multiple output （MIMO） relaying techniques can greatly improve the spectral efficiency and extend network coverage for future wireless systems. This article investigates a multiuser MIMO relay channel, where a base station （BS） with multiple antennas communicates with multiple mobile stations （MS） via a relay station （RS） with multiple antennas. The RS applies linear processing to the received signal and then forwards the processed signal. The dual channel conditions between MIMO relay multiple access channel （MAC） and broadcast channel （BC） are first developed for single-relay scenario with white Gaussian noise. Then the MAC-BC duality for MIMO relay systems is established by proving that the capacity region of MIMO relay MAC is equal to that of dual MIMO relay BC under the same total network transmit power constraint. In addition, the duality is also extended to multi-relay scenario with arbitrary noise. Finally, several simple general numerical examples are provided to better illustrate the effectiveness of the MIMO relay MAC-BC duality.

Analysis of Outage Capacity of NOMA： SIC vs. JD

In fifth-generation wireless communication networks, Non-Orthogonal Multiple Access（NOMA） has attracted much attention in both academic and industrial fields because of its higher spectral efficiency in comparison with orthogonal multiple access. Recently, numerous uplink NOMA techniques have been proposed,some of which are based on Successive Interference Cancellation（SIC） and others on Joint Decoding（JD, or simultaneous decoding）. In this study, we analyze the outage capacities of SIC and JD in the case of single-block transmission over a two-user Gaussian multiple-access channel with partial channel state information at transmitter from the perspective of information theory. Results of the analysis and numerals show that compared to SIC, JD can achieve a sum-rate gain of up to 10% or sum-power gain of 0.8 dB.