A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Formany years,researchers have explored power allocation(PA)algorithms driven bymodels in wireless networks where multiple-user communications with interference are present.Nowadays,data-driven machine learning methods have become quite popular in analyzing wireless communication systems,which among them deep reinforcement learning(DRL)has a significant role in solving optimization issues under certain constraints.To this purpose,in this paper,we investigate the PA problem in a k-user multiple access channels(MAC),where k transmitters(e.g.,mobile users)aim to send an independent message to a common receiver(e.g.,base station)through wireless channels.To this end,we first train the deep Q network(DQN)with a deep Q learning(DQL)algorithm over the simulation environment,utilizing offline learning.Then,the DQN will be used with the real data in the online training method for the PA issue by maximizing the sumrate subjected to the source power.Finally,the simulation results indicate that our proposedDQNmethod provides better performance in terms of the sumrate compared with the available DQL training approaches such as fractional programming(FP)and weighted minimum mean squared error(WMMSE).Additionally,by considering different user densities,we show that our proposed DQN outperforms benchmark algorithms,thereby,a good generalization ability is verified over wireless multi-user communication systems.

Cooperative multiple access channels: Achievable rates and optimal resource allocation

We investigate the multiple access channels （MAC） where sources can cooperate via half-duplex relaying and refer to it as cooperative MAC channels （CMAC）. Assuming perfect channel state information （CSI） at the transmitters and the receivers, we determine the bounds on the achievable rate region of a Gaussian CMAC channel and an inner bound on the outage capacity region of a fading CMAC channel. Based on superposition modulation, a half-duplex cooperative relay scheme with optimal resource allocation is proposed to achieve the bounds of capacity region. Analytical results and simulation results show that the achievable rate region of a Gaussian CMAC channel is larger than that of a Gaussian MAC channel with direct transmission （DT） schemes. But they have the same achievable sum rate. Moreover, the proposed scheme can provide higher outage capacity region than DT schemes in a fading MAC channel due to the fact that sources can share the resources with each other to reduce outages.

Hybrid Channel Access Mechanism Based on Coexistence Scenario of NR-Unlicensed

With the rapid development of 5G NR(New Radio),the explosive increment of traffic amount is calling the utilization of unlicensed band.3GPP has proposed LAA(Licensed Assisted Access)to use LTE in unlicensed band and pointed out that NR-U(NR-Unlicensed)can reuse most designs of it.However,the existing channel access mechanism of LAA is conservative under the coexistence scenario of NR-U,which leads to the waste of time resource.To address the problem this paper proposes a hybrid channel access mechanism to take advantage of the LBT(Listen-Before-Talk)mechanism of LAA when channel is quite busy and transmit directly with reduced power when it is relatively idle.The channel busy degree is judged by a series of periodically updated adaptive thresholds.System-level simulation verifies that under the coexistence scenario of NR-U the proposed mechanism can achieve higher UPT(User Perceived Throughput)and lower delay than other channel access mechanisms.

Cross-Layer Framework for Fine-Grained Channel Access in Next Generation High-Density Wi Fi Networks

Densely deployed Wi Fi networks will play a crucial role in providing the capacity for next generation mobile internet. However, due to increasing interference, overlapped channels in Wi Fi networks and throughput efficiency degradation, densely deployed Wi Fi networks is not a guarantee to obtain higher throughput. An emergent challenge is how to effi ciently utilize scarce spectrum resources, by matching physical layer resources to traffi c demand. In this aspect, access control allocation strategies play a pivotal role but remain too coarse-grained. As a solution, this research proposes a flexible framework for fine-grained channel width adaptation and multi-channel access in Wi Fi networks. This approach, named SFCA(Subcarrier Fine-grained Channel Access), adopts DOFDM(Discontinuous Orthogonal Frequency Division Multiplexing) at the PHY layer. It allocates the frequency resource with a subcarrier granularity, which facilitates the channel width adaptation for multi-channel access and thus brings more fl exibility and higher frequency efficiency. The MAC layer uses a frequencytime domain backoff scheme, which combines the popular time-domain BEB scheme with a frequency-domain backoff to decrease access collision, resulting in higher access probability for the contending nodes. SFCA is compared with FICA(an established access scheme)showing significant outperformance. Finally we present results for next generation 802.11 ac Wi Fi networks.

A Media Access Control Scheme for Service Differentiation in Ad hoc Networks

IEEE 802.11 distributed coordination function(DCF)can alleviate the collision and hidden station problem,but it doesn't differentiate traffic categories(TC).Therefore,it can't provide sufficient quality of service(QoS)support for different TC.Recently,a new contention-based enhanced distributed channel access(EDCA)scheme is proposed which provides a probabilistic QoS support.In this paper,an improved EDCA scheme for service differentiation in ad hoc networks is proposed.In this scheme,signal channel resistance coefficient is used to adjust the contention window(CW).It proves that the scheme provides the traffic differentiation,high throughput and low delay through simulation.

Network coding with diversity and outdated channel state information

Physical-layer network coding （PNC） has the potential to significantly improve the throughput of wireless networks where the channels can be modeled as additive white Gaussian noise （AWGN） channel. As extending to mul- tiple channels, this technique requires both amplitude and phase compensation at each transmitter and will lead to inef- ficient systems yielding no diversity even with perfect channel state information （CSI）. In order to avoid these limita- tions, we apply network coding with diversity （NCD） to achieve a form of selection diversity and extend NCD to coop- erative multiple access channels in this paper. However, in practical wireless communication systems, the CSI could become outdated due to the difference between the CSI used in the relay selection and data transmission phases. Hence, the selected relay may not be the best one during data transmission phase due to the dynamic change in the wireless channels. Therefore, we first explore the relation between the present and past CSIs. Exploiting this relationship, the NCD scheme with outdated CSI is investigated based on the past CSI. To evaluate the performance of this scheme, an information-theoretic metric, namely the outage capacity, is studied under this condition.

Performance analysis of IEEE 802.11e EDCA in wireless LANs

In this paper, we propose an analytical model for the performance evaluation of IEEE 802.1 le enhanced distributed channel access （EDCA）. Different from most previous analytical studies based on the saturation assumption, we extend the analytical model to non-saturation conditions. An empty state is introduced into the Markov chain to represent the status of transmission queue being empty. This model can be used to calculate the traffic priority, throughput, and MAC layer delay with various configurations of contention parameters. A detailed simulation is provided to validate the proposed model. With the help of this model, the contention parameters can be configured appropriately to achieve specific quality-of-service （QoS） requirements.

Put Others Before Itself:A Multi-Leader One-Follower Anti-Jamming Stackelberg Game Against Tracking Jammer

This paper mainly investigates the coordinated anti-jamming channel access problems in multiuser scenarios where there exists a tracking jammer who senses the spectrum and traces the channel with maximal receiving power.To cope with the challenges brought by the tracking jammer,a multi-leader onefollower anti-jamming Stackelberg(MOAS)game is formulated,which is able to model the complex interactions between users and the tracking jammer.In the proposed game,users act as leaders,chose their channel access strategies and transmit firstly.The tracking jammer acts as the follower,whose objective is to find the optimal jamming strategy at each time slot.Besides,the existence of Stackelberg equilibriums(SEs)is proved,which means users reach Nash Equilibriums(NEs)for each jamming strategy while the jammer finds its best response jamming strategy for the current network access case.An active attraction based anti-jamming channel access(3ACA)algorithm is designed to reach SEs,where jammed users keep their channel access strategies unchanged to create access chances for other users.To enhance the fairness of the system,users will adjust their strategies and relearn after certain time slots to provide access chances for those users who sacrifice themselves to attract the tracking jammer.

Reducing Cyclic Prefix Overhead Based on Symbol Repetition in NB-IoT-Based Maritime Communication

With the increasing maritime activities,a great demand of wide-area maritime digital data services is needed.Therefore,Narrowband Internet of Things(NB-IoT)that can provide wide coverage has been expected as an application for maritime communication networks(MCNS).In this paper,we aim to enhance the spectral efficiency in NB-IoT by reducing the cyclic prefix(CP)overhead in random access signal without causing interference.The key point of the proposed scheme is the symbols transmitted for multiple times repeatedly in NB-IoT.Specifically,all CP are removed and multi-path fading effect is eliminated by using a repeated symbol to cover the disturbed symbol to construct a circular convolution structure of the channel with the same effect as adding CP.In addition,a single-tap equalization is still appropriate.To validate the effectiveness of the proposed scheme,simulation results are carried out with respect to the bit error ratio(BER).

An Information Theory Approach to the Data Compression and Imaging System for Synthetic Aperture Radar （SAR）

Synthetic aperture radar (SAR) is portrayed as a multiple access channel. An information theory approach is applied to the SAR imaging system, and the information content about a target that can be extracted from its radar image is evaluated by the average mutual information measure. A conditional (transition) probability density function (PDF) of the SAR imaging system is derived by analyzing the system and a closed form of the information content is found. It is shown that the information content obtained by the SAR imaging system from an independent sample of echoes will decrease and the total information content obtained by the SAR imaging system will increase with an increase in the number of looks. Because the total average mutual information is also used to define a measure of radiometric resolution for radar images, it is shown that the radiometric resolution of a radar image of terrain will be improved by spatial averaging. In addition, the imaging process and the data compression process for SAR are each treated as an independent generalized communication channel. The effects of data compression upon radiometric resolution for SAR are studied and some conclusions are obtained.

Network Coding Based on Linear Block Codes for Multi-source Cooperative Relaying Networks

In order to improve link performance of future wireless relay networks,a network coding scheme with linear block codes was proposed,which could be deployed in a relay network consisting of multi-source sending data to a common base station(BS) with the assistance of one relay node.At BS,an iterative decoding structure between one cooperative decoder and a number of single-source decoders was established using the relayed network codes and source codes.Further,the extrinsic information transfer(EXIT) chart technique was used to predict and analyze the convergence behavior of iterative decoder.The analysis and simulation results show that the bit error ratio(BER) performance of the proposed scheme outperforms reference scheme under different relay network coding matrices.Compared with a reference scheme without the multisource cooperation,the proposed scheme can obtain network coding gain from the relay network while not reduce its code rate.

Statistical-mechanical analysis of multiuser channel capacity with imperfect channel state information

In this paper, the effect of imperfect channel state information at the receiver, which is caused by noise and other interference, on the multi-access channel capacity is analysed through a statistical-mechanical approach. Replica analyses focus on analytically studying how the minimum mean square error （MMSE） channel estimation error appears in a multiuser channel capacity formula. And the relevant mathematical expressions are derived. At the same time, numerical simulation results are demonstrated to validate the Replica analyses. The simulation results show how the system parameters, such as channel estimation error, system load and signal-to-noise ratio, affect the channel capacity.

An Achievable Rate Region for the Asynchronous Multiple Access Channel with Feedback

An achievable rate region for the asynchronous multiple access channel with feedback is established through the use of superposition coding, list decoding and time sharing. The calculation results demonstrate that lack of synchronization does not affect the achievable rate region when the code block length tends to infinity, and that if the length of the code word is finite, especially not sufficiently larger than a fixed maximal delay, the asynchronization will cause a loss of the rate region. The amount of such a loss with its explanation for the reason is given, and the difference between the losses for the asynchronous multiple access channel with and without feedback is also discussed in this paper.

The design of accelerator control network analysis system and its application

Purpose The control network,which is a crucial component of the contemporary accelerator control system,connects all servers,workstations,PCs,and instruments at each station to exchange data and share resources.The security and reliability of the network directly affect the operating efficiency of the control system.It is essential to know the technology of packet capture,monitoring,and analysis in order to maintain the accelerator control network's healthy,safe,and dependable functioning.Methods In this article,IMPCAS NetAnalyzer,a novel and general accelerator control network analysis system,is developed using object-oriented C#language,multi-threading technology,as well as the SharpPcap link-layer network access packet capture and filtering engine.Results This system can capture and thoroughly analyze control network protocols,particularly the CA and PVA protocols in EPICS.It summarizes the status of the IOC server along with PV access data.Simultaneously,by importing its IP address information,any accelerator device may generate real-time alarms for irregular access IP.This enables regular accelerator individuals to quickly understand the network's operational status.Conclusion Finally,the system has been tested and validated on two heavy ion accelerator research facilities,SESRI(the Practical Application in Space Environment Simulation and Research Infrastructure)and HIRFL(the Heavy Ion Research Facility in Lanzhou).The results indicate that it achieves the desired aims and serves as a solid foundation for future version development.

Analysis of Outage Capacity of NOMA： SIC vs. JD

In fifth-generation wireless communication networks, Non-Orthogonal Multiple Access（NOMA） has attracted much attention in both academic and industrial fields because of its higher spectral efficiency in comparison with orthogonal multiple access. Recently, numerous uplink NOMA techniques have been proposed,some of which are based on Successive Interference Cancellation（SIC） and others on Joint Decoding（JD, or simultaneous decoding）. In this study, we analyze the outage capacities of SIC and JD in the case of single-block transmission over a two-user Gaussian multiple-access channel with partial channel state information at transmitter from the perspective of information theory. Results of the analysis and numerals show that compared to SIC, JD can achieve a sum-rate gain of up to 10% or sum-power gain of 0.8 dB.

On the MAC-BC duality of multiuser non-regenerative MIMO relay systems

Multiple input multiple output （MIMO） relaying techniques can greatly improve the spectral efficiency and extend network coverage for future wireless systems. This article investigates a multiuser MIMO relay channel, where a base station （BS） with multiple antennas communicates with multiple mobile stations （MS） via a relay station （RS） with multiple antennas. The RS applies linear processing to the received signal and then forwards the processed signal. The dual channel conditions between MIMO relay multiple access channel （MAC） and broadcast channel （BC） are first developed for single-relay scenario with white Gaussian noise. Then the MAC-BC duality for MIMO relay systems is established by proving that the capacity region of MIMO relay MAC is equal to that of dual MIMO relay BC under the same total network transmit power constraint. In addition, the duality is also extended to multi-relay scenario with arbitrary noise. Finally, several simple general numerical examples are provided to better illustrate the effectiveness of the MIMO relay MAC-BC duality.

Two-Level Cross-Talked Admission Control Mechanism for QoS Guarantee in 802.11e EDCA

This paper describes a two-level cross-talked admission control mechanism that guarantees quality of service （QoS） requirements for multimedia applications over wireless local area networks （WLANs）. An enhanced distributed channel access analytical model is used to compute the maximum number of admitted users according to the QoS requirements and the packet arrival characters. Then, some channel resources are reserved for handoff calls based on the maximum number of admitted users and the call-level traffic model. The channel utilization ratio is also measured to reflect the current system traffic load. The maximum number of admitted users and the channel utilization ratio are used for admission control for applications with QoS requirements in the call level and for rate control of best effort applications in the packet level using the p-nonacknowledgement scheme. Thus, the QoS requirements are statistically guaranteed while the system is efficiently utilized. Simulations validate the effectiveness of this mechanism to guarantee the QoS and bandwidth utilization.