Intelligent Fast Cell Association Scheme Based on Deep Q-Learning in Ultra-Dense Cellular Networks

To support dramatically increased traffic loads,communication networks become ultra-dense.Traditional cell association(CA)schemes are timeconsuming,forcing researchers to seek fast schemes.This paper proposes a deep Q-learning based scheme,whose main idea is to train a deep neural network(DNN)to calculate the Q values of all the state-action pairs and the cell holding the maximum Q value is associated.In the training stage,the intelligent agent continuously generates samples through the trial-anderror method to train the DNN until convergence.In the application stage,state vectors of all the users are inputted to the trained DNN to quickly obtain a satisfied CA result of a scenario with the same BS locations and user distribution.Simulations demonstrate that the proposed scheme provides satisfied CA results in a computational time several orders of magnitudes shorter than traditional schemes.Meanwhile,performance metrics,such as capacity and fairness,can be guaranteed.

Dynamics analysis and cryptographic implementation of a fractional-order memristive cellular neural network model

Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function,a brand-new tristable locally active memristor model is first proposed in this paper.Here,a novel four-dimensional fractional-order memristive cellular neural network(FO-MCNN)model with hidden attractors is constructed to enhance the engineering feasibility of the original CNN model and its performance.Then,its hardware circuit implementation and complicated dynamic properties are investigated on multi-simulation platforms.Subsequently,it is used toward secure communication application scenarios.Taking it as the pseudo-random number generator(PRNG),a new privacy image security scheme is designed based on the adaptive sampling rate compressive sensing(ASR-CS)model.Eventually,the simulation analysis and comparative experiments manifest that the proposed data encryption scheme possesses strong immunity against various security attack models and satisfactory compression performance.

Resource Allocation in Multi-User Cellular Networks:A Transformer-Based Deep Reinforcement Learning Approach

To meet the communication services with diverse requirements,dynamic resource allocation has shown increasing importance.In this paper,we consider the multi-slot and multi-user resource allocation(MSMU-RA)in a downlink cellular scenario with the aim of maximizing system spectral efficiency while guaranteeing user fairness.We first model the MSMURA problem as a dual-sequence decision-making process,and then solve it by a novel Transformerbased deep reinforcement learning(TDRL)approach.Specifically,the proposed TDRL approach can be achieved based on two aspects:1)To adapt to the dynamic wireless environment,the proximal policy optimization(PPO)algorithm is used to optimize the multi-slot RA strategy.2)To avoid co-channel interference,the Transformer-based PPO algorithm is presented to obtain the optimal multi-user RA scheme by exploring the mapping between user sequence and resource sequence.Experimental results show that:i)the proposed approach outperforms both the traditional and DRL methods in spectral efficiency and user fairness,ii)the proposed algorithm is superior to DRL approaches in terms of convergence speed and generalization performance.

Modeling and Performance Analysis of UAV-Aided Millimeter Wave Cellular Networks with Stochastic Geometry

UAV-aided cellular networks,millimeter wave(mm-wave)communications and multi-antenna techniques are viewed as promising components of the solution for beyond-5G(B5G)and even 6G communications.By leveraging the power of stochastic geometry,this paper aims at providing an effective framework for modeling and analyzing a UAV-aided heterogeneous cellular network,where the terrestrial base stations(TBSs)and the UAV base stations(UBSs)coexist,and the UBSs are provided with mm-wave and multi-antenna techniques.By modeling the TBSs as a PPP and the UBSs as a Matern hard-core point pro-´cess of type II(MPH-II),approximated but accurate analytical results for the average rate of the typical user of both tiers are derived through an approximation method based on the mean interference-to-signal ratio(MISR)gain.The influence of some relevant parameters is discussed in detail,and some insights into the network deployment and optimization are revealed.Numerical results show that some trade-offs are worthy of being considered,such as the antenna array size,the altitude of the UAVs and the power control factor of the UBSs.

Jamming-Aided Secure Communication in Ultra-Dense LEO Integrated Satellite-Terrestrial Networks

The ultra-dense low earth orbit(LEO)integrated satellite-terrestrial networks(UDLEO-ISTN)can bring lots of benefits in terms of wide coverage,high capacity,and strong robustness.Meanwhile,the broadcasting and open natures of satellite links also reveal many challenges for transmission security protection,especially for eavesdropping defence.How to efficiently take advantage of the LEO satellite’s density and ensure the secure communication by leveraging physical layer security with the cooperation of jammers deserves further investigation.To our knowledge,using satellites as jammers in UDLEO-ISTN is still a new problem since existing works mainly focused on this issue only from the aspect of terrestrial networks.To this end,we study in this paper the cooperative secrecy communication problem in UDLEOISTN by utilizing several satellites to send jamming signal to the eavesdroppers.An iterative scheme is proposed as our solution to maximize the system secrecy energy efficiency(SEE)via jointly optimizing transmit power allocation and user association.Extensive experiment results verify that our designed optimization scheme can significantly enhance the system SEE and achieve the optimal power allocation and user association strategies.

Outage Probability Analysis for D2D-Enabled Heterogeneous Cellular Networks with Exclusion Zone:A Stochastic Geometry Approach

Interference management is one of the most important issues in the device-to-device(D2D)-enabled heterogeneous cellular networks(HetCNets)due to the coexistence of massive cellular and D2D devices in which D2D devices reuse the cellular spectrum.To alleviate the interference,an efficient interference management way is to set exclusion zones around the cellular receivers.In this paper,we adopt a stochastic geometry approach to analyze the outage probabilities of cellular and D2D users in the D2D-enabled HetCNets.The main difficulties contain three aspects:1)how to model the location randomness of base stations,cellular and D2D users in practical networks;2)how to capture the randomness and interrelation of cellular and D2D transmissions due to the existence of random exclusion zones;3)how to characterize the different types of interference and their impacts on the outage probabilities of cellular and D2D users.We then run extensive Monte-Carlo simulations which manifest that our theoretical model is very accurate.

Anti-jamming channel access in 5G ultra-dense networks: a game-theoretic learning approach

This paper investigates the Quality of Experience(QoE)oriented channel access anti-jamming problem in 5th Generation Mobile Communication(5G)ultra-dense networks.Firstly,considering that the 5G base station adopts beamforming technology,an anti-jamming model under Space Division Multiple Access(SDMA)conditions is proposed.Secondly,the confrontational relationship between users and the jammer is formulated as a Stackelberg game.Besides,to achieve global optimization,we design a local cooperation mechanism for users and formulate the cooperation and competition among users as a local altruistic game.By proving that the local altruistic game is an Exact Potential Game(EPG),we further prove the existence of pure strategy Nash Equilibrium(NE)among users and Stackelberg Equilibrium(SE)between users and jammer.Thirdly,to obtain the equilibrium solutions of the proposed games,we propose an anti-jamming channel selection algorithm and improve its convergence speed through heterogeneous learning parameters.The simulation results validate the convergence and effectiveness of the proposed algorithm.Compared with the throughput optimization scheme,our proposed scheme obtain a greater network satisfaction rate.Finally,we also analyze user fairness changes during the algorithm convergence process and get some interesting conclusions.

Data Aggregation-based Transmission Method in Ultra-Dense Wireless Networks

As the Internet of Things(IoT)advances,machine-type devices are densely deployed and massive networks such as ultra-dense networks(UDNs)are formed.Various devices attend to the network to transmit data using machine-type communication(MTC),whereby numerous,various are generated.MTC devices generally have resource constraints and use wireless communication.In this kind of network,data aggregation is a key function to provide transmission efficiency.It can reduce the number of transmitted data in the network,and this leads to energy saving and reducing transmission delays.In order to effectively operate data aggregation in UDNs,it is important to select an aggregation point well.The total number of transmitted data may vary,depending on the aggregation point to which the data are delivered.Therefore,in this paper,we propose a novel data aggregation scheme to select the appropriate aggregation point and describe the data transmission method applying the proposed aggregation scheme.In addition,we evaluate the proposed scheme with extensive computer simulations.Better performances in the proposed scheme are achieved compared to the conventional approach.

Design of multilayer cellular neural network based on memristor crossbar and its application to edge detection

Memristor with memory properties can be applied to connection points(synapses)between cells in a cellular neural network(CNN).This paper highlights memristor crossbar-based multilayer CNN(MCM-CNN)and its application to edge detection.An MCM-CNN is designed by adopting a memristor crossbar composed of a pair of memristors.MCM-CNN based on the memristor crossbar with changeable weight is suitable for edge detection of a binary image and a color image considering its characteristics of programmablization and compactation.Figure of merit(FOM)is introduced to evaluate the proposed structure and several traditional edge detection operators for edge detection results.Experiment results show that the FOM of MCM-CNN is three times more than that of the traditional edge detection operators.

Cross-Layer Framework for Capacity Analysis in Multiuser Ultra-Dense Networks with Cell DTx

Cell discontinuous transmission(Cell DTx)is a key technology to mitigate inter-cell interference(ICI)in ultra-dense networks(UDNs).The aim of this work is to understand the impact of Cell DTx on physical-layer sum rates of SBSs and link-layer quality-of-service(QoS)performance in multiuser UDNs.In this work,we develop a cross-layer framework for capacity analysis in multiuser UDNs with Cell DTx.In particular,we first extend the traditional one-dimensional effective capacity model to a new multidimensional effective capacity model to derive the sum rate and the effective capacity.Moreover,we propose a new iterative bisection search algorithm that is capable of approximating QoS performance.The convergence of this new algorithm to a unique QoS exponent vector is later proved.Finally,we apply this framework to the round-robin and the max-C/I scheduling policies.Simulation results show that our framework is accurate in approximating 1)queue length distribution,2)delay distribution and 3)sum rates under the above two scheduling policies,and further show that with the Cell DTx,systems have approximately 30% higher sum rate and 35% smaller average delay than those in full-buffer scenarios.

Improved Clustering and Resource Allocation for Ultra-Dense Networks

To reduce the interference among small cells of Ultra-Dense Networks(UDN),an improved Clustering-Assisted Resource Allocation(CARA)scheme is proposed in this paper.The proposed scheme is divided into three steps.First,an Interference-Limited Clustering Algorithm(ILCA)based on interference graph corresponding to the interference relationship between Femtocell Base Stations(FBSs),is proposed to group FBSs into disjoint clusters,in which a pre-threshold is set to constrain the sum of interference in each cluster,and a Cluster Head(CH)is selected for each cluster.Then,CH performs a twostage sub-channel allocation within its associated cluster,where the first stage assigns one sub-channel to each user of the cluster and the second stage assigns a second sub-channel to some users.Finally,a power allocation method is designed to maximize throughput for a given clustering and sub-channel configuration.Simulation results indicate that the proposed scheme distributes FBSs into each cluster more evenly,and significantly improves the system throughput compared with the existing schemes in the same scenario.

Distributionally robust optimization based chance-constrained energy management for hybrid energy powered cellular networks

Energy harvesting has been recognized as a promising technique with which to effectively reduce carbon emis-sions and electricity expenses of base stations.However,renewable energy is inherently stochastic and inter-mittent,imposing formidable challenges on reliably satisfying users'time-varying wireless traffic demands.In addition,the probability distribution of the renewable energy or users’wireless traffic demand is not always fully known in practice.In this paper,we minimize the total energy cost of a hybrid-energy-powered cellular network by jointly optimizing the energy sharing among base stations,the battery charging and discharging rates,and the energy purchased from the grid under the constraint of a limited battery size at each base station.In solving the formulated non-convex chance-constrained stochastic optimization problem,a new ambiguity set is built to characterize the uncertainties in the renewable energy and wireless traffic demands according to interval sets of the mean and covariance.Using this ambiguity set,the original optimization problem is transformed into a more tractable second-order cone programming problem by exploiting the distributionally robust optimization approach.Furthermore,a low-complexity distributionally robust chance-constrained energy management algo-rithm,which requires only interval sets of the mean and covariance of stochastic parameters,is proposed.The results of extensive simulation are presented to demonstrate that the proposed algorithm outperforms existing methods in terms of the computational complexity,energy cost,and reliability.

In Band Full Duplex (IBFD) Technology for Next Generation Wireless Networks: A Survey in Cellular Networks

Next-Generation(NextG)wireless communication networks with their widespread applications require high data rates,seamless connectivity and high quality of service(QoS).To cope up with an unprecedented rise of data hungry applications,users demand more spectral resources imposing a limitation on available wireless spectrum.One of the potential solutions to address the spectrum scarce issue is to incorporate in band full duplex(IBFD)or full duplex(FD)paradigm in next generation networks including 5G new radio(NR).Recently,FD has gained the research interest in cellular networks for its potential to double the wireless link capacity and enhancing spectral efficiency(SE).In half duplex(HD)cellular networks,base stations(BSs)can either perform uplink(UL)or downlink(DL)transmission at a particular time instant leading to reduced throughput levels.Due to the advancement in the self interference reduction(SIR)techniques,full duplex base stations(FD-BSs)can be employed to allow simultaneous UL and DL transmissions at the same time–frequency resources as compared to its HD counterpart.It ideally achieves twice the throughput without any additional complexity at user-equipment(UE).This paper covers a detailed survey on FD cellular networks.A series of SIR approaches,UE-UE mitigation techniques are summarized.Various existing MAC protocols and antenna architectures for FD cellular networks are outlined.An overview of security aspects for FD in cellular networks is also presented.Lastly,various open issues and possible research directions are brought up for FD cellular networks.

Mobility-driven user-centric AP clustering in mobile edge computing-based ultra-dense networks

ultra-Dense Network(UDN)has been envisioned as a promising technology to provide high-quality wireless connectivity in dense urban areas,in which the density of Access Points(APs)is increased up to the point where it is comparable with or surpasses the density of active mobile users.In order to mitigate inter-AP interference and improve spectrum efficiency,APs in UDNs are usually clustered into multiple groups to serve different mobile users,respectively.However,as the number of APs increases,the computational capability within an AP group has become the bottleneck of AP clustering.In this paper,we first propose a novel UDN architecture based on Mobile Edge Computing(MEC),in which each MEC server is associated with a user-centric AP cluster to act as a mobile agent.In addition,in the context of MEC-based UDN,we leverage mobility prediction techniques to achieve a dynamic AP clustering scheme,in which the cluster structure can automatically adapt to the dynamic distribution of user traffic in a specific area.Simulation results show that the proposed scheme can highly increase the average user throughput compared with the baseline algorithm using max-SINR user association and equal bandwidth allocation,while it guarantees at the same time low transmission delay.

Two-Codebook-Based Cooperative Precoding for TDD-CoMP in 5G Ultra-Dense Networks

In ultra-dense networks （UDN）, the local precoding scheme for time-division duplex coordinated multiple point transmission （TDD-CoMP） can have a good performance with no feedback by using reciprocity between uplink and dovallink. However, if channel is time-varying, the channel difference would cause codeword mismatch between transmitter and receiver, which leads to performance degradation. In this paper, a linear interpolation method is proposed for TDD-CoMP system to estimate the uplink channel at the receiver, which would reduce the channel difference caused by time delay and decrease the probability of codeword mismatch between both sides. Moreover, to mitigate severe inter-cell interference and increase the coverage and throughput of celledge users in UDN, a two-codebook scheme is used to strengthen cooperation between base stations （BSs）, which can outperform the global precoding scheme with less overhead. Simulations show that the proposed scheme can significantly improve the link performance compared to the global precoding scheme.

Ultra-Dense Networking Architectures and Technologies for 5G

With the continuous enrichment of mobile communication application scenarios in the future, the traditional macro-cellular-based mobile communication network architecture will be difficult to meet the explosive growth in demand for communications services.

5G Ultra-Dense Networks

In future 5G networks,a key scenario is the dense user distribution over some area,such as office,urban apartments,shopping mall,stadium,etc.,where the requirement for user-experienced rate at cell-edge can be

Coverage Analyses on Directional Transmissions Ultra-Dense Networks with Imperfect Beam Alignment

Blockage and imperfect beam alignment are two principal difficulties in high-frequency bands directional transmissions.In this paper,the coverage performance of downlink directional transmissions in ultra-dense networks is analyzed,with the consideration of beam alignment error and link blockage through stochastic geometry.Numerical experiments demonstrate that narrower beam leads to higher coverage probability with perfect beam alignment,but it is not the case with imperfect beam alignment.Therefore,the optimal beamwidth that maximize the coverage probability is characterized and a closed-form approximation of the optimal beamwidth is derived under imperfect beam alignment,accordingly.Furthermore,the optimal beamwidth is a monotonically increasing function of the standard deviation of the beam alignment error,and a monotonically decreasing function of the beamwidth of correspondent communication end,indicating that the beamwidth of the communication pairs ought to be jointly designed.

A Pilot Contamination Avoidance Based on Pilot Pattern Design for Ultra-Dense Network

With the ever-growing number of base stations(BSs)and user equipments(UEs)in ultra-dense networks(UDN),reusing the same pilot sequences among the cells is inevitable.With pilot reuse scheme,the channel estimation obtained at a BS contains not only the desired channel-state information(CSI)but also interference from neighboring cells,which can severely degrade CSI estimation performance and adversely affect communication performance.In this paper we consider a pilot contamination avoidance based on pilot pattern design for UDN where the pilot reuse employed and the interfering users from neighboring cells may be not at lower power levels at the BS compared to the in-cell users.We present a novel statistical interference model of sub-carriers to describe the non-deterministic interference from neighboring cells.Then,we provide a pilot pattern design model with non-uniform pilot distribution.Based on this,a pilot contamination avoidance based on pilot pattern design is proposed where pilot reuse scheme and the non-deterministic interference from neighboring cells are taken into consideration.Unlike existing interference mitigation approaches,the proposed method eliminates interference through the method of interference avoidance and can be applied to different kinds of channel estimation algorithms.Simulation results showed that the proposed approach can effectively avoid the interference and ensure the accuracy of channel estimation.

The analysis of coverage probability,ASE and EE in heterogeneous ultra-dense networks with power control

The ultra-dense network is a promising technology to increase the network capacity in the forthcoming fifthgeneration(5G)mobile communication networks by deploying lots of low power Small Base Stations(SBSs)which overlap with Macro Base Stations(MBSs).The interference and energy consumption increase rapidly with the number of SBSs although each SBS transmits with small power.In this paper,we model a downlink heterogeneous ultra-dense network where a lot of SBSs are randomly deployed with MBSs based on the Poisson point process.We derive the coverage probability and its variance,and analyze the area spectral efficiency and energy efficiency of the network considering three Fractional Power Control(FPC)strategies.The numerical results and Monte Carlo simulation results show that power control can mitigate the interference and balance the performances of inner-user and edge-user equipments.Especially,a great improvement of energy efficiency is archived with a little loss of area spectral efficiency when FPC is adopted.Finally,we analyze the effect of base stations’(BSs’)sleeping on the performance of the network when it is partially loaded.