Dynamic Spectrum Anti-Jamming with Distributed Learning and Transfer Learning

Physical-layer security issues in wireless systems have attracted great attention.In this paper,we investigate the spectrum anti-jamming(AJ)problem for data transmissions between devices.Considering fast-changing physical-layer jamming attacks in the time/frequency domain,frequency resources have to be configured for devices in advance with unknown jamming patterns(i.e.the time-frequency distribution of the jamming signals)to avoid jamming signals emitted by malicious devices.This process can be formulated as a Markov decision process and solved by reinforcement learning(RL).Unfortunately,stateof-the-art RL methods may put pressure on the system which has limited computing resources.As a result,we propose a novel RL,by integrating the asynchronous advantage actor-critic(A3C)approach with the kernel method to learn a flexible frequency pre-configuration policy.Moreover,in the presence of time-varying jamming patterns,the traditional AJ strategy can not adapt to the dynamic interference strategy.To handle this issue,we design a kernelbased feature transfer learning method to adjust the structure of the policy function online.Simulation results reveal that our proposed approach can significantly outperform various baselines,in terms of the average normalized throughput and the convergence speed of policy learning.

Throughput Analysis of Dynamic Spectrum Anti-Jamming Multiple-Access in HF Communication Systems

A multiple-access networking scheme based on the new dynamic spectrum anti-jamming system is proposed in this paper. The network consists of a center node and multiple user nodes. The center node detects spectrum holes in the operation band periodically according to the user performance target. Detected spectrum holes are allocated to users who request communication. Throughput of this networking scheme is analyzed over a high-frequency(HF) interference channel. The effect of error correction coding and spectrum hole information transmission error is discussed. Throughput of this scheme and conventional frequency-hopping multiple-access(FHMA) scheme are compared. Results show that user performance increase leads to throughput decrease, which can be offset by error correction coding. If spectrum hole information transmission is in error, the throughput is not affected much as long as the bit error rate is below 10-2. Furthermore, throughput of this scheme is obviously superior to the throughput of FHMA scheme.

Dynamic Update Scheme of Spectrum Information Based on Spectrum Opportunity Incentive in the Database-Assisted Dynamic Spectrum Management

To solve the problem of delayed update of spectrum information(SI) in the database assisted dynamic spectrum management(DB-DSM), this paper studies a novel dynamic update scheme of SI in DB-DSM. Firstly, a dynamic update mechanism of SI based on spectrum opportunity incentive is established, in which spectrum users are encouraged to actively assist the database to update SI in real time. Secondly, the information update contribution(IUC) of spectrum opportunity is defined to describe the cost of accessing spectrum opportunity for heterogeneous spectrum users, and the profit of SI update obtained by the database from spectrum allocation. The process that the database determines the IUC of spectrum opportunity and spectrum user selects spectrum opportunity is mapped to a Hotelling model. Thirdly, the process of determining the IUC of spectrum opportunities is further modelled as a Stackelberg game by establishing multiple virtual spectrum resource providers(VSRPs) in the database. It is proved that there is a Nash Equilibrium in the game of determining the IUC of spectrum opportunities by VSRPs. Finally, an algorithm of determining the IUC based on a genetic algorithm is designed to achieve the optimal IUC. The-oretical analysis and simulation results show that the proposed method can quickly find the optimal solution of the IUC, and ensure that the spectrum resource provider can obtain the optimal profit of SI update.

Floquet spectrum and universal dynamics of a periodically driven two-atom system

We investigate the Floquet spectrum and excitation properties of a two-ultracold-atom system with periodically driven interaction in a three-dimensional harmonic trap.The interaction between the atoms is changed by varying the s-wave scattering length in two ways,the cosine and the square-wave modulations.It is found that as the driving frequency increases,the Floquet spectrum exhibits two main features for both modulations,the accumulating and the spreading of the quasienergy levels,which further lead to different dynamical behaviors.The accumulation is associated with collective excitations and the persistent growth of the energy,while the spread indicates that the energy is bounded at all times.The initial scattering length,the driving frequency and amplitude can all significantly change the Floquet spectrum as well as the dynamics.However,the corresponding relation between them is valid universally.Finally,we propose a mechanism for selectively exciting the system to one specific state by using the avoided crossing of two quasienergy levels,which could guide preparation of a desired state in experiments.

Multi-Strategy Dynamic Spectrum Access in Cognitive Radio Networks: Modeling, Analysis and Optimization

Dynamic spectrum access(DSA) based on cognitive radios(CR) technique is an effective approach to address the "spectrum scarcity" issue. However, traditional CR-enabled DSA system employs only single DSA strategy, which might not be suited to the dynamic network environment. In this paper, we propose a multi-strategy DSA(MS-DSA) system, where the primary and the secondary system share spectrum resources with multiple DSA strategies simultaneously. To analyze the performance of the proposed MS-DSA system, we model it as a continuous-time Markov chain(CTMC) and derive the expressions to compute the corresponding performance metrics. Based on this, we define a utility function involving the concerns of effective throughput, interference quantity on primary users, and spectrum leasing cost. Two optimization schemes, named as spectrum allocation and false alarm probability selection, are proposed to maximize the utility function. Finally, numerical simulations are provided to validate our analysis and demonstrate that the performance can be significantly improved caused by virtues of the proposed MS-DSA system.

Dynamic Matching-Based Spectrum Detection in Cognitive Radio Networks

Cognitive Radio Network provides an opportunity to reduce the spectrum resource crisis by allowing secondary users to access the idle spectrum allocated to primary users. The precondition of spectrum sharing is to obtain the Spectrum Availability Information(SAI). Energy detection is a typical technology to get SAI. With the mobility of primary users, the energy received by secondary users varies greatly with the distance from the target primary users. Most of the existing energy detection algorithms that use fixed thresholds are not suitable. We propose a Dynamic Matching-Based Spectrum Detection(DMBSD) scheme which can detect sensing data, reduce the impact of malicious data and make final sensing results more accurate with dynamic threshold setting and data matching. Simulation results show that the proposed scheme can detect tempered data, and increase detection probability by decreasing false alarm probability and missed detection probability.

A Dynamic Distributed Spectrum Allocation Mechanism Based on Game Model in Fog Radio Access Networks

With the explosive growth of highspeed wireless data demand and the number of mobile devices, fog radio access networks(F-RAN) with multi-layer network structure becomes a hot topic in recent research. Meanwhile, due to the rapid growth of mobile communication traffic, high cost and the scarcity of wireless resources, it is especially important to develop an efficient radio resource management mechanism. In this paper, we focus on the shortcomings of resource waste, and we consider the actual situation of base station dynamic coverage and user requirements. We propose a spectrum pricing and allocation scheme based on Stackelberg game model under F-RAN framework, realizing the allocation of resource on demand. This scheme studies the double game between the users and the operators, as well as between the traditional operators and the virtual operators, maximizing the profits of the operators. At the same time, spectrum reuse technology is adopted to improve the utilization of network resource. By analyzing the simulation results, it is verified that our proposed scheme can not only avoid resource waste, but also effectively improve the operator's revenue efficiency and overall network resource utilization.

A DYNAMIC SPECTRUM ACCESS NETWORK BASED ON COGNITIVE RADIO

Dynamic spectrum access technologies based on Cognitive Radio(CR) is under intensive research carried out by the wireless communication society and is expected to solve the problem of spectrum scarcity.However,most enabling technologies related to dynamic spectrum access are con-sidered individually.In this paper,we consider these key technologies jointly and introduce a new implementation scheme for a Dynamic Spectrum Access Network Based on Cognitive Radio(DSAN-BCR).We start with a flexible hardware platform for DSAN-BCR,as well as a flexible protocol structure that dominates the operation of DSAN-BCR.We then focus on the state of the art of key technologies such as spectrum sensing,spectrum resources management,dynamic spectrum access,and routing that are below the network layer in DSAN-BCR,as well as the development of technologies related to higher layers.Last but not the least,we analyze the challenges confronted by these men-tioned technologies in DSAN-BCR,and give the perspectives on the future development of these technologies.The DSAN-BCR introduced is expected to provide a system level guidance to alleviate the problem of spectrum scarcity.

Reinforcement Learning Based Dynamic Spectrum Access in Cognitive Internet of Vehicles

Cognitive Internet of Vehicles(CIoV)can improve spectrum utilization by accessing the spectrum licensed to primary user(PU)under the premise of not disturbing the PU’s transmissions.However,the traditional static spectrum access makes the CIoV unable to adapt to the various spectrum environments.In this paper,a reinforcement learning based dynamic spectrum access scheme is proposed to improve the transmission performance of the CIoV in the licensed spectrum,and avoid causing harmful interference to the PU.The frame structure of the CIoV is separated into sensing period and access period,whereby the CIoV can optimize the transmission parameters in the access period according to the spectrum decisions in the sensing period.Considering both detection probability and false alarm probability,a Q-learning based spectrum access algorithm is proposed for the CIoV to intelligently select the optimal channel,bandwidth and transmit power under the dynamic spectrum states and various spectrum sensing performance.The simulations have shown that compared with the traditional non-learning spectrum access algorithm,the proposed Q-learning algorithm can effectively improve the spectral efficiency and throughput of the CIoV as well as decrease the interference power to the PU.

Dynamic energy spectrum and energy deposition in solid target by intense pulsed ion beams

A method for analyzing the dynamic energy spectrum of intense pulsed ion beam(IPIB) was proposed.Its influence on beam energy deposition in metal target was studied with IPIB produced by two types of magnetically insulated diodes(MID).The emission of IPIB was described with space charge limitation model,and the dynamic energy spectrum was further analyzed with time-of-flight method.IPIBs generated by pulsed accelerators of BIPPAB-450(active MID) and TEMP-4M(passive MID) were studied.The dynamic energy spectrum was used to deduce the power density distribution of IPIB in the target with Monte Carlo simulation and infrared imaging diagnostics.The effect on the distribution and evolution of thermal field induced by the characteristics of IPIB dynamic energy spectrum was discussed.

A METHOD FOR CALCULATING THE LYAPUNOV EXPONENT SPECTRUM OF A PERIODICALLY EXCITED NON-AUTONOMOUS DYNAMICAL SYSTEM

The relation between the Lyapunov exponent spectrum of a periodically excited non-autono-mous dynamical system and the Lyapunov exponent spectrum of the corresponding autonomous system is givenand the validity of the relation is verified theoretically and computationally.A direct method for calculatingthe Lyapunov exponent spectrum of non-autonomous dynamical systems is suggested in this paper,whichmakes it more eonvenient to calculate the Lyapunov exponent spectrum of the dynamical system periodicallyexcited.Following the definition of the Lyapunov dimension DLAof the autonomous system,the definition ofthe Lyapunov dimension DL of the non-autonomous dynamical system is also given,and the difference be-tween them is the integer 1 namely,DLA-DL = 1.For a quasi-periodically excited dynamical system,similar conclusions are formed.

Dynamic Spectrum Access Based on Prior Knowledge Enabled Reinforcement Learning with Double Actions in Complex Electromagnetic Environment

The spectrum access problem of cognitive users in the fast-changing dynamic interference spectrum environment is addressed in this paper.The prior knowledge for the dynamic spectrum access is modeled and a reliability quantification scheme is presented to guide the use of the prior knowledge in the learning process.Furthermore,a spectrum access scheme based on the prior knowledge enabled RL(PKRL)is designed,which effectively improved the learning efficiency and provided a solution for users to better adapt to the fast-changing and high-density electromagnetic environment.Compared with the existing methods,the proposed algorithm can adjust the access channel online according to historical information and improve the efficiency of the algorithm to obtain the optimal access policy.Simulation results show that,the convergence speed of the learning is improved by about 66%with the invariant average throughput.

Orthogonal Codes-Based Dynamic Spectrum Access in Cognitive Radio Networks

Dynamic spectrum access(DSA) in cognitive radio(CR) networks became a challenging research area recently. In CR technology, the DSA between primary users(PUs) and secondary users(SUs) simultaneously can be achieved without degrading the performance of the PUs by SUs interference. This can be achieved by donating incentive power to the PUs in order to compensate the interference caused by the SUs. Consequently, PUs allow SUs to share the spectrum. In this paper, orthogonal codes-based dynamic spectrum access(OC-DSA) technique is proposed. OC-DSA technique employs orthogonality between PUs and SUs transmitted data symbols in addition to the incentive power donation. Compared to other techniques, the proposed technique uses a simple encoder at the SU network for the same PU network infrastructure. By applying orthogonal codes, the interference caused by SUs is canceled and hence the donated power to incentivize the PUs is reduced. Also, the SU packet rate is increased significantly. The simulation results show that the proposed technique provides effective improvements over other existing techniques in the signal strength and the bit error rate performance of both the PU network and the SU network at the receiver side. Moreover, the proposed technique requires less donated power to incentivize the PU and has higher packet rate.

Dynamic prediction of landslide displacement using singular spectrum analysis and stack long short-term memory network

An accurate landslide displacement prediction is an important part of landslide warning system. Aiming at the dynamic characteristics of landslide evolution and the shortcomings of traditional static prediction models, this paper proposes a dynamic prediction model of landslide displacement based on singular spectrum analysis(SSA) and stack long short-term memory(SLSTM) network. The SSA is used to decompose the landslide accumulated displacement time series data into trend term and periodic term displacement subsequences. A cubic polynomial function is used to predict the trend term displacement subsequence, and the SLSTM neural network is used to predict the periodic term displacement subsequence. At the same time, the Bayesian optimization algorithm is used to determine that the SLSTM network input sequence length is 12 and the number of hidden layer nodes is 18. The SLSTM network is updated by adding predicted values to the training set to achieve dynamic displacement prediction. Finally, the accumulated landslide displacement is obtained by superimposing the predicted value of each displacement subsequence. The proposed model was verified on the Xintan landslide in Hubei Province, China. The results show that when predicting the displacement of the periodic term, the SLSTM network has higher prediction accuracy than the support vector machine(SVM) and auto regressive integrated moving average(ARIMA). The mean relative error(MRE) is reduced by 4.099% and 3.548% respectively, while the root mean square error(RMSE) is reduced by 5.830 mm and 3.854 mm respectively. It is concluded that the SLSTM network model can better simulate the dynamic characteristics of landslides.

Frequency spectrum analysis on micro-seismic signal of rock bursts induced by dynamic disturbance

Blasting and breaking of hard roof are main inducing causes of rock bursts in coal mines with danger of rock burst,and it is important to find out the frequency spectrum distribution laws of these dynamic stress waves and rock burst waves for researching the mechanism of rock burst.In this paper,Fourier transform as a micro-seismic signal conversion method of amplitude-time character to amplitude-frequency character is used to analyze the frequency spectrum characters of micro-seismic signal of blasting,hard roof breaking and rock bursts induced by the dynamic disturbance in order to find out the difference and relativity of different signals.The results indicate that blasting and breaking of hard roof are high frequency signals,and the peak values of dominant frequency of the signals are single.However,the results indicate that the rock bursts induced by the dynamic disturbance are low frequency signals,and there are two obvious peak values in the amplitude-frequency curve witch shows that the signals of rock bursts are superposition of low frequency signals and high frequency signals.The research conclusions prove that dynamic disturbance is necessary condition for rock bursts,and the conclusions provide a new way to research the mechanism of rock bursts.

Database-Assisted Dynamic Spectrum Access with QoS Guarantees:A Double-Phase Auction Approach

Since FCC's opening for white space(WS) utilization,database-assisted dynamic spectrum access(DSA) has become the de facto solution for the realization of dynamic spectrum sharing(DSS),due to its simplicity and compatibility with commercial off-the-shelf(COTS) devices.It is envisioned that such technology will strongly support the prosperous wireless multimedia networking(WMN) applications with satisfying QoS guarantees in the future.However,how to counter the time-frequency variant property when exploiting the WS spectrum for the provision of these services to secondary users(SUs) still remains a great challenge.In such context,a dynamic secondary access scheme for database-assisted spectrum sharing networks is proposed in this paper.In the beginning,the spectrum requirements of SUs for diverse services are modeled by considering the minimum required service data-rate and spectrum access duration.Afterwards,the spectrum demand evaluation and bidding policy are formulated based on the service classes of SUs.Furthermore,a doublephase(DP) spectrum allocation scheme,which consists of the initial resource allocation phase and resource allocation adjustment phase,is carefully designed for DSA.Finally,extensive simulations are conducted and the results demonstrate that our scheme can increase the spectrum trading revenue and adapt to varying service requirements.

Dynamics of Sea Ice and Spectrum of Ice Force

Spectrum and self-excite characters are the two significant characters of the dynamics of sea ice. The spectrum character of sea ice is mainly shown by the spectrum of ice force. The spectrum character of the sea ice is its intrinsic attributes. When the spectrum of ice force from the dynamic response of ice and structure interaction are evaluated, the effect of dynamic character of the structure must be eliminated. In this paper, the ice force spectrum at Bohai Bay and Liaodong Bay is evaluated from the displacement and strain responses of a single degree and a multi-degree freedom structure. The evaluated ice force spectrum can be used to define the spectrum character of ice in the analysis of ice induced vibration.

Spatio-Temporal Population Density and Spatial Dynamic Spectrum Allocation

A realistic population density distribution scenario in conjunction with the spatial dynamic spectrum allocation (DSA) is taken into account to mitigate the spectrum wastage in terms of extra guard bands. For the insertion of the extra guard bands, an efficient strategy based on self-assessment is applied to each victim cell individually and independently. Consequently, it is no more required to spread the extra guard band over the whole DSA region. Simulation results show an improvement of 3%-4% in percentage of satisfied users for Universal Mobile Telecommunications System (UMTS) network and 4%-5% for Digital Video Broadcasting Terrestrial (DVB-T) network.

MULTI-CHANNEL TRANSMISSION STRATEGY FOR DYNAMIC SPECTRUM ACCESS

Cognitive radio is a promising technology that deals with the scarcity of radio spectrum. In this paper, we propose a new multi-channel transmission strategy for dynamic spectrum access in cognitive radio network. Starting with the model of spectrum activities, we present the multi-channel transmission strategy which has primary user's protection mechanism to improve the spectrum efficiency and study its performance under perfect and imperfect sensing. Numerical example results reveal that the performance of the proposed strategy has the superiority with respect to capacity performance of cognitive users and the protection of primary users.

Proactive Spectrum Monitoring for Suspicious Wireless Powered Communications in Dynamic Spectrum Sharing Networks

This paper studies the proactive spec-trum monitoring with one half-duplex spectrum moni-tor(SM)to cope with the potential suspicious wireless powered communications(SWPC)in dynamic spec-trum sharing networks.The jamming-assisted spec-trum monitoring scheme via spectrum monitoring data(SMD)transmission is proposed to maximize the sum ergodic monitoring rate at SM.In SWPC,the suspi-cious communications of each data block occupy mul-tiple independent blocks,with a block dedicated to the wireless energy transfer by the energy-constrained suspicious nodes with locations in a same cluster(symmetric scene)or randomly distributed(asymmet-ric scene)and the remaining blocks used for the in-formation transmission from suspicious transmitters(STs)to suspicious destination(SD).For the sym-metric scene,with a given number of blocks for SMD transmission,namely the jamming operation,we first reveal that SM should transmit SMD signal(jam the SD)with tolerable maximum power in the given blocks.The perceived suspicious signal power at SM could be maximized,and thus so does the correspond-ing sum ergodic monitoring rate.Then,we further reveal one fundamental trade-off in deciding the op-timal number of given blocks for SMD transmission.For the asymmetric scene,a low-complexity greedy block selection scheme is proposed to guarantee the optimal performance.Simulation results show that the jamming-assisted spectrum monitoring schemes via SMD transmission achieve much better perfor-mance than conventional passive spectrum monitor-ing,since the proposed schemes can obtain more accu-rate and effective spectrum characteristic parameters,which provide basic support for fine-grained spectrum management and a solution for spectrum security in dynamic spectrum sharing network.