Channel assignment and power allocation for throughput improvement with PPO in B5G heterogeneous edge networks

In Beyond the Fifth Generation(B5G)heterogeneous edge networks,numerous users are multiplexed on a channel or served on the same frequency resource block,in which case the transmitter applies coding and the receiver uses interference cancellation.Unfortunately,uncoordinated radio resource allocation can reduce system throughput and lead to user inequity,for this reason,in this paper,channel allocation and power allocation problems are formulated to maximize the system sum rate and minimum user achievable rate.Since the construction model is non-convex and the response variables are high-dimensional,a distributed Deep Reinforcement Learning(DRL)framework called distributed Proximal Policy Optimization(PPO)is proposed to allocate or assign resources.Specifically,several simulated agents are trained in a heterogeneous environment to find robust behaviors that perform well in channel assignment and power allocation.Moreover,agents in the collection stage slow down,which hinders the learning of other agents.Therefore,a preemption strategy is further proposed in this paper to optimize the distributed PPO,form DP-PPO and successfully mitigate the straggler problem.The experimental results show that our mechanism named DP-PPO improves the performance over other DRL methods.

A self-organization formation configuration based assignment probability and collision detection

The formation control of multiple unmanned aerial vehicles(multi-UAVs)has always been a research hotspot.Based on the straight line trajectory,a multi-UAVs target point assignment algorithm based on the assignment probability is proposed to achieve the shortest overall formation path of multi-UAVs with low complexity and reduce the energy consumption.In order to avoid the collision between UAVs in the formation process,the concept of safety ball is introduced,and the collision detection based on continuous motion of two time slots and the lane occupation detection after motion is proposed to avoid collision between UAVs.Based on the idea of game theory,a method of UAV motion form setting based on the maximization of interests is proposed,including the maximization of self-interest and the maximization of formation interest is proposed,so that multi-UAVs can complete the formation task quickly and reasonably with the linear trajectory assigned in advance.Finally,through simulation verification,the multi-UAVs target assignment algorithm based on the assignment probability proposed in this paper can effectively reduce the total path length,and the UAV motion selection method based on the maximization interests can effectively complete the task formation.

Development of SNP parentage assignment techniques in the yellowfin seabream Acanthopagrus latus

Acanthopagrus latus is an essential aquaculture species on the south coast of China.However,there is a lack of systematic breeding of A.latus,which considerably limits the sustainable development of A.latus.As a result,genetic improvements are urgently needed to breed new strains of A.latus with rapid growth and strong resistance to disease.During selective breeding,it is necessary to estimate the genetic parameters of the target trait,which in turn depends on an accurate disentangled pedigree for the selective population.Therefore,it is necessary to establish the parentage assignment technique for A.latus.In this study,95 individuals selected from their parents and their 14 families were used as experimental material.SNPs were developed by genome resequencing,and highly polymorphic SNPs were screened on the basis of optimized filtering parameters.A total of 14392738 SNPs were discovered and 205 SNPs were selected for parentage assignment using the CERVUS software.In the model where the gender of the parents is known,the assignment success rate is 98.61%for the male parent,97.22%for the female parent,and 95.83%for the parent pair.In the model where the gender of the parents is unknown,the assignment success rate is 100%for a single parent and 90.28%for the parent pair.The results of this study were expected to serve as a reference for the breeding of new varieties of A.latus.

Reinforcement Learning Based Quantization Strategy Optimal Assignment Algorithm for Mixed Precision

The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.

ACS-based resource assignment and task scheduling in grid

To solve the deadlock problem of tasks that the interdependence between tasks fails to consider during the course of resource assignment and task scheduling based on the heuristics algorithm, an improved ant colony system （ACS） based algorithm is proposed. First, how to map the resource assignment and task scheduling （RATS） problem into the optimization selection problem of task resource assignment graph （TRAG） and to add the semaphore mechanism in the optimal TRAG to solve deadlocks are explained. Secondly, how to utilize the grid pheromone system model to realize the algorithm based on ACS is explicated. This refers to the construction of TRAG by the random selection of appropriate resources for each task by the user agent and the optimization of TRAG through the positive feedback and distributed parallel computing mechanism of the ACS. Simulation results show that the proposed algorithm is effective and efficient in solving the deadlock problem.

A Discrete-Time Stochastic Traffic Assignment Model

A discrete time stochastic traffic assignment model is proposed. The model provides a discrete time description of the variations of flows on a road network during a day or a peak period. The congestion effect at links and link junctions are taken into account. The first in first out principle is enforced on all links at all periods of the day. A stochastic user equilibrium assignment is achieved when the tripmaker is unable to find better travel alternatives. A computational procedure is also presented.

Survey of the research on dynamic weapon-target assignment problem

The basic concepts and models of weapon-target assignment （WTA） are introduced and the mathematical nature of the WTA models is also analyzed. A systematic survey of research on WTA problem is provided. The present research on WTA is focused on models and algorithms. In the research on models of WTA, the static WTA models are mainly studied and the dynamic WTA models are not fully studied in deed. In the research on algorithms of WTA, the intelligent algorithms are often used to solve the WTA problem. The small scale of static WTA problems has been solved very well, however, the large scale of dynamic WTA problems has not been solved effectively so far. Finally, the characteristics of dynamic WTA are analyzed and directions for the future research on dynamic WTA are discussed.

Special secret sharing scheme with the function of assignment

A concept of secret sharing scheme with the function of assignment is proposed. It provides great capabilities for many practical applications. In this scheme, the dealer can randomly assign one or more than one participant to get the secret at any time, but these participants can get nothing about the secret before that moment. At the same time, the other participants cannot get anything about the secret by stealing the secret value when it is transferred. However, if the dealer is lost, a certain number or more partidtmnts of them can reoonstruct the secret by ccoperating. In order to clear this concept, an illustrating scheme with geometry method and a practical scheme with algebra method is given.

~1H and ^(13)C NMR Assignments for Amlodipine and Risperidone

Aim To investigate the NMR spectroscopy of amlodipine and risperidone.Methods 1D NMR and 2D NMR experimental techniques of gCOSY, gHSQC and gHMBC were wsed. Results Theassignments of the ~1H and ^(13) C NMR data for the two drugs were performed and confirmed by theevidence of J_(HF) and J_(CF). Conclusion The structures of amlodipine and risperidone wereconfirmed by careful analysis of regular 1D and 2D NMR spectroscopy.

Local adaptive transmit power assignment strategy for wireless sensor networks

A distributed local adaptive transmit power assignment (LA-TPA) strategy was proposed to construct a topology with better performance according to the environment and application scenario and prolong the network lifetime.It takes the path loss exponent and the energy control coefficient into consideration with the aim to accentuate the minimum covering district of each node more accurately and precisely according to various network application scenarios.Besides,a self-healing scheme that enhances the robustness of the network was provided.It makes the topology tolerate more dead nodes than existing algorithms.Simulation was done under OMNeT++ platform and the results show that the LA-TPA strategy is more effective in constructing a well-performance network topology based on various application scenarios and can prolong the network lifetime significantly.

Cross Point Assignment Algorithm Under Consideration of Very Long Nets

A cross point assignment algorithm is proposed under consideration of very long nets (LCPA).It is to consider not only the cost of connection between cross points and pins and the exclusive cost among cross points on the boundary of a global routing cell,but also the cost of displacement among cross points of the same net.The experiment results show that the quality and speed in the following detailed routing are improved obviously,especially for very long nets.

Traffic-aware static channel assignment algorithm in wireless mesh networks

A channel assignment algorithm with awareness of link traffic is proposed in multi-radio multi-channel wireless mesh networks. First, the physical interference model based on the signal-to-interference-plus-noise ratio and successful transmission condition is described. The model is more suitable for a wireless communication environment than other existing models. Secondly, a pure integer quadratic programming （PIQP） model is used to solve the channel assignment problem and improve the capacity of wireless mesh networks. Consequently, a traffic- aware static channel assignment algorithm（TASC） is designed. The algorithm adopts some network parameters, including the network connectivity, the limitation of the number of radios and the successful transmission conditions in wireless communications. The TASC algorithm can diminish network interference and increase the efficiency of channel assignment while keeping the connectivity of the network. Finally, the feasibility and effectivity of the channel assignment solution are illustrated by the simulation results. Compared witb similar algorithms, the proposed algorithm can increase the capacity of WMNs.

Competition assignment problem algorithm based on Hungarian method

Traditional Hungarian method can only solve standard assignment problems, while can not solve competition assignment problems. This article emphatically discussed the difference between standard assignment problems and competition assignment problems. The kinds of competition assignment problem algorithms based on Hungarian method and the solutions of them were studied.

Direct computing methods for turn flows in traffic assignment

Two methods based on a slight modification of the regular traffic assignmentalgorithms are proposed to directly compute turn flows instead of estimating them from link flows orobtaining them by expanding the networks. The first one is designed on the path-turn incidencerelationship, and it is similar to the computational procedure of link flows. It applies to thetraffic assignment algorithms that can provide detailed path structures. The second utilizes thelink-turn incidence relationship and the conservation of flow on links, a law deriving from thisrelationship. It is actually an improved version of Dial's logit assignment algorithm. The proposedapproaches can avoid the shortcomings both of the estimation methods, e. g. Furness's model andFrator's model, and of the network-expanding method in precision, stability and computation scale.Finally, they are validated by numerical examples.

Lazy loading algorithm for traffic assignment of road networks under fixed charge condition

The measures of path charge are important considerations in traffic assignment of road networks. Factors, such as travel time, fixed charge and traffic congestion which affect road users＇ choices of trip paths, are analyzed. Travelers usually decide their trip paths based on their personal habits, preferences and the information at hand. By considering both deterministic and stochastic factors which affect the value of time （VOT） during the process of path choosing, a variational inequality model is proposed to describe the problem of traffic assignment. A lazy loading algorithm for traffic assignment is designed to solve the proposed model, and the calculation steps are given. Numerical experiment results show that compared with the all-or-nothing assignment, the proposed model and the algorithm can provide more optimal traffic assignments for road networks. The results of this study can be used to optimize traffic planning and management.

Traffic Assignment Forecast Model Research in ITS

As an important role in the development of ITS, traffic assignment forecast is always the research focus. Based on the analysis of classic traffic assignment forecast models, an improved traffic assignment forecast model, multi-ways probability and capacity constraint (MPCC) is presented. Using the new traffic as- signment forecast model to forecast the traffic volume will improve the rationality and veracity of traffic as- signment forecast.

Assignment Theory and Application of Intelligent Traffic Systems

Assignment theory of intelligent traffic systems (ITS) is a new information management system of vehicle in recent developments. In this paper, the basic concepts of the theory and three representative studies, that is, (1) simulation based approach, (2)optimal control theory approach, and (3) optimization approach are introduced. Their advantages and drawbacks are analyzed and expounded. Also introduced are two latest techniques of assignment theory of ITS. Finally, a dynamic assignment model of a traffic transport network is proposed.

A CHANNEL ASSIGNMENT ALGORITHM VIA CONFLICT SHIFTING FOR DISTRIBUTED COGNITIVE NETWORKS

Channel assignment is a challenge for distributed cognitive networks due to spectrum mobility and lack of centralized entity.We present a dynamic and efficient algorithm via conflict shifting,referred as Shifting-based Channel Assignment(SCA).In this algorithm,the system was modeled with a conflict graph,and users cannot assign the channels that primary users(legacy users) and neighbors already occupied.In order to eliminate the conflicts between neighbors efficiently,secondary users(unlicensed users) try to transfer them through a straight path to the boundary,where conflicts are easier to solve as there are less neighbors for boundary users.Actions in one shift are executed in slots,and users act in a synchronous and separated manner.As a result,some of the conflicting channels are avoid from directly abandoned,and for this,utility of the entire network can be improved.Simulation results show that the proposed algorithm can provide similar utility performance while obviously reducing the communication cost than bargaining-base algorithms.In small scale networks with low user mobility(under 20%),it reduces 50% of the communication overhead than the later.

A Temporal Domain Decomposition Algorithmic Scheme for Large-Scale Dynamic Traffic Assignment

With emergent interest of Simulation-Based Dynamic Traffic Assignment(SBDTA)in the field of transportation network modeling,deployment of SBDTA models for traffic operations and transportation planning have increased significantly in recent years.In parallel,research and development of innovative approaches of the SBDTA model have enhanced the quality of both the assignment component,i.e,improvement of convergence quality of the Dynamic User Equilibrium(DUE)problem,and the traffic simulation element.However,computational requirement remains to be one of the great challenges for DTA implementations on large-scale networks with a long analysis period.This paper presents a temporal decomposition scheme for large spatial-and temporal-scale dynamic traffic assignment,in which the entire analysis period is divided into Epochs.Vehicle assignment is performed sequentially in each Epoch,thus improving the model scalability and confining the peak run-time memory requirement regardless of the total analysis period.A proposed self-turning scheme adaptively searches for the run-time-optimal Epoch setting during iterations regardless of the characteristics of the modeled network.Extensive numerical experiments confirm the promising performance of the proposed algorithmic schemes.

Cross Point Assignment Algorithm with Crosstalk Constraint

An algorithm to resolve the coupling effect problem is proposed during the cross point assignment (CPA) stage.In the algorithm,the priority queue concept and the rip-up and reroute strategy are combined to control crosstalk noise caused by interconnect coupling capacitance.First,the nets are arranged into different priority queues according to their weighted sum of their length and criticality.Then,the CPA problem for one queue of nets is translated into a linear assignment problem.After the assignment of one queue of nets,a post-CPA checking routine is performed to check and rip up the net pairs which violate the crosstalk noise constraint and then push them into the next queue to be reassigned.The algorithm is tested by a set of bench mark examples,and the experimental results are promising...