CoopAI-Route: DRL Empowered Multi-Agent Cooperative System for Efficient QoS-Aware Routing for Network Slicing in Multi-Domain SDN

The emergence of beyond 5G networks has the potential for seamless and intelligent connectivity on a global scale.Network slicing is crucial in delivering services for different,demanding vertical applications in this context.Next-generation applications have time-sensitive requirements and depend on the most efficient routing path to ensure packets reach their intended destinations.However,the existing IP(Internet Protocol)over a multi-domain network faces challenges in enforcing network slicing due to minimal collaboration and information sharing among network operators.Conventional inter-domain routing methods,like Border Gateway Protocol(BGP),cannot make routing decisions based on performance,which frequently results in traffic flowing across congested paths that are never optimal.To address these issues,we propose CoopAI-Route,a multi-agent cooperative deep reinforcement learning(DRL)system utilizing hierarchical software-defined networks(SDN).This framework enforces network slicing in multi-domain networks and cooperative communication with various administrators to find performance-based routes in intra-and inter-domain.CoopAI-Route employs the Distributed Global Topology(DGT)algorithm to define inter-domain Quality of Service(QoS)paths.CoopAI-Route uses a DRL agent with a message-passing multi-agent Twin-Delayed Deep Deterministic Policy Gradient method to ensure optimal end-to-end routes adapted to the specific requirements of network slicing applications.Our evaluation demonstrates CoopAI-Route’s commendable performance in scalability,link failure handling,and adaptability to evolving topologies compared to state-of-the-art methods.

Clinical effects of detailed nursing management interventions on medication adherence and disease perception in patients with drugresistant tuberculosis

BACKGROUND Tuberculosis(TB)is a chronic respiratory infectious disease that considerably jeopardizes human health,and there is no effective vaccine suitable for its prevention in the entire population.AIM To investigate the promotion of medication adherence and disease cognition in patients with drug-resistant(DR-)TB using detailed nursing management.METHODS In total,114 patients with DR-TB who were diagnosed and treated at our hospital between January 2019 and January 2023 were included in this study.Patients in the control group(n=57)were managed with conventional nursing care,while those in the observation group(n=57)were managed with detailed nursing care.Medication adherence,disease awareness scores,medication safety,and nursing satisfaction were compared between the two groups after the intervention.RESULTS The post-intervention medication compliance rate was 91.23%in the observation group and 75.44%in the control group,with the former being 15.79%higher than the latter(P<0.05).There was no statistically significant difference in the disease awareness scores between the two groups before the intervention;the disease awareness scores of the observation group were significantly higher than those of the control group after the intervention(P<0.05).The incidence of gastrointestinal reactions,joint swelling and pain,hearing loss,electrolyte disorders,and liver and kidney function abnormalities were lower in the observation group than those in the control group.The total nursing satisfaction of the observation group was higher than that of the control group(P<0.05).CONCLUSION Implementation of detailed nursing management for patients with DR-TB can effectively improve medication adherence,enhance awareness of the disease,ensure safety of medication,and improve satisfaction with nursing care.

A deep-reinforcement learning approach for optimizing homogeneous droplet routing in digital microfluidic biochips

Over the past two decades,digital microfluidic biochips have been in much demand for safety-critical and biomedical applications and increasingly important in point-of-care analysis,drug discovery,and immunoassays,among other areas.However,for complex bioassays,finding routes for the transportation of droplets in an electrowetting-on-dielectric digital biochip while maintaining their discreteness is a challenging task.In this study,we propose a deep reinforcement learning-based droplet routing technique for digital microfluidic biochips.The technique is implemented on a distributed architecture to optimize the possible paths for predefined source–target pairs of droplets.The actors of the technique calculate the possible routes of the source–target pairs and store the experience in a replay buffer,and the learner fetches the experiences and updates the routing paths.The proposed algorithm was applied to benchmark suitesⅠand Ⅲ as two different test benches,and it achieved significant improvements over state-of-the-art techniques.

MTCR-CR Routing Strategy for Connection-Oriented Routing over Satellite Networks

The high-speed movement of satellites makes it not feasible to directly apply the mature routing scheme on the ground to the satellite network.DT-DVTR in the snapshot-based connectionoriented routing strategy is one of the representative solutions,but it still has room for improvement in terms of routing stability.In this paper,we propose an improved scheme for connection-oriented routing strategy named the Minimal Topology Change Routing based on Collaborative Rules(MTCR-CR).The MTCR-CR uses continuous time static topology snapshots based on satellite status to search for intersatellite link(ISL)construction solutions that meet the minimum number of topology changes to avoid route oscillations.The simulation results in Beidou-3 show that compared with DT-DVTR,MTCR-CR reduces the number of routing changes by about 92%,the number of path changes caused by routing changes is about38%,and the rerouting time is reduced by approximately 47%.At the same time,in order to show our algorithm more comprehensively,the same experimental index test was also carried out on the Globalstar satellite constellation.

Digital twin driven and intelligence enabled content delivery in end-edge-cloud collaborative 5G networks

The rapid development of 5G/6G and AI enables an environment of Internet of Everything(IoE)which can support millions of connected mobile devices and applications to operate smoothly at high speed and low delay.However,these massive devices will lead to explosive traffic growth,which in turn cause great burden for the data transmission and content delivery.This challenge can be eased by sinking some critical content from cloud to edge.In this case,how to determine the critical content,where to sink and how to access the content correctly and efficiently become new challenges.This work focuses on establishing a highly efficient content delivery framework in the IoE environment.In particular,the IoE environment is re-constructed as an end-edge-cloud collaborative system,in which the concept of digital twin is applied to promote the collaboration.Based on the digital asset obtained by digital twin from end users,a content popularity prediction scheme is firstly proposed to decide the critical content by using the Temporal Pattern Attention(TPA)enabled Long Short-Term Memory(LSTM)model.Then,the prediction results are input for the proposed caching scheme to decide where to sink the critical content by using the Reinforce Learning(RL)technology.Finally,a collaborative routing scheme is proposed to determine the way to access the content with the objective of minimizing overhead.The experimental results indicate that the proposed schemes outperform the state-of-the-art benchmarks in terms of the caching hit rate,the average throughput,the successful content delivery rate and the average routing overhead.

Enhancing Network Design through Statistical Evaluation of MANET Routing Protocols

This paper contributes a sophisticated statistical method for the assessment of performance in routing protocols salient Mobile Ad Hoc Network(MANET)routing protocols:Destination Sequenced Distance Vector(DSDV),Ad hoc On-Demand Distance Vector(AODV),Dynamic Source Routing(DSR),and Zone Routing Protocol(ZRP).In this paper,the evaluation will be carried out using complete sets of statistical tests such as Kruskal-Wallis,Mann-Whitney,and Friedman.It articulates a systematic evaluation of how the performance of the previous protocols varies with the number of nodes and the mobility patterns.The study is premised upon the Quality of Service(QoS)metrics of throughput,packet delivery ratio,and end-to-end delay to gain an adequate understanding of the operational efficiency of each protocol under different network scenarios.The findings explained significant differences in the performance of different routing protocols;as a result,decisions for the selection and optimization of routing protocols can be taken effectively according to different network requirements.This paper is a step forward in the general understanding of the routing dynamics of MANETs and contributes significantly to the strategic deployment of robust and efficient network infrastructures.

Dynamic Routing of Multiple QoS-Required Flows in Cloud-Edge Autonomous Multi-Domain Data Center Networks

The 6th generation mobile networks(6G)network is a kind of multi-network interconnection and multi-scenario coexistence network,where multiple network domains break the original fixed boundaries to form connections and convergence.In this paper,with the optimization objective of maximizing network utility while ensuring flows performance-centric weighted fairness,this paper designs a reinforcement learning-based cloud-edge autonomous multi-domain data center network architecture that achieves single-domain autonomy and multi-domain collaboration.Due to the conflict between the utility of different flows,the bandwidth fairness allocation problem for various types of flows is formulated by considering different defined reward functions.Regarding the tradeoff between fairness and utility,this paper deals with the corresponding reward functions for the cases where the flows undergo abrupt changes and smooth changes in the flows.In addition,to accommodate the Quality of Service(QoS)requirements for multiple types of flows,this paper proposes a multi-domain autonomous routing algorithm called LSTM+MADDPG.Introducing a Long Short-Term Memory(LSTM)layer in the actor and critic networks,more information about temporal continuity is added,further enhancing the adaptive ability changes in the dynamic network environment.The LSTM+MADDPG algorithm is compared with the latest reinforcement learning algorithm by conducting experiments on real network topology and traffic traces,and the experimental results show that LSTM+MADDPG improves the delay convergence speed by 14.6%and delays the start moment of packet loss by 18.2%compared with other algorithms.

Frequency-tunable single-photon router based on a microresonator containing a driven three-level emitter

We propose a frequency-tunable router of single photons with high routing efficiency, which is constructed by two waveguides mediately linked by a single-mode whispering gallery resonator with a driven three-level emitter. Quantum routing probability in the output port is obtained via the real-space Hamiltonian. By adjusting the resonator–emitter coupling and the drive, the desired continuous central frequencies for the resonance peaks of routing photons can be manipulated nearly linearly, with the assistance of Rabi splitting effect and optical Stark shift. The proposed routing system may provide potential applications in designing other frequency-modulation quantum optical devices, such as multiplexers,filters, and so on.

QoS Routing Optimization Based on Deep Reinforcement Learning in SDN

To enhance the efficiency and expediency of issuing e-licenses within the power sector, we must confront thechallenge of managing the surging demand for data traffic. Within this realm, the network imposes stringentQuality of Service (QoS) requirements, revealing the inadequacies of traditional routing allocation mechanismsin accommodating such extensive data flows. In response to the imperative of handling a substantial influx of datarequests promptly and alleviating the constraints of existing technologies and network congestion, we present anarchitecture forQoS routing optimizationwith in SoftwareDefinedNetwork (SDN), leveraging deep reinforcementlearning. This innovative approach entails the separation of SDN control and transmission functionalities, centralizingcontrol over data forwardingwhile integrating deep reinforcement learning for informed routing decisions. Byfactoring in considerations such as delay, bandwidth, jitter rate, and packet loss rate, we design a reward function toguide theDeepDeterministic PolicyGradient (DDPG) algorithmin learning the optimal routing strategy to furnishsuperior QoS provision. In our empirical investigations, we juxtapose the performance of Deep ReinforcementLearning (DRL) against that of Shortest Path (SP) algorithms in terms of data packet transmission delay. Theexperimental simulation results show that our proposed algorithm has significant efficacy in reducing networkdelay and improving the overall transmission efficiency, which is superior to the traditional methods.

An SDN-Based Algorithm for Caching,Routing,and Load Balancing in ICN

One of the challenges of Informationcentric Networking(ICN)is finding the optimal location for caching content and processing users’requests.In this paper,we address this challenge by leveraging Software-defined Networking(SDN)for efficient ICN management.To achieve this,we formulate the problem as a mixed-integer nonlinear programming(MINLP)model,incorporating caching,routing,and load balancing decisions.We explore two distinct scenarios to tackle the problem.Firstly,we solve the problem in an offline mode using the GAMS environment,assuming a stable network state to demonstrate the superior performance of the cacheenabled network compared to non-cache networks.Subsequently,we investigate the problem in an online mode where the network state dynamically changes over time.Given the computational complexity associated with MINLP,we propose the software-defined caching,routing,and load balancing(SDCRL)algorithm as an efficient and scalable solution.Our evaluation demonstrates that the SDCRL algorithm significantly reduces computational time while maintaining results that closely resemble those achieved by GAMS.

Improving Network Availability through Optimized Multipath Routing and Incremental Deployment Strategies

Currently,distributed routing protocols are constrained by offering a single path between any pair of nodes,thereby limiting the potential throughput and overall network performance.This approach not only restricts the flow of data but also makes the network susceptible to failures in case the primary path is disrupted.In contrast,routing protocols that leverage multiple paths within the network offer a more resilient and efficient solution.Multipath routing,as a fundamental concept,surpasses the limitations of traditional shortest path first protocols.It not only redirects traffic to unused resources,effectively mitigating network congestion,but also ensures load balancing across the network.This optimization significantly improves network utilization and boosts the overall performance,making it a widely recognized efficient method for enhancing network reliability.To further strengthen network resilience against failures,we introduce a routing scheme known as Multiple Nodes with at least Two Choices(MNTC).This innovative approach aims to significantly enhance network availability by providing each node with at least two routing choices.By doing so,it not only reduces the dependency on a single path but also creates redundant paths that can be utilized in case of failures,thereby enhancing the overall resilience of the network.To ensure the optimal placement of nodes,we propose three incremental deployment algorithms.These algorithms carefully select the most suitable set of nodes for deployment,taking into account various factors such as node connectivity,traffic patterns,and network topology.By deployingMNTCon a carefully chosen set of nodes,we can significantly enhance network reliability without the need for a complete overhaul of the existing infrastructure.We have conducted extensive evaluations of MNTC in diverse topological spaces,demonstrating its effectiveness in maintaining high network availability with minimal path stretch.The results are impressive,showing that even when implemented on just 60%of nodes,our incremental deployment method significantly boosts network availability.This underscores the potential of MNTC in enhancing network resilience and performance,making it a viable solution for modern networks facing increasing demands and complexities.The algorithms OSPF,TBFH,DC and LFC perform fast rerouting based on strict conditions,while MNTC is not restricted by these conditions.In five real network topologies,the average network availability ofMNTCis improved by 14.68%,6.28%,4.76%and 2.84%,respectively,compared with OSPF,TBFH,DC and LFC.

Detailed seismic zoning of the East Kazakhstan region in the Republic of Kazakhstan

Kazakhstan is currently drafting new construction regulations that comply with the major provisions of the Eurocodes.Such regulations are created on the basis of seismic zoning maps of various degrees of detail,developed by our Institute of Seismology using a new methodological approach for Kazakhstan.The article is about creating the first normative map of the Detailed Seismic Zoning on a probabilistic foundation for the Republic of Kazakhstan’s East Kazakhstan region.We carried out the probabilistic assessment of seismic hazard using a methodology consistent with the main provisions of Eurocode 8and updated compared with that used in developing maps of Kazakhstan’s General Seismic Zoning and seismic microzoning of Almaty.The most thorough and current data accessible for the area under consideration were combined with contemporary analytical techniques.Updates have been done to not only the databases being used but also the way seismic sources were shown,including active faults now.On a scale of 1:1000000,precise seismic zoning maps of the East Kazakhstan region were created for two probabilities of exceedance:10%and 2%in 50 years in terms of peak ground accelerations and macroseismic intensities.The obtained seismic hazard distribution is generally consistent with the General Seismic Zoning of Kazakhstan’s previous findings.However,because active faults were included and a thoroughly revised catalog was used,there are more pronounced zones of increased danger along the fault in the western part of the region.In the west of the territory,acceleration values also increased due to a more accurate consideration of seismotectonic conditions.Zoning maps are the basis for developing new state building regulations of the Republic of Kazakhstan.

Towards Blockchain-Based Secure BGP Routing,Challenges and Future Research Directions

Border Gateway Protocol(BGP)is a standard inter-domain routing protocol for the Internet that conveys network layer reachability information and establishes routes to different destinations.The BGP protocol exhibits security design defects,such as an unconditional trust mechanism and the default acceptance of BGP route announcements from peers by BGP neighboring nodes,easily triggering prefix hijacking,path forgery,route leakage,and other BGP security threats.Meanwhile,the traditional BGP security mechanism,relying on a public key infrastructure,faces issues like a single point of failure and a single point of trust.The decentralization,anti-tampering,and traceability advantages of blockchain offer new solution ideas for constructing secure and trusted inter-domain routing mechanisms.In this paper,we summarize the characteristics of BGP protocol in detail,sort out the BGP security threats and their causes.Additionally,we analyze the shortcomings of the traditional BGP security mechanism and comprehensively evaluate existing blockchain-based solutions to address the above problems and validate the reliability and effectiveness of blockchain-based BGP security methods in mitigating BGP security threats.Finally,we discuss the challenges posed by BGP security problems and outline prospects for future research.

Mitigating Blackhole and Greyhole Routing Attacks in Vehicular Ad Hoc Networks Using Blockchain Based Smart Contracts

The rapid increase in vehicle traffic volume in modern societies has raised the need to develop innovative solutions to reduce traffic congestion and enhance traffic management efficiency.Revolutionary advanced technology,such as Intelligent Transportation Systems(ITS),enables improved traffic management,helps eliminate congestion,and supports a safer environment.ITS provides real-time information on vehicle traffic and transportation systems that can improve decision-making for road users.However,ITS suffers from routing issues at the network layer when utilising Vehicular Ad Hoc Networks(VANETs).This is because each vehicle plays the role of a router in this network,which leads to a complex vehicle communication network,causing issues such as repeated link breakages between vehicles resulting from the mobility of the network and rapid topological variation.This may lead to loss or delay in packet transmissions;this weakness can be exploited in routing attacks,such as black-hole and gray-hole attacks,that threaten the availability of ITS services.In this paper,a Blockchain-based smart contracts model is proposed to offer convenient and comprehensive security mechanisms,enhancing the trustworthiness between vehicles.Self-Classification Blockchain-Based Contracts(SCBC)and Voting-Classification Blockchain-Based Contracts(VCBC)are utilised in the proposed protocol.The results show that VCBC succeeds in attaining better results in PDR and TP performance even in the presence of Blackhole and Grayhole attacks.

Numerical Simulation of Turbulent Diffusion Flames of a Biogas Enriched with Hydrogen

Any biogas produced by the anaerobic fermentation of organic materials has the advantage of being an environmentally friendly biofuel.Nevertheless,the relatively low calorific value of such gases makes their effective utilization in practical applications relatively difficult.The present study considers the addition of hydrogen as a potential solution to mitigate this issue.In particular,the properties of turbulent diffusion jet flames and the related pollutant emissions are investigated numerically for different operating pressures.The related numerical simulations are conducted by solving the RANS equations in the frame of the Reynolds Stress Model in combination with the flamelet approach.Radiation effects are also taken into account and the combustion kinetics are described via the GRI-Mech 3.0 reaction model.The considered hydrogen fuel enrichment spans the range from 0%to 50%in terms of volume.Pressure varies between 1 and 10 atm.The results show that both hydrogen addition and pressure increase lead to an improvement in terms of mixing quality and have a significant effect on flame temperature and height.They also reduce CO_(2) emissions but increase NOx production.Prompt NO is shown to be the predominant NO formation mechanism.

Node Sociability Based Intelligent Routing for Post-Disaster Emergency Networks

In a post-disaster environment characterized by frequent interruptions in communication links,traditional wireless communication networks are ineffective.Although the“store-carry-forward”mechanism characteristic of Delay Tolerant Networks(DTNs)can transmit data from Internet of things devices to more reliable base stations or data centres,it also suffers from inefficient data transmission and excessive transmission delays.To address these challenges,we propose an intelligent routing strategy based on node sociability for post-disaster emergency network scenarios.First,we introduce an intelligent routing strategy based on node intimacy,which selects more suitable relay nodes and assigns the corresponding number of message copies based on comprehensive utility values.Second,we present an intelligent routing strategy based on geographical location of nodes to forward message replicas secondarily based on transmission utility values.Finally,experiments demonstrate the effectiveness of our proposed algorithm in terms of message delivery rate,network cost ratio and average transmission delay.

Normalized glandular dose coefficients for digital breast tomosynthesis using detailed Chinese breast models

The rise in breast cancer diagnoses among Chinese women has necessitated the use of X-ray breast screening,which carries a radiation risk.This study aimed to provide a dosimetry protocol for the Chinese female population to replace the traditional standard that utilizes simplified breast models,for the accurate estimation of the mean glandular dose of a patient undergoing digital breast tomosynthesis(DBT).The first set of detailed Chinese female breast models and representative breast parameters was constructed.Considering backscatter radiation and computational efficiency,we improved the combination of these models and the Chinese reference adult female whole-body voxel phantom.Image acquisition for four commercial DBT systems that are widely employed in China was simulated using the Monte Carlo method to obtain the normalized glandular dose coefficients of DBT(D_(gN)^(DBT))and the glandular depth dose(D_(g)^(dep)(z))for different breast characteristics and X-ray spectra.We calculated a series of D_(gN)^(DBT) values for breasts with different percentage mass glandularities(5%,25%,50%,75%,and 100%)and compressed breast thicknesses(2,3,4,5,6,and 7 cm)at various tube potentials(25,28,30,32,35,and 49 kV)and target/filter combinations(W/Rh,W/Al,Mo/Mo,Rh/Rh,and Rh/Ag).The parameter dependence of the breast characteristics and beam conditions on D_(gN)^(DBT) in detailed breast models was investigated.The D_(gN)^(DBT) results were 14.6-51.0%lower than those of the traditional dosimetry standard in China.The difference in D_(gN)^(DBT) was mainly due to a decrease in the depth of the main energy deposition area caused by the glandular distribution along the depth direction.The results obtained in this study may be used to improve breast dosimetry in China and provide more detailed information on risk assessment during DBT.

A Traffic-Aware and Cluster-Based Energy Efficient Routing Protocol for IoT-Assisted WSNs

The seamless integration of intelligent Internet of Things devices with conventional wireless sensor networks has revolutionized data communication for different applications,such as remote health monitoring,industrial monitoring,transportation,and smart agriculture.Efficient and reliable data routing is one of the major challenges in the Internet of Things network due to the heterogeneity of nodes.This paper presents a traffic-aware,cluster-based,and energy-efficient routing protocol that employs traffic-aware and cluster-based techniques to improve the data delivery in such networks.The proposed protocol divides the network into clusters where optimal cluster heads are selected among super and normal nodes based on their residual energies.The protocol considers multi-criteria attributes,i.e.,energy,traffic load,and distance parameters to select the next hop for data delivery towards the base station.The performance of the proposed protocol is evaluated through the network simulator NS3.40.For different traffic rates,number of nodes,and different packet sizes,the proposed protocol outperformed LoRaWAN in terms of end-to-end packet delivery ratio,energy consumption,end-to-end delay,and network lifetime.For 100 nodes,the proposed protocol achieved a 13%improvement in packet delivery ratio,10 ms improvement in delay,and 10 mJ improvement in average energy consumption over LoRaWAN.

A new quantum key distribution resource allocation and routing optimization scheme

Quantum key distribution(QKD)is a technology that can resist the threat of quantum computers to existing conventional cryptographic protocols.However,due to the stringent requirements of the quantum key generation environment,the generated quantum keys are considered valuable,and the slow key generation rate conflicts with the high-speed data transmission in traditional optical networks.In this paper,for the QKD network with a trusted relay,which is mainly based on point-to-point quantum keys and has complex changes in network resources,we aim to allocate resources reasonably for data packet distribution.Firstly,we formulate a linear programming constraint model for the key resource allocation(KRA)problem based on the time-slot scheduling.Secondly,we propose a new scheduling scheme based on the graded key security requirements(GKSR)and a new micro-log key storage algorithm for effective storage and management of key resources.Finally,we propose a key resource consumption(KRC)routing optimization algorithm to properly allocate time slots,routes,and key resources.Simulation results show that the proposed scheme significantly improves the key distribution success rate and key resource utilization rate,among others.

Secure and Reliable Routing in the Internet of Vehicles Network:AODV-RL with BHA Attack Defense

Wireless technology is transforming the future of transportation through the development of the Internet of Vehicles(IoV).However,intricate security challenges are intertwinedwith technological progress:Vehicular ad hoc Networks(VANETs),a core component of IoV,face security issues,particularly the Black Hole Attack(BHA).This malicious attack disrupts the seamless flow of data and threatens the network’s overall reliability;also,BHA strategically disrupts communication pathways by dropping data packets from legitimate nodes altogether.Recognizing the importance of this challenge,we have introduced a new solution called ad hoc On-Demand Distance Vector-Reputation-based mechanism Local Outlier Factor(AODV-RL).The significance of AODVRL lies in its unique approach:it verifies and confirms the trustworthiness of network components,providing robust protection against BHA.An additional safety layer is established by implementing the Local Outlier Factor(LOF),which detects and addresses abnormal network behaviors.Rigorous testing of our solution has revealed its remarkable ability to enhance communication in VANETs.Specifically,Our experimental results achieve message delivery ratios of up to 94.25%andminimal packet loss ratios of just 0.297%.Based on our experimental results,the proposedmechanismsignificantly improves VANET communication reliability and security.These results promise a more secure and dependable future for IoV,capable of transforming transportation safety and efficiency.