Efficient Penetration Testing Path Planning Based on Reinforcement Learning with Episodic Memory

Intelligent penetration testing is of great significance for the improvement of the security of information systems,and the critical issue is the planning of penetration test paths.In view of the difficulty for attackers to obtain complete network information in realistic network scenarios,Reinforcement Learning(RL)is a promising solution to discover the optimal penetration path under incomplete information about the target network.Existing RL-based methods are challenged by the sizeable discrete action space,which leads to difficulties in the convergence.Moreover,most methods still rely on experts’knowledge.To address these issues,this paper proposes a penetration path planning method based on reinforcement learning with episodic memory.First,the penetration testing problem is formally described in terms of reinforcement learning.To speed up the training process without specific prior knowledge,the proposed algorithm introduces episodic memory to store experienced advantageous strategies for the first time.Furthermore,the method offers an exploration strategy based on episodic memory to guide the agents in learning.The design makes full use of historical experience to achieve the purpose of reducing blind exploration and improving planning efficiency.Ultimately,comparison experiments are carried out with the existing RL-based methods.The results reveal that the proposed method has better convergence performance.The running time is reduced by more than 20%.

Promotion of structural plasticity in area V2 of visual cortex prevents against object recognition memory deficits in aging and Alzheimer's disease rodents

Memory deficit,which is often associated with aging and many psychiatric,neurological,and neurodegenerative diseases,has been a challenging issue for treatment.Up till now,all potential drug candidates have failed to produce satisfa ctory effects.Therefore,in the search for a solution,we found that a treatment with the gene corresponding to the RGS14414protein in visual area V2,a brain area connected with brain circuits of the ventral stream and the medial temporal lobe,which is crucial for object recognition memory(ORM),can induce enhancement of ORM.In this study,we demonstrated that the same treatment with RGS14414in visual area V2,which is relatively unaffected in neurodegenerative diseases such as Alzheimer s disease,produced longlasting enhancement of ORM in young animals and prevent ORM deficits in rodent models of aging and Alzheimer’s disease.Furthermore,we found that the prevention of memory deficits was mediated through the upregulation of neuronal arbo rization and spine density,as well as an increase in brain-derived neurotrophic factor(BDNF).A knockdown of BDNF gene in RGS14414-treated aging rats and Alzheimer s disease model mice caused complete loss in the upregulation of neuronal structural plasticity and in the prevention of ORM deficits.These findings suggest that BDNF-mediated neuronal structural plasticity in area V2 is crucial in the prevention of memory deficits in RGS14414-treated rodent models of aging and Alzheimer’s disease.Therefore,our findings of RGS14414gene-mediated activation of neuronal circuits in visual area V2 have therapeutic relevance in the treatment of memory deficits.

Machine learning-assisted efficient design of Cu-based shape memory alloy with specific phase transition temperature

The martensitic transformation temperature is the basis for the application of shape memory alloys(SMAs),and the ability to quickly and accurately predict the transformation temperature of SMAs has very important practical significance.In this work,machine learning(ML)methods were utilized to accelerate the search for shape memory alloys with targeted properties(phase transition temperature).A group of component data was selected to design shape memory alloys using reverse design method from numerous unexplored data.Component modeling and feature modeling were used to predict the phase transition temperature of the shape memory alloys.The experimental results of the shape memory alloys were obtained to verify the effectiveness of the support vector regression(SVR)model.The results show that the machine learning model can obtain target materials more efficiently and pertinently,and realize the accurate and rapid design of shape memory alloys with specific target phase transition temperature.On this basis,the relationship between phase transition temperature and material descriptors is analyzed,and it is proved that the key factors affecting the phase transition temperature of shape memory alloys are based on the strength of the bond energy between atoms.This work provides new ideas for the controllable design and performance optimization of Cu-based shape memory alloys.

Astrocytic endothelin-1 overexpression impairs learning and memory ability in ischemic stroke via altered hippocampal neurogenesis and lipid metabolism

Vascular etiology is the second most prevalent cause of cognitive impairment globally.Endothelin-1,which is produced and secreted by endothelial cells and astrocytes,is implicated in the pathogenesis of stroke.However,the way in which changes in astrocytic endothelin-1 lead to poststroke cognitive deficits following transient middle cerebral artery occlusion is not well understood.Here,using mice in which astrocytic endothelin-1 was overexpressed,we found that the selective overexpression of endothelin-1 by astrocytic cells led to ischemic stroke-related dementia(1 hour of ischemia;7 days,28 days,or 3 months of reperfusion).We also revealed that astrocytic endothelin-1 overexpression contributed to the role of neural stem cell proliferation but impaired neurogenesis in the dentate gyrus of the hippocampus after middle cerebral artery occlusion.Comprehensive proteome profiles and western blot analysis confirmed that levels of glial fibrillary acidic protein and peroxiredoxin 6,which were differentially expressed in the brain,were significantly increased in mice with astrocytic endothelin-1 overexpression in comparison with wild-type mice 28 days after ischemic stroke.Moreover,the levels of the enriched differentially expressed proteins were closely related to lipid metabolism,as indicated by Kyoto Encyclopedia of Genes and Genomes pathway analysis.Liquid chromatography-mass spectrometry nontargeted metabolite profiling of brain tissues showed that astrocytic endothelin-1 overexpression altered lipid metabolism products such as glycerol phosphatidylcholine,sphingomyelin,and phosphatidic acid.Overall,this study demonstrates that astrocytic endothelin-1 overexpression can impair hippocampal neurogenesis and that it is correlated with lipid metabolism in poststroke cognitive dysfunction.

Between the City and Images:An Analysis of Mainstream Media’s Paths of Constructing the Cultural Memory of a City:Taking Chengdu Radio and Television’s“Hi Chengdu”as an Example

Mainstream media play a crucial role in constructing the cultural memory of a city.This study used 319 short videos released by“Hi Chengdu,”a new media product of Chengdu Radio and Television,as samples.Based on the grounded theory,a research framework encompassing“content,technology,and discourse”was established to explore the paths through which mainstream media construct the cultural memory.Regarding content,this paper emphasized temporal and spatial contexts and urban spaces,delving deep into the themes of the cultural memory and vehicles for it.In terms of technology,this paper discussed the practice of leveraging audio/visual-mode discourse to stitch together the impressions of a city and evoke emotional resonance to create a“flow”of memory.As for discourse,this paper looked at the performance of a communication ritual to frame concepts and shape urban identity.It is essential to break free from conventional thinking and leverage local culture as the primary driving force to further boost a city’s productivity,in order to excel in cultural communication.

The Impact of Opioid Drugs on Memory and Other Cognitive Functions: A Review

Background and Purpose: Opioids, used for centuries to alleviate pain, have become a double-edged sword. While effective, they come with a host of adverse effects, including memory and cognition impairment. This review delves into the impact of opioid drugs on cognitive functions, explores underlying mechanisms, and investigates their prevalence in both medical care and illicit drug use. The ultimate goal is to find ways to mitigate their potential harm and address the ongoing opioid crisis. Methods: We sourced data from PubMed and Google Scholar, employing search combinations like “opioids,” “memory,” “cognition,” “amnesia,” “cognitive function,” “executive function,” and “inhibition.” Our focus was on English-language articles spanning from the inception of these databases up to the present. Results: The literature consistently reveals that opioid use, particularly at high doses, adversely affects memory and other cognitive functions. Longer deliberation times, impaired decision-making, impulsivity, and behavioral disorders are common consequences. Chronic high-dose opioid use is associated with conditions such as amnesiac syndrome (OAS), post-operative cognitive dysfunction (POCD), neonatal abstinence syndrome (NAS), depression, anxiety, sedation, and addiction. Alarming trends show increased opioid use over recent decades, amplifying the risk of these outcomes. Conclusion: Opioids cast a shadow over memory and cognitive function. These effects range from amnesiac effects, lessened cognitive function, depression, and more. Contributing factors include over-prescription, misuse, misinformation, and prohibition policies. Focusing on correct informational campaigns, removing punitive policies, and focusing on harm reduction strategies have been shown to lessen the abuse and use of opioids and thus helping to mitigate the adverse effects of these drugs. Further research into the impacts of opioids on cognitive abilities is also needed as they are well demonstrated in the literature, but the mechanism is not often completely understood.

Enhanced Memory-Safe Linux Security Modules (eLSMs) for Improving Security of Docker Containers for Data Centers

The adoption of Docker containers has revolutionized software deployment by providing a lightweight and efficient way to isolate applications in data centers. However, securing these containers, especially when handling sensitive data, poses significant challenges. Traditional Linux Security Modules (LSMs) such as SELinux and AppArmor have limitations in providing fine-grained access control to files within containers. This paper presents a novel approach using eBPF (extended Berkeley Packet Filter) to implement a LSM that focuses on file-oriented access control within Docker containers. The module allows the specification of policies that determine which programs can access sensitive files, providing enhanced security without relying solely on the host operating system’s major LSM.

Design and implementation of dual-mode configurable memory architecture for CNN accelerator

With the rapid development of deep learning algorithms,the computational complexity and functional diversity are increasing rapidly.However,the gap between high computational density and insufficient memory bandwidth under the traditional von Neumann architecture is getting worse.Analyzing the algorithmic characteristics of convolutional neural network(CNN),it is found that the access characteristics of convolution(CONV)and fully connected(FC)operations are very different.Based on this feature,a dual-mode reronfigurable distributed memory architecture for CNN accelerator is designed.It can be configured in Bank mode or first input first output(FIFO)mode to accommodate the access needs of different operations.At the same time,a programmable memory control unit is designed,which can effectively control the dual-mode configurable distributed memory architecture by using customized special accessing instructions and reduce the data accessing delay.The proposed architecture is verified and tested by parallel implementation of some CNN algorithms.The experimental results show that the peak bandwidth can reach 13.44 GB·s^(-1)at an operating frequency of 120 MHz.This work can achieve 1.40,1.12,2.80 and 4.70 times the peak bandwidth compared with the existing work.

Optimized operation scheme of flash-memory-based neural network online training with ultra-high endurance

With the rapid development of machine learning,the demand for high-efficient computing becomes more and more urgent.To break the bottleneck of the traditional Von Neumann architecture,computing-in-memory(CIM)has attracted increasing attention in recent years.In this work,to provide a feasible CIM solution for the large-scale neural networks(NN)requiring continuous weight updating in online training,a flash-based computing-in-memory with high endurance(10^(9) cycles)and ultrafast programming speed is investigated.On the one hand,the proposed programming scheme of channel hot electron injection(CHEI)and hot hole injection(HHI)demonstrate high linearity,symmetric potentiation,and a depression process,which help to improve the training speed and accuracy.On the other hand,the low-damage programming scheme and memory window(MW)optimizations can suppress cell degradation effectively with improved computing accuracy.Even after 109 cycles,the leakage current(I_(off))of cells remains sub-10pA,ensuring the large-scale computing ability of memory.Further characterizations are done on read disturb to demonstrate its robust reliabilities.By processing CIFAR-10 tasks,it is evident that~90%accuracy can be achieved after 109 cycles in both ResNet50 and VGG16 NN.Our results suggest that flash-based CIM has great potential to overcome the limitations of traditional Von Neumann architectures and enable high-performance NN online training,which pave the way for further development of artificial intelligence(AI)accelerators.

The study of lithographic variation in resistive random access memory

Reducing the process variation is a significant concern for resistive random access memory(RRAM).Due to its ultrahigh integration density,RRAM arrays are prone to lithographic variation during the lithography process,introducing electrical variation among different RRAM devices.In this work,an optical physical verification methodology for the RRAM array is developed,and the effects of different layout parameters on important electrical characteristics are systematically investigated.The results indicate that the RRAM devices can be categorized into three clusters according to their locations and lithography environments.The read resistance is more sensitive to the locations in the array(~30%)than SET/RESET voltage(<10%).The increase in the RRAM device length and the application of the optical proximity correction technique can help to reduce the variation to less than 10%,whereas it reduces RRAM read resistance by 4×,resulting in a higher power and area consumption.As such,we provide design guidelines to minimize the electrical variation of RRAM arrays due to the lithography process.

Garcinia Kola and Kolaviron Attenuates Bisphenol A-Induced Memory Impairment and Hippocampal Neuroinflammation in Male Wistar Rats

Bisphenol A (BPA), a toxicant which can leach into food from plastic containers, is reported to induce neurotoxicity among others via oxidative mechanisms. However, antioxidant compounds have been suggested to mitigate BPA-induced toxicities. Garcinia kola (GK) and its bioactive compound, kolaviron, are well-established natural antioxidants, which can exert protective effects against BPA-induced toxicities. This study was designed to investigate the likely mitigating effect of GK and kolaviron on BPA-induced memory impairment and hippocampal neuroinflammation in male Wistar rats. Thirty-five rats were equally grouped and treated as follows: I and II received distilled water and corn oil, respectively at 0.2 mL, while III - VII received BPA (50 mg/kg), BPA + GK (200 mg/kg), BPA + kolaviron (200 mg/kg), GK and kolaviron, respectively for 28 days p.o. Thereafter, behavioral studies were done using the Novel Object Recognition and Y maze tests. Subsequently under anaesthesia, the hippocampus in each animal was dissected out, homogenized and analysed for malondialdehyde, superoxide dismutase, catalase, reduced glutathione, glutathione transferase, nitrites, interleukin-6, tumour necrosis factor-α, acetylcholinesterase, glutamate acid decarboxylase, and arginase activity. Data were analyzed by ANOVA and Tukey Post-hoc test at p p Garcinia kola and Kolaviron mitigate bisphenol A-induced memory impairment and neuroinflammation via antioxidant potentiation and neurotransmitter balance.

Memory effect in time fractional Schrödinger equation

A significant obstacle impeding the advancement of the time fractional Schrodinger equation lies in the challenge of determining its precise mathematical formulation.In order to address this,we undertake an exploration of the time fractional Schrodinger equation within the context of a non-Markovian environment.By leveraging a two-level atom as an illustrative case,we find that the choice to raise i to the order of the time derivative is inappropriate.In contrast to the conventional approach used to depict the dynamic evolution of quantum states in a non-Markovian environment,the time fractional Schrodinger equation,when devoid of fractional-order operations on the imaginary unit i,emerges as a more intuitively comprehensible framework in physics and offers greater simplicity in computational aspects.Meanwhile,we also prove that it is meaningless to study the memory of time fractional Schrodinger equation with time derivative 1<α≤2.It should be noted that we have not yet constructed an open system that can be fully described by the time fractional Schrodinger equation.This will be the focus of future research.Our study might provide a new perspective on the role of time fractional Schrodinger equation.

Fabrication and integration of photonic devices for phase-change memory and neuromorphic computing

In the past decade,there has been tremendous progress in integrating chalcogenide phase-change materials(PCMs)on the silicon photonic platform for non-volatile memory to neuromorphic in-memory computing applications.In particular,these non von Neumann computational elements and systems benefit from mass manufacturing of silicon photonic integrated circuits(PICs)on 8-inch wafers using a 130 nm complementary metal-oxide semiconductor line.Chip manufacturing based on deep-ultraviolet lithography and electron-beam lithography enables rapid prototyping of PICs,which can be integrated with high-quality PCMs based on the wafer-scale sputtering technique as a back-end-of-line process.In this article,we present an overview of recent advances in waveguide integrated PCM memory cells,functional devices,and neuromorphic systems,with an emphasis on fabrication and integration processes to attain state-of-the-art device performance.After a short overview of PCM based photonic devices,we discuss the materials properties of the functional layer as well as the progress on the light guiding layer,namely,the silicon and germanium waveguide platforms.Next,we discuss the cleanroom fabrication flow of waveguide devices integrated with thin films and nanowires,silicon waveguides and plasmonic microheaters for the electrothermal switching of PCMs and mixed-mode operation.Finally,the fabrication of photonic and photonic–electronic neuromorphic computing systems is reviewed.These systems consist of arrays of PCM memory elements for associative learning,matrix-vector multiplication,and pattern recognition.With large-scale integration,the neuromorphic photonic computing paradigm holds the promise to outperform digital electronic accelerators by taking the advantages of ultra-high bandwidth,high speed,and energy-efficient operation in running machine learning algorithms.

A novel one-time-programmable memory unit based on Schottky-type p-GaN diode

In this work,a novel one-time-programmable memory unit based on a Schottky-type p-GaN diode is proposed.During the programming process,the junction switches from a high-resistance state to a low-resistance state through Schottky junction breakdown,and the state is permanently preserved.The memory unit features a current ratio of more than 10^(3),a read voltage window of 6 V,a programming time of less than 10^(−4)s,a stability of more than 108 read cycles,and a lifetime of far more than 10 years.Besides,the fabrication of the device is fully compatible with commercial Si-based GaN process platforms,which is of great significance for the realization of low-cost read-only memory in all-GaN integration.

Electromagnetic Performance Analysis of Variable Flux Memory Machines with Series-magnetic-circuit and Different Rotor Topologies

In this paper,the electromagnetic performance of variable flux memory(VFM)machines with series-magnetic-circuit is investigated and compared for different rotor topologies.Based on a V-type VFM machine,five topologies with different interior permanent magnet(IPM)arrangements are evolved and optimized under same constrains.Based on two-dimensional(2-D)finite element(FE)method,their electromagnetic performance at magnetization and demagnetization states is evaluated.It reveals that the iron bridge and rotor lamination region between constant PM(CPM)and variable PM(VPM)play an important role in torque density and flux regulation(FR)capabilities.Besides,the global efficiency can be improved in VFM machines by adjusting magnetization state(MS)under different operating conditions.

Cognitive Navigation for Intelligent Mobile Robots:A Learning-Based Approach With Topological Memory Configuration

Autonomous navigation for intelligent mobile robots has gained significant attention,with a focus on enabling robots to generate reliable policies based on maintenance of spatial memory.In this paper,we propose a learning-based visual navigation pipeline that uses topological maps as memory configurations.We introduce a unique online topology construction approach that fuses odometry pose estimation and perceptual similarity estimation.This tackles the issues of topological node redundancy and incorrect edge connections,which stem from the distribution gap between the spatial and perceptual domains.Furthermore,we propose a differentiable graph extraction structure,the topology multi-factor transformer(TMFT).This structure utilizes graph neural networks to integrate global memory and incorporates a multi-factor attention mechanism to underscore elements closely related to relevant target cues for policy generation.Results from photorealistic simulations on image-goal navigation tasks highlight the superior navigation performance of our proposed pipeline compared to existing memory structures.Comprehensive validation through behavior visualization,interpretability tests,and real-world deployment further underscore the adapt-ability and efficacy of our method.

Advances of embedded resistive random access memory in industrial manufacturing and its potential applications

Embedded memory,which heavily relies on the manufacturing process,has been widely adopted in various industrial applications.As the field of embedded memory continues to evolve,innovative strategies are emerging to enhance performance.Among them,resistive random access memory(RRAM)has gained significant attention due to its numerousadvantages over traditional memory devices,including high speed(<1 ns),high density(4 F^(2)·n^(-1)),high scalability(~nm),and low power consumption(~pJ).This review focuses on the recent progress of embedded RRAM in industrial manufacturing and its potentialapplications.It provides a brief introduction to the concepts and advantages of RRAM,discusses the key factors that impact its industrial manufacturing,and presents the commercial progress driven by cutting-edge nanotechnology,which has been pursued by manysemiconductor giants.Additionally,it highlights the adoption of embedded RRAM in emerging applications within the realm of the Internet of Things and future intelligent computing,with a particular emphasis on its role in neuromorphic computing.Finally,the review discusses thecurrent challenges and provides insights into the prospects of embedded RRAM in the era of big data and artificial intelligence.

Relationship between physical activity and specific working memory indicators of depressive symptoms in university students

BACKGROUND The detection rate of depression among university students has been increasing in recent years,becoming one of the main psychological diseases that endangers their physical and mental health.According to statistics,self-harm and suicide,for which there is no effective intervention,are the second leading causes of death.AIM To explore the relationship between different elements and levels of physical activity and college students’depression-symptom-specific working memory indicators.METHODS Of 143 college students were analyzed using the Beck Depression Self-Rating Scale,the Physical Activity Rating Scale,and the Working Memory Task.RESULTS There was a significant difference between college students with depressive symptoms and healthy college students in completing verbal and spatial working memory(SWM)tasks correctly(all P<0.01).Physical Activity Scale-3 scores were significantly and positively correlated with the correct rate of the verbal working memory task(r=0.166)and the correct rate of the SWM task(r=0.210)(all P<0.05).There were significant differences in the correct rates of verbal and SWM tasks according to different exercise intensities(all P<0.05)and different exercise durations(all P<0.05),and no significant differences in the correct rates of verbal and SWM tasks by exercise frequency(all P>0.05).CONCLUSION An increase in physical exercise among college students,particularly medium-and high-intensity exercise and exercise of 30 min or more,can improve the correct rate of completing working memory tasks.

Positive Effect of Transcranial Direct Current Stimulation on Visual Verbal Working Memory in Patients with Attention-Deficit/Hyperactivity Disorder

Background: Working memory is an executive function that plays an important role in many aspects of daily life, and its impairment in patients with attention-deficit/hyperactivity disorder (ADHD) affects quality of life. The dorsolateral prefrontal cortex (DLPFC) has been a good target site for transcranial direct current stimulation (tDCS) due to its intense involvement in working memory. In our 2018 study, tDCS improved visual-verbal working memory in healthy subjects. Objective: This study examines the effects of tDCS on ADHD patients, particularly on verbal working memory. Methods: We conducted an experiment involving verbal working memory of two modalities, visual and auditory, and a sustained attention task that could affect working memory in 9 ADHD patients. Active or sham tDCS was applied to the left DLPFC in a single-blind crossover design. Results: tDCS significantly improved the accuracy of visual-verbal working memory. In contrast, tDCS did not affect auditory-verbal working memory and sustained attention. Conclusion: tDCS to the left DLPFC improved visual-verbal working memory in ADHD patients, with important implications for potential ADHD treatments.

The complex roles of m^(6)A modifications in neural stem cell proliferation, differentiation, and self-renewal and implications for memory and neurodegenerative diseases

N6-methyladenosine(m^(6)A), the most prevalent and conserved RNA modification in eukaryotic cells, profoundly influences virtually all aspects of mRNA metabolism. mRNA plays crucial roles in neural stem cell genesis and neural regeneration, where it is highly concentrated and actively involved in these processes. Changes in m^(6)A modification levels and the expression levels of related enzymatic proteins can lead to neurological dysfunction and contribute to the development of neurological diseases. Furthermore, the proliferation and differentiation of neural stem cells, as well as nerve regeneration, are intimately linked to memory function and neurodegenerative diseases. This paper presents a comprehensive review of the roles of m^(6)A in neural stem cell proliferation, differentiation, and self-renewal, as well as its implications in memory and neurodegenerative diseases. m^(6)A has demonstrated divergent effects on the proliferation and differentiation of neural stem cells. These observed contradictions may arise from the time-specific nature of m^(6)A and its differential impact on neural stem cells across various stages of development. Similarly, the diverse effects of m^(6)A on distinct types of memory could be attributed to the involvement of specific brain regions in memory formation and recall. Inconsistencies in m^(6)A levels across different models of neurodegenerative disease, particularly Alzheimer's disease and Parkinson's disease, suggest that these disparities are linked to variations in the affected brain regions. Notably, the opposing changes in m^(6)A levels observed in Parkinson's disease models exposed to manganese compared to normal Parkinson's disease models further underscore the complexity of m^(6)A's role in neurodegenerative processes. The roles of m^(6)A in neural stem cell proliferation, differentiation, and self-renewal, and its implications in memory and neurodegenerative diseases, appear contradictory. These inconsistencies may be attributed to the timespecific nature of m^(6)A and its varying effects on distinct brain regions and in different environments.