Efficient Penetration Testing Path Planning Based on Reinforcement Learning with Episodic Memory

Intelligent penetration testing is of great significance for the improvement of the security of information systems,and the critical issue is the planning of penetration test paths.In view of the difficulty for attackers to obtain complete network information in realistic network scenarios,Reinforcement Learning(RL)is a promising solution to discover the optimal penetration path under incomplete information about the target network.Existing RL-based methods are challenged by the sizeable discrete action space,which leads to difficulties in the convergence.Moreover,most methods still rely on experts’knowledge.To address these issues,this paper proposes a penetration path planning method based on reinforcement learning with episodic memory.First,the penetration testing problem is formally described in terms of reinforcement learning.To speed up the training process without specific prior knowledge,the proposed algorithm introduces episodic memory to store experienced advantageous strategies for the first time.Furthermore,the method offers an exploration strategy based on episodic memory to guide the agents in learning.The design makes full use of historical experience to achieve the purpose of reducing blind exploration and improving planning efficiency.Ultimately,comparison experiments are carried out with the existing RL-based methods.The results reveal that the proposed method has better convergence performance.The running time is reduced by more than 20%.

Volcanically Driven Terrestrial Environmental Perturbations during the Carnian Pluvial Episode in the Eastern Tethys

The Carnian Pluvial Episode(CPE)fingerprints global environmental perturbations and biological extinction on land and oceans and is potentially linked to the Wrangellia Large Igneous Province(LIP).However,the correlation between terrestrial environmental changes and Wrangellia volcanism in the Ordos Basin during the CPE remains poorly understood.Records of negative carbon isotopic excursions(NCIEs),mercury(Hg),Hg/TOC,and Hg enrichment factor(HgEF)from oil shales in a large-scale terrestrial Ordos Basin in the Eastern Tethys were correlated with marine and other terrestrial successions.The three significant NCIEs in the study section were consistently correlated with those in the CPE successions of Europe,the UK,and South and North China.The U-Pb geochronology indicates a Ladinian-Carnian age for the Chang 7 Member.A comprehensive overview of the geochronology,NCIE correlation,and previous bio-and chronostratigraphic frameworks shows that the Ladinian-Carnian boundary is located in the lower part of Chang 7 in the Yishicun section.HgEF may be a more reliable proxy for tracing volcanic eruptions than the Hg/TOC ratio because the accumulation rates of TOC content largely vary in terrestrial and marine successions.The records of Hg,Hg/TOC,HgEF,and NCIEs in the Ordos Basin aligned with Carnian successions worldwide and were marked by similar anomalies,indicating a global response to the Wrangellia LIP during the CPE.Anoxia,a warm-humid climate,enhancement of detrital input,and NCIEs are synchronous with the CPE interval in the Ordos Basin,which suggests that the CPE combined with the regional Qinling Orogeny should dominate the enhanced rate of terrigenous input and paleoenvironmental evolution in the Ordos Basin.

Sequence Thickness and its Response to Episodic Tectonic Evolution in Paleogene Qikou Sag, Bohaiwan Basin

The sequence stratigraphy framework of Paleogene of Qikou Sag has been built in this paper. The evolution law of episodic subsidence in Qikou Sag has been expounded, with the analysis of the characteristic of sequence thickness, as well as the study of consedimental tectonic activity, subsidence history, paleogeomorphology and the coupling relationship among them. The faults controlling action was the dominant mechanism during rifting stage I , as the depression was the dominant mechanism during rifting stage III, which embodies a process from intense disparity fault depression to integral subsidence. Meanwhile, under the control of regional faulting and later stage depression, subsidence rate centers and paleogeomorphic concave centers are always corresponding to the sequence thickness centers, and the changes of subsidence centers and paleogeomorphology concave centers are consistent with the migration of thickness centers, which presents the restriction, coupling and response among them and clarifies the law that tectonic activity controls the basin fill by means of controlling the subsidence rate and paleogeomorphology from contributing factor angle. On this basis, the dynamic evolution of the composite pattern of structure-subsidence-deposition in the fault controlling actic region during the three rifting stages and their petroleum geological significance has been discussed.

On the Geodynamic Mechanism of Episodic Uplift of the Tibetan Plateau during the Cenozoic Era

Multi-stage uplift of the Tibetan Plateau during the Cenozoic implies a complex geodynamic process.In this paper,we review main geodynamic models for the uplift of the plateau,and,in particular,analyze the spatio-temporal framework of the Cenozoic deformation structures,which are closely related to the deep geodynamic mechanism for the plateau uplift.From this perspective,significant change of the deformation regime over the Tibetan Plateau occurred by the middle-late Miocene,while thrust and thrust-folding system under NS compression was succeded by extension or stress-relaxation.Meanwhile,a series of large-scale strike-slip faults commenced or was kinemtically reversed.Based on a systematic synthesis of the structure deformation,magmatism,geomorphological process and geophysical exploration,we propose a periodical model of alternating crustal compression and extension for episodic uplift of the Tibetan Plateau.

Episodic Carbonate Deposits on the Triassic Continental Slope in Southern China

Abstract Episodic carbonate deposits on the Triassic continental slope in southern China are mainly composed of gravity-flow limestones and contourite limestones. Gravity-flow limestones were well developed in the lower and middle Yangtze area in the Early Triassic and in the Yunnan-Guizhou-Guangxi area in the Early and Middle Triassic. Five fundamental types of gravity-flow limestones are recognized: slide limestone, debris-flow limestone, grain-flow limestone, turbidite limestone and rockfall limestone. They form six types of assemblage beds: slide-debris-flow limestones, slide-debris-flow-turbidite limestone, slide-debris-flow-grain-flow-turbidite limestone, rockfall-debris-flow limestone, debris-flow-turbidite limestone, and debris-flow-grain-flow-turbidite limestone. The first two were formed mainly in the Early Triassic slopes. The Middle Triassic slopes were characterized by widespread rockfall limestone. Growth faults, storms, earthquakes and oversteepened slopes are considered to be the probable triggers of the gravity flows.

Measuring episodic abdominal pain and disability in suspected sphincter of Oddi dysfunction

AIM:To evaluate the reliability of an instrument that measures disability arising from episodic abdominal pain in patients with suspected sphincter of Oddi dysfunction(SOD).METHODS:Although several treatments have been utilized to reduce pain and associated disability,measurement tools have not been developed to reliably track outcomes.Two pilot studies were conducted to assess test-retest reliability of a newly developed instrument,the recurrent abdominal pain intensity and disability(RAPID) instrument.The RAPID score is a 90-d summation of days where productivity for various daily activities is reduced as a result of abdominal pain episodes,and is modeled after the migraine disability assessment instrument used to measure headache-related disability.RAPID was administered by telephone on 2 consecutive occasions in 2 consenting populations with suspected SOD:a pre-sphincterotomy population(Pilot Ⅰ,n = 55) and a post-sphincterotomy population(Pilot Ⅱ,n = 70).RESULTS:The average RAPID scores for Pilots Ⅰ and Ⅱ were:82 d(median:81.5 d,SD:64 d) and 48 d(median:0 d,SD:91 d),respectively.The concordance between the 2 assessments for both populations was very good:0.81 for the pre-sphincterotomy population and 0.95 for the post-sphincterotomy population.CONCLUSION:The described pilot studies suggest that RAPID is a reliable instrument for measuring disability resulting from abdominal pain in suspected SOD patients.

Fracturing and Episodic Fluid Expulsion in Pressure Compartments

The fracturing of the pressure compartments in sedimentary basins may not be caused completely by natural hydraulic fracturing. On the bases of fracture mechanics and numerical simulation, we consider that there are two mechanisms concerning the fracturing of pressure compartments, which are as follows: (1) natural hydraulic fracturing of the sediments within pressure compartments, and (2) tensile fracturing due to tangential traction. When the fracture, formed in the sediments within pressure compartments due to hydraulic fracturing, arrives at the base of the seal, the intensely tangential tensile stresses are created and lead to the fracturing of the seal. After the seal fractured, the fluid escaped from the pressure compartments. In a shallow pressure compartment, the duration of fracture opening and fluid expulsion is about 10-20 years in a cycle.

Base-Level Cycles and Episodic Coal Accumulation——Case Study of Dongsheng Coalfield in Ordos Basin

The advantage of high-resolution sequence stratigraphy, which takes base-levels as reference, is that it can be applied to continental depositional basins controlled by multiple factors and can effectively improve the accuracy and resolution of sequential stratigraphic analysis. Moreover, the principles of base-level cycles are also suitable for analyzing sequential stratigraphy in continental coal-bearing basins because of their accuracy in forecasting distribution of coal measures. By taking the Dongsheng coalfield in the Ordos basin as an example, the extensive application of base-level cycles in exploration and exploitation of coal is analyzed. The result shows that the Yan’an formation in the Dongsheng area is a long-term base-level cycle which is bordered by nonconformities and made up of five mid-term cycles and 13 short-term cycles. The long-term cycle and the mid-term cycles are obvious in comparison with a transverse profile. The episodic coal accumulation in the Mesozoic Ordos basin means that the deposition of primary matter (peat bogs) of coalification is discontinuous, periodical and cyclical in the evolution of the basin. The episodic accumulation of coal measures in the Yan’an stage is controlled by ascending-descending changes of a long-term cycle and middle-term cycles. Coal measures formed during the early and late periods of the long-term cycle are characterized by multiple layers, big cumulative thickness and poor continuity. Coal measures formed in the mid-term of the long cycle are dominated by good continuity, fewer layers and a small additive thickness, which is favorable for the accumulation of thick and continuous coal measures in the transition stage of mid term base-level cycles.

Potential Effects of Episodic Deposition on Nutrients and Heavy Metals in Decomposing Litters of Suaeda glauca in Salt Marsh of the Yellow River Estuary, China

Episodic deposition has been recognized as a major factor affecting the decomposition rate of detrital material in salt marshes. In this paper, three one-off burial treatments, no burial treatment(0 cm, NBT), current burial treatment(10 cm, CBT) and strong burial treatment(20 cm, SBT), were designed in intertidal zone of the Yellow River Estuary to determine the potential influences of episodic deposition on nutrient(C, N) and heavy metal(Pb, Cr, Cu, Zn, Ni, Mn, Cd, V and Co) variations in decomposing litters of Suaeda glauca. Results showed that although various burial treatments showed no statistical difference in decomposition rate of S. glauca, the values generally followed the sequence of CBT(0.002 403/d) > SBT(0.002 195/d) > NBT(0.002 060/d). The nutrients and heavy metals in decomposing litters of the three burial treatments exhibited different variations except for N, Cu, Cr, Ni and Co. Except for Mn, no significant differences in C, N, Pb, Cr, Cu, Zn, Ni, V and Co concentrations occurred among the three treatments(P > 0.05). With increasing burial depth, Cr and Cd levels generally increased while Cu, Ni and Mn concentrations decreased. Although episodic deposition was generally favorable for C and N release from S. glauca, its influence on release was insignificant. In the three burial treatments, Pb, Cr, Zn, Ni, Mn, V and Co stocks in S. glauca generally evidenced the export of metals from litter to environment, and, with increasing burial depth, the export amounts increased greatly. The S. glauca were particular efficient in binding Cd and releasing Pb, Cr, Zn, Ni, Mn, V and Co, and, with increasing burial depth, stocks of Cu in decomposing litters generally shifted from release to accumulation. The experiment indicated that the potential eco-toxic risk of Pb, Cr, Zn, Ni, Mn, V and Co exposure would be serious as the strong burial episodes occurred in S. glauca marsh.

Frequent Episodic Vertigo is an Unexpected Side Effect of Flutamide

An 82-year-old male suffered from prostatic cancer five years ago. Since then, he has taken flutamide and was bothered with episodic vertigo (EV) every morning. In order to treat prostatic cancer, flutamide was not discontinued, but conservative treatment and life-style change were recommended. Finally, EV actually subsided. Herein, we report the rare case, in which EV was an unexpected side effect of flutamide. Herein we review his whole history, physical examination, vestibular function test, electronystagmogram, caloric test, awake encephalogram, blood examinations, color-coded duplex ultrasonogram and magnetic resonance imaging/angiogram to suggest a mechanism of flutamide responsible for EV.

Numerical Modeling of Episodic Compaction and Its Efecting Parameters in Geopresured Shales

ＮｕｍｅｒｉｃａｌＭｏｄｅｌｉｎｇｏｆＥｐｉｓｏｄｉｃＣｏｍｐａｃｔｉｏｎａｎｄＩｔｓＥｆｅｃｔｉｎｇＰａｒａｍｅｔｅｒｓｉｎＧｅｏｐｒｅｓｕｒｅｄＳｈａｌｅｓ＊ＸｉｅＸｉｎｏｎｇＦａｃｕｌｔｙｏｆＥａｒｔｈＲｅｓｏｕｒｃｅｓ，ＣｈｉｎａＵｎｉｖｅｒ...

Precambrian Mantle Characteristics as Recorded by the Episodic Mafic Magmatism in the Liaodong Peninsula

1 Introduction Mafic rocks are widespread throughout the Liaodong Peninsula and vicinity,northeastern North China Craton,providing important constraints on their mantle source characteristics of individual episodes,as they have

Linked Data-based Slide Repository： The Episodic Slide Retrieval Using the Episodic Keyword Networks

This paper focuses on developing a system that allows presentation authors to effectively retrieve presentation slides for reuse from a large volume of existing presentation materials. We assume episodic memories of the authors can be used as contextual keywords in query expressions to efficiently dig out the expected slides for reuse rather than using only the part-of-slide-descriptions-based keyword queries. As a system, a new slide repository is proposed, composed of slide material collections, slide content data and pieces of information from authors＇ episodic memories related to each slide and presentation together with a slide retrieval application enabling authors to use the episodic memories as part of queries. The result of our experiment shows that the episodic memory-used queries can give more discoverability than the keyword-based queries. Additionally, an improvement model is discussed on the slide retrieval for further slide-finding efficiency by expanding the episodic memories model in the repository taking in the links with the author-and-slide-related data and events having been post on the private and social media sites.

Episodic Learning and Memory in Prodromal Huntington’s Disease: The Role of Multimodal Encoding and Selective Reminding

This study investigated episodic memory in prodromal HD. Three groups were compared (N = 70): mutation carriers with less than 12.5 years to disease onset (n = 16), mutation carriers with 12.5 or more years to disease onset (n = 16), and noncarriers (n = 38). Episodic memory was assessed using the Fuld Object Memory Evaluation, which included multimodal presentation and selective reminding, and the Claeson-Dahl Learning Test which included verbal repeated presentation and recall trials. Both carrier groups demonstrated deficient episodic memory compared to noncarriers. The results suggest deficient episodic memory in prodromal HD, and that inconsistent retrieval contributes to these deficits. Multimodal presentation attenuates the deficits.

X-linked Charcot-Marie-Tooth disease after SARS-CoV-2 vaccination mimicked stroke-like episodes: A case report

BACKGROUND Severe acute respiratory syndrome coronavirus 2(SARS-CoV-2) vaccinations have been administered worldwide, with occasional reports of associated neurological complications. Specifically, the impact of vaccinations on individuals with Xlinked Charcot-Marie-Tooth disease type 1(CMTX1) is unclear. Patients with CMTX1 can have stroke-like episodes with posterior reversible encephalopathy syndrome on magnetic resonance imaging(MRI), although this is rare.CASE SUMMARY A 39-year-old man was admitted with episodic aphasia and dysphagia for 2 d. He received SARS-CoV-2 vaccination 39 d before admission. Physical examination showed pes cavus and reduced tendon reflexes. Brain MRI showed bilateral, symmetrical, restricted diffusion with T2 hyperintensities in the cerebral hemispheres. Nerve conduction studies revealed peripheral nerve damage. He was diagnosed with Charcot-Marie-Tooth disease, and a hemizygous mutation in the GJB1 gene on the X chromosome, known to be pathogenic for CMTX1, was identified. Initially, we suspected transient ischemic attack or demyelinating leukoencephalopathy. We initiated treatment with antithrombotic therapy and immunotherapy. At 1.5 mo after discharge, brain MRI showed complete resolution of lesions, with no recurrence.CONCLUSION SARS-CoV-2 vaccination could be a predisposing factor for CMTX1 and trigger a sudden presentation.

首发的精神分裂症和抑郁症及双相障碍的治疗延迟(综述)

本文旨在综述首发的精神分裂症、抑郁症、双相障碍治疗延迟的相关研究,对3类首发精神障碍治疗延迟的影响因素进行比较,发现患者责任感提高、家庭凝聚力降低、病耻感、疾病相关知识匮乏、就医资源匮乏、医疗支持不足会导致治疗延迟,使患者病程更长,症状更重,影响其社会功能。

右江盆地卡林型金矿成矿年代学研究进展

右江盆地是全球仅次于美国内华达地区的第二大卡林型金矿床集中分布区。由于成矿时代的不确定性,盆地内卡林型金矿床的成矿动力学背景一直不清。为准确确定这些金矿床的成矿时代,近四十年来国内外矿床学家进行了孜孜不倦的探索,从早期以石英裂变径迹和流体包裹体Rb-Sr等时线法为代表的定年,到中期以硫化物Re-Os等时线法为代表的单矿物溶样法定年,再到最新以热液金红石、独居石和磷灰石U-Th-Pb法为代表的微区原位定年,其定年对象和方法见证了同位素地质年代学的发展历程。现已基本明确,右江盆地主要发育两期卡林型金矿成矿作用,分别为215~200 Ma和155~140 Ma,相当于印支期和燕山期,其动力学背景分别对应于印支-华南-华北地块碰撞后的印支期陆内造山过程以及燕山期软流圈上涌诱发的岩石圈伸展作用。

首发精神分裂症患者血清sTfR、FGF22水平与临床症状的关系及其诊断价值

目的探讨首发精神分裂症(FES)患者血清可溶性转铁蛋白受体(sTfR)及成纤维细胞生长因子22(FGF22)表达情况,分析二者与FES患者临床症状的关系并进行诊断价值分析。方法选取2021年3月至2023年2月在该院确诊的97例FES患者作为FES组,同期选取来该院体检的96例健康志愿者作为对照组。采用免疫透射比浊法检测sTfR水平,酶联免疫吸附试验(ELISA)检测FGF22水平,Spearman法分析FES患者血清中sTfR及FGF22水平与阳性与阴性病症量表(PANSS)评分及威斯康辛卡片分类测验(WCST)结果的相关性,受试者工作特征(ROC)曲线分析sTfR及FGF22水平对FES的临床诊断价值。结果两组在性别、年龄、体质量指数、受教育年限、饮酒史及吸烟史方面差异均无统计学意义(P>0.05),与对照组比较,FES组血清sTfR及FGF22水平均下降(P<0.05)。sTfR单独诊断FES的曲线下面积(AUC)为0.835,最佳截断值为4.606 mg/L,FGF22单独诊断FES的AUC为0.772,最佳截断值为208.333μg/L,二者联合诊断的AUC(0.921)大于sTfR单独诊断的AUC(Z=2.613,P=0.009)及FGF22单独诊断的AUC(Z=5.140,P<0.001);sTfR高水平组及FGF22高水平组的PANSS阳性症状评分、阴性症状评分、病理症状评分、总评分、WCST持续性错误数、错误应答数分别低于sTfR低水平组及FGF22低水平组(P<0.05),而WCST完成分类数、WCST正确应答数分别高于sTfR低水平组及FGF22低水平组(P<0.05);FES组中sTfR、FGF22水平与PANSS阳性症状评分、阴性症状评分、病理症状评分、总评分、WCST持续性错误数、WCST错误应答数均呈负相关(P<0.05),与WCST完成分类数及WCST正确应答数均呈正相关(P<0.05)。结论FES患者血清sTfR及FGF22水平下降,联合检测sTfR及FGF22水平对于FES的临床诊断具有重要意义。

首发未治疗精神分裂症患者并发高尿酸血症的相关因素分析

目的:分析首发未治疗精神分裂症住院患者并发高尿酸血症的相关因素。方法:纳入2021年1月至2022年12月在首都医科大学附属北京安定医院住院的首发未治疗的精神分裂患者,根据尿酸结果分为无高尿酸血症组(n=127)和有高尿酸血症组(n=73),对两组患者的一般人口学资料及相关指标进行比较,采用二项Logistic回归分析首发未治疗精神分裂症住院患者并发高尿酸血症的相关因素。结果:与无高尿酸血症患者组相比较,有高尿酸血症患者组的年龄及发病年龄小、精神疾病家族史阳性者比例高、吸烟者比例高、白蛋白低、三酰甘油高、高密度脂蛋白低、体质量指数(body mass index,BMI)高、有高血压及高血脂的比例高(P均<0.05)。分析结果显示,BMI高、阳性症状评分高均是首发未治疗精神分裂症住院患者患高尿酸血症的危险因素(OR均>1.00,P均<0.05);年龄小、不吸烟、未患有高血压及高血脂均是首发未治疗精神分裂症住院患者患高尿酸血症的保护因素(OR均<1.00,P均<0.05)。结论:首发未治疗精神分裂症患者的尿酸水平与精神症状相关,阳性症状、BMI指数、年龄、吸烟、高血压、高血脂是其患高尿酸血症的独立危险因素。

以凸面蛛网膜下腔出血为影像特征的脑淀粉样血管病临床特点分析

目的:探讨以急性凸面蛛网膜下腔出血(convexity subarachnoid hemorrhage,cSAH为影像特征的脑淀粉样血管病(cerebral amyloid angiopathy,CAA)的临床和影像学特点,及与患者脑出血再发的风险相关性。方法:回顾性分析2013年6月至2020年12月,北京安贞医院就诊的以cSAH为特征合改良Boston诊断标准的18例很可能的CAA患者,分析其流行病学资料、临床特点、头颅CT/头颅磁共振成像(magnetic resonance imaging,MRI)等信息。结果:18例患者男女比例为1:1.25,发病年龄59~91岁,平均(75±9)岁,最常见的临床症状为短暂性局灶性神经系统症状发作(transient focal neurological episodes,TFNE,12/18),头颅影像学表现为局限型(14/18)和弥漫型c SAH(4/18)。随访15个月,平均(15±5)个月,8例患者出现反复TFNE发作,4例再发c SAH,4例脑出血。结论:以cSAH为特征的CAA多见于老年人,TFNE为最常见的临床表现,头颅CT/MRI是最重要的诊断方法,应尽量避免抗栓治疗。