Classification of Conversational Sentences Using an Ensemble Pre-Trained Language Model with the Fine-Tuned Parameter

Sentence classification is the process of categorizing a sentence based on the context of the sentence.Sentence categorization requires more semantic highlights than other tasks,such as dependence parsing,which requires more syntactic elements.Most existing strategies focus on the general semantics of a conversation without involving the context of the sentence,recognizing the progress and comparing impacts.An ensemble pre-trained language model was taken up here to classify the conversation sentences from the conversation corpus.The conversational sentences are classified into four categories:information,question,directive,and commission.These classification label sequences are for analyzing the conversation progress and predicting the pecking order of the conversation.Ensemble of Bidirectional Encoder for Representation of Transformer(BERT),Robustly Optimized BERT pretraining Approach(RoBERTa),Generative Pre-Trained Transformer(GPT),DistilBERT and Generalized Autoregressive Pretraining for Language Understanding(XLNet)models are trained on conversation corpus with hyperparameters.Hyperparameter tuning approach is carried out for better performance on sentence classification.This Ensemble of Pre-trained Language Models with a Hyperparameter Tuning(EPLM-HT)system is trained on an annotated conversation dataset.The proposed approach outperformed compared to the base BERT,GPT,DistilBERT and XLNet transformer models.The proposed ensemble model with the fine-tuned parameters achieved an F1_score of 0.88.

A Modified CycleGAN for Multi-Organ Ultrasound Image Enhancement via Unpaired Pre-Training

Handheld ultrasound devices are known for their portability and affordability,making them widely utilized in underdeveloped areas and community healthcare for rapid diagnosis and early screening.However,the image quality of handheld ultrasound devices is not always satisfactory due to the limited equipment size,which hinders accurate diagnoses by doctors.At the same time,paired ultrasound images are difficult to obtain from the clinic because imaging process is complicated.Therefore,we propose a modified cycle generative adversarial network(cycleGAN) for ultrasound image enhancement from multiple organs via unpaired pre-training.We introduce an ultrasound image pre-training method that does not require paired images,alleviating the requirement for large-scale paired datasets.We also propose an enhanced block with different structures in the pre-training and fine-tuning phases,which can help achieve the goals of different training phases.To improve the robustness of the model,we add Gaussian noise to the training images as data augmentation.Our approach is effective in obtaining the best quantitative evaluation results using a small number of parameters and less training costs to improve the quality of handheld ultrasound devices.

Adapter Based on Pre-Trained Language Models for Classification of Medical Text

We present an approach to classify medical text at a sentence level automatically.Given the inherent complexity of medical text classification,we employ adapters based on pre-trained language models to extract information from medical text,facilitating more accurate classification while minimizing the number of trainable parameters.Extensive experiments conducted on various datasets demonstrate the effectiveness of our approach.

Enhancing Relational Triple Extraction in Specific Domains:Semantic Enhancement and Synergy of Large Language Models and Small Pre-Trained Language Models

In the process of constructing domain-specific knowledge graphs,the task of relational triple extraction plays a critical role in transforming unstructured text into structured information.Existing relational triple extraction models facemultiple challenges when processing domain-specific data,including insufficient utilization of semantic interaction information between entities and relations,difficulties in handling challenging samples,and the scarcity of domain-specific datasets.To address these issues,our study introduces three innovative components:Relation semantic enhancement,data augmentation,and a voting strategy,all designed to significantly improve the model’s performance in tackling domain-specific relational triple extraction tasks.We first propose an innovative attention interaction module.This method significantly enhances the semantic interaction capabilities between entities and relations by integrating semantic information fromrelation labels.Second,we propose a voting strategy that effectively combines the strengths of large languagemodels(LLMs)and fine-tuned small pre-trained language models(SLMs)to reevaluate challenging samples,thereby improving the model’s adaptability in specific domains.Additionally,we explore the use of LLMs for data augmentation,aiming to generate domain-specific datasets to alleviate the scarcity of domain data.Experiments conducted on three domain-specific datasets demonstrate that our model outperforms existing comparative models in several aspects,with F1 scores exceeding the State of the Art models by 2%,1.6%,and 0.6%,respectively,validating the effectiveness and generalizability of our approach.

基于24Model-D-ISM的地铁站火灾疏散影响因素研究

为预防地铁站火灾事故,深入了解地铁站火灾人员疏散影响因素间的内在联系与层次结构,基于第6版“2-4”模型(24Model)分析63起地铁站火灾疏散事故,充分考虑各个因素之间的交互作用,提取19个影响地铁站人员疏散的关键因素,建立地铁站火灾人员疏散影响因素指标体系;采用算子客观赋权法(C-OWA)改进决策试验与评价实验法(DEMATEL),确定地铁站火灾人员疏散的重要影响因素;在此基础上,采用解释结构模型(ISM)分析各个因素间的层次结构及相互作用路径,构建地铁站火灾人员疏散影响因素的多级递阶结构模型。研究结果表明:疏散引导、恐慌从众行为、人员拥挤为地铁站火灾人员疏散的关键影响因素;地铁站火灾人员疏散受表层因素、中间层因素、深层因素共同作用的影响,其中,疏散教育与培训、设施维护与检查、疏散预案等因素是根源影响因素,重视根源影响因素的改善有利于从本质上预防和控制事故的发生。

Construction and application of knowledge graph for grid dispatch fault handling based on pre-trained model

With the construction of new power systems,the power grid has become extremely large,with an increasing proportion of new energy and AC/DC hybrid connections.The dynamic characteristics and fault patterns of the power grid are complex;additionally,power grid control is difficult,operation risks are high,and the task of fault handling is arduous.Traditional power-grid fault handling relies primarily on human experience.The difference in and lack of knowledge reserve of control personnel restrict the accuracy and timeliness of fault handling.Therefore,this mode of operation is no longer suitable for the requirements of new systems.Based on the multi-source heterogeneous data of power grid dispatch,this paper proposes a joint entity–relationship extraction method for power-grid dispatch fault processing based on a pre-trained model,constructs a knowledge graph of power-grid dispatch fault processing and designs,and develops a fault-processing auxiliary decision-making system based on the knowledge graph.It was applied to study a provincial dispatch control center,and it effectively improved the accident processing ability and intelligent level of accident management and control of the power grid.

Leveraging Vision-Language Pre-Trained Model and Contrastive Learning for Enhanced Multimodal Sentiment Analysis

Multimodal sentiment analysis is an essential area of research in artificial intelligence that combines multiple modes,such as text and image,to accurately assess sentiment.However,conventional approaches that rely on unimodal pre-trained models for feature extraction from each modality often overlook the intrinsic connections of semantic information between modalities.This limitation is attributed to their training on unimodal data,and necessitates the use of complex fusion mechanisms for sentiment analysis.In this study,we present a novel approach that combines a vision-language pre-trained model with a proposed multimodal contrastive learning method.Our approach harnesses the power of transfer learning by utilizing a vision-language pre-trained model to extract both visual and textual representations in a unified framework.We employ a Transformer architecture to integrate these representations,thereby enabling the capture of rich semantic infor-mation in image-text pairs.To further enhance the representation learning of these pairs,we introduce our proposed multimodal contrastive learning method,which leads to improved performance in sentiment analysis tasks.Our approach is evaluated through extensive experiments on two publicly accessible datasets,where we demonstrate its effectiveness.We achieve a significant improvement in sentiment analysis accuracy,indicating the supe-riority of our approach over existing techniques.These results highlight the potential of multimodal sentiment analysis and underscore the importance of considering the intrinsic semantic connections between modalities for accurate sentiment assessment.

耦合优化蚁群算法与P-Median model的选址模型设计

为节省城建部门对于公共体育设施的投入成本以及提高城市人民生活质量,以运动场所优化选址为例,提出一种新型设施选址模型。该模型主要基于P-Median model(最小化阻抗模型)根据需求点数量从全部候选设施选址中选择设施空间位置,让用户达到离自己最近设施距离成本总和最小的目的,对选址的基本原则和实际情况提出要求,构造目标函数用于优化后蚁群算法求解进行选址工作。优化蚁群算法实现基于Python语言模块,通过改进蚁群原始信息素,提升原有算法的收敛速度,求出目标函数最优解,可以很好地模拟对于运动场所的选址。用二者耦合进行优势互补所设计的选址模型来搜寻研究区蚁群信息素浓度残留最大的栅格像元,从而确定未被已有设施点服务半径覆盖的最佳设施点建立位置。实验结果表明,该新型选址模型相较于最小化阻抗模型与最大化覆盖模型,新增优化设施点使整体服务半径覆盖率分别高出10.42%和6.95%,适合求解较为精确且小规模空间下的选址问题。

Mshpy23:a user-friendly,parameterized model of magnetosheath conditions

Lunar Environment heliospheric X-ray Imager(LEXI)and Solar wind−Magnetosphere−Ionosphere Link Explorer(SMILE)will observe magnetosheath and its boundary motion in soft X-rays for understanding magnetopause reconnection modes under various solar wind conditions after their respective launches in 2024 and 2025.Magnetosheath conditions,namely,plasma density,velocity,and temperature,are key parameters for predicting and analyzing soft X-ray images from the LEXI and SMILE missions.We developed a userfriendly model of magnetosheath that parameterizes number density,velocity,temperature,and magnetic field by utilizing the global Magnetohydrodynamics(MHD)model as well as the pre-existing gas-dynamic and analytic models.Using this parameterized magnetosheath model,scientists can easily reconstruct expected soft X-ray images and utilize them for analysis of observed images of LEXI and SMILE without simulating the complicated global magnetosphere models.First,we created an MHD-based magnetosheath model by running a total of 14 OpenGGCM global MHD simulations under 7 solar wind densities(1,5,10,15,20,25,and 30 cm)and 2 interplanetary magnetic field Bz components(±4 nT),and then parameterizing the results in new magnetosheath conditions.We compared the magnetosheath model result with THEMIS statistical data and it showed good agreement with a weighted Pearson correlation coefficient greater than 0.77,especially for plasma density and plasma velocity.Second,we compiled a suite of magnetosheath models incorporating previous magnetosheath models(gas-dynamic,analytic),and did two case studies to test the performance.The MHD-based model was comparable to or better than the previous models while providing self-consistency among the magnetosheath parameters.Third,we constructed a tool to calculate a soft X-ray image from any given vantage point,which can support the planning and data analysis of the aforementioned LEXI and SMILE missions.A release of the code has been uploaded to a Github repository.

24Model与LCM原因因素定义对比研究

为探究损失致因模型(LCM)原因因素定义与事故致因“2-4”模型(24Model)存在的异同和优缺点,梳理2个模型各层面原因和结果的定义,对比定义内容及其对事故原因分析等安全实务的指导作用,并以一起瓦斯爆炸事故为例加以实证分析,获得二者分析结果之间的差异。研究结果表明:LCM是首个将管理因素纳入事故致因分析的一维事件序列模型,可明确各层面原因因素的定义和因素间的逻辑关系,但部分定义存在交叉重复的问题,并没有揭示安全工作指导思想等深层次事故致因因素;24Model作为系统性事故致因模型,对各类因素的定义均以组织为主体,描述事件、事故、安全的概念内涵,划分个体安全动作、安全能力和组织安全管理体系的类别并给出含义解析,探究组织安全文化层面的问题并以32个元素体现;2个模型的事故原因分析方法均建立在对各层级原因因素定义的基础上,并适用于模型理论体系本身。

Assessing the Performance of CMIP6 Models in Simulating Droughts across Global Drylands

Both the attribution of historical change and future projections of droughts rely heavily on climate modeling. However,reasonable drought simulations have remained a challenge, and the related performances of the current state-of-the-art Coupled Model Intercomparison Project phase 6(CMIP6) models remain unknown. Here, both the strengths and weaknesses of CMIP6 models in simulating droughts and corresponding hydrothermal conditions in drylands are assessed.While the general patterns of simulated meteorological elements in drylands resemble the observations, the annual precipitation is overestimated by ~33%(with a model spread of 2.3%–77.2%), along with an underestimation of potential evapotranspiration(PET) by ~32%(17.5%–47.2%). The water deficit condition, measured by the difference between precipitation and PET, is 50%(29.1%–71.7%) weaker than observations. The CMIP6 models show weaknesses in capturing the climate mean drought characteristics in drylands, particularly with the occurrence and duration largely underestimated in the hyperarid Afro-Asian areas. Nonetheless, the drought-associated meteorological anomalies, including reduced precipitation, warmer temperatures, higher evaporative demand, and increased water deficit conditions, are reasonably reproduced. The simulated magnitude of precipitation(water deficit) associated with dryland droughts is overestimated by 28%(24%) compared to observations. The observed increasing trends in drought fractional area,occurrence, and corresponding meteorological anomalies during 1980–2014 are reasonably reproduced. Still, the increase in drought characteristics, associated precipitation and water deficit are obviously underestimated after the late 1990s,especially for mild and moderate droughts, indicative of a weaker response of dryland drought changes to global warming in CMIP6 models. Our results suggest that it is imperative to employ bias correction approaches in drought-related studies over drylands by using CMIP6 outputs.

Genetically modified non-human primate models for research on neurodegenerative diseases

Neurodegenerative diseases(NDs)are a group of debilitating neurological disorders that primarily affect elderly populations and include Alzheimer's disease(AD),Parkinson's disease(PD),Huntington's disease(HD),and amyotrophic lateral sclerosis(ALS).Currently,there are no therapies available that can delay,stop,or reverse the pathological progression of NDs in clinical settings.As the population ages,NDs are imposing a huge burden on public health systems and affected families.Animal models are important tools for preclinical investigations to understand disease pathogenesis and test potential treatments.While numerous rodent models of NDs have been developed to enhance our understanding of disease mechanisms,the limited success of translating findings from animal models to clinical practice suggests that there is still a need to bridge this translation gap.Old World nonhuman primates(NHPs),such as rhesus,cynomolgus,and vervet monkeys,are phylogenetically,physiologically,biochemically,and behaviorally most relevant to humans.This is particularly evident in the similarity of the structure and function of their central nervous systems,rendering such species uniquely valuable for neuroscience research.Recently,the development of several genetically modified NHP models of NDs has successfully recapitulated key pathologies and revealed novel mechanisms.This review focuses on the efficacy of NHPs in modeling NDs and the novel pathological insights gained,as well as the challenges associated with the generation of such models and the complexities involved in their subsequent analysis.

Large animal models for Huntington's disease research

Huntington'sdisease(HD)isahereditary neurodegenerative disorder for which there is currently no effectivetreatmentavailable.Consequently,the development of appropriate disease models is critical to thoroughly investigate disease progression.The genetic basis of HD involves the abnormal expansion of CAG repeats in the huntingtin(HTT)gene,leading to the expansion of a polyglutamine repeat in the HTT protein.Mutant HTT carrying the expanded polyglutamine repeat undergoes misfolding and forms aggregates in the brain,which precipitate selective neuronal loss in specific brain regions.Animal models play an important role in elucidating the pathogenesis of neurodegenerative disorders such as HD and in identifying potential therapeutic targets.Due to the marked species differences between rodents and larger animals,substantial efforts have been directed toward establishing large animal models for HD research.These models are pivotal for advancing the discovery of novel therapeutic targets,enhancing effective drug delivery methods,and improving treatment outcomes.We have explored the advantages of utilizing large animal models,particularly pigs,in previous reviews.Since then,however,significant progress has been made in developing more sophisticated animal models that faithfully replicate the typical pathology of HD.In the current review,we provide a comprehensive overview of large animal models of HD,incorporating recent findings regarding the establishment of HD knock-in(KI)pigs and their genetic therapy.We also explore the utilization of large animal models in HD research,with a focus on sheep,non-human primates(NHPs),and pigs.Our objective is to provide valuable insights into the application of these large animal models for the investigation and treatment of neurodegenerative disorders.

Genetically modified pigs:Emerging animal models for hereditary hearing loss

Hereditary hearing loss(HHL),a genetic disorder that impairs auditory function,significantly affects quality of life and incurs substantial economic losses for society.To investigate the underlying causes of HHL and evaluate therapeutic outcomes,appropriate animal models are necessary.Pigs have been extensively used as valuable large animal models in biomedical research.In this review,we highlight the advantages of pig models in terms of ear anatomy,inner ear morphology,and electrophysiological characteristics,as well as recent advancements in the development of distinct genetically modified porcine models of hearing loss.Additionally,we discuss the prospects,challenges,and recommendations regarding the use pig models in HHL research.Overall,this review provides insights and perspectives for future studies on HHL using porcine models.

Genome-edited rabbits:Unleashing the potential of a promising experimental animal model across diverse diseases

Animal models are extensively used in all aspects of biomedical research,with substantial contributions to our understanding of diseases,the development of pharmaceuticals,and the exploration of gene functions.The field of genome modification in rabbits has progressed slowly.However,recent advancements,particularly in CRISPR/Cas9-related technologies,have catalyzed the successful development of various genome-edited rabbit models to mimic diverse diseases,including cardiovascular disorders,immunodeficiencies,agingrelated ailments,neurological diseases,and ophthalmic pathologies.These models hold great promise in advancing biomedical research due to their closer physiological and biochemical resemblance to humans compared to mice.This review aims to summarize the novel gene-editing approaches currently available for rabbits and present the applications and prospects of such models in biomedicine,underscoring their impact and future potential in translational medicine.

Background removal from global auroral images:Data-driven dayglow modeling

Global images of auroras obtained by cameras on spacecraft are a key tool for studying the near-Earth environment.However,the cameras are sensitive not only to auroral emissions produced by precipitating particles,but also to dayglow emissions produced by photoelectrons induced by sunlight.Nightglow emissions and scattered sunlight can contribute to the background signal.To fully utilize such images in space science,background contamination must be removed to isolate the auroral signal.Here we outline a data-driven approach to modeling the background intensity in multiple images by formulating linear inverse problems based on B-splines and spherical harmonics.The approach is robust,flexible,and iteratively deselects outliers,such as auroral emissions.The final model is smooth across the terminator and accounts for slow temporal variations and large-scale asymmetries in the dayglow.We demonstrate the model by using the three far ultraviolet cameras on the Imager for Magnetopause-to-Aurora Global Exploration(IMAGE)mission.The method can be applied to historical missions and is relevant for upcoming missions,such as the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.

Fractal Fractional Order Operators in Computational Techniques for Mathematical Models in Epidemiology

New fractional operators, the COVID-19 model has been studied in this paper. By using different numericaltechniques and the time fractional parameters, the mechanical characteristics of the fractional order model areidentified. The uniqueness and existence have been established. Themodel’sUlam-Hyers stability analysis has beenfound. In order to justify the theoretical results, numerical simulations are carried out for the presented methodin the range of fractional order to show the implications of fractional and fractal orders.We applied very effectivenumerical techniques to obtain the solutions of themodel and simulations. Also, we present conditions of existencefor a solution to the proposed epidemicmodel and to calculate the reproduction number in certain state conditionsof the analyzed dynamic system. COVID-19 fractional order model for the case of Wuhan, China, is offered foranalysis with simulations in order to determine the possible efficacy of Coronavirus disease transmission in theCommunity. For this reason, we employed the COVID-19 fractal fractional derivative model in the example ofWuhan, China, with the given beginning conditions. In conclusion, again the mathematical models with fractionaloperators can facilitate the improvement of decision-making for measures to be taken in the management of anepidemic situation.

Model reduction of fractional impedance spectra for time–frequency analysis of batteries, fuel cells, and supercapacitors

Joint time–frequency analysis is an emerging method for interpreting the underlying physics in fuel cells,batteries,and supercapacitors.To increase the reliability of time–frequency analysis,a theoretical correlation between frequency-domain stationary analysis and time-domain transient analysis is urgently required.The present work formularizes a thorough model reduction of fractional impedance spectra for electrochemical energy devices involving not only the model reduction from fractional-order models to integer-order models and from high-to low-order RC circuits but also insight into the evolution of the characteristic time constants during the whole reduction process.The following work has been carried out:(i)the model-reduction theory is addressed for typical Warburg elements and RC circuits based on the continued fraction expansion theory and the response error minimization technique,respectively;(ii)the order effect on the model reduction of typical Warburg elements is quantitatively evaluated by time–frequency analysis;(iii)the results of time–frequency analysis are confirmed to be useful to determine the reduction order in terms of the kinetic information needed to be captured;and(iv)the results of time–frequency analysis are validated for the model reduction of fractional impedance spectra for lithium-ion batteries,supercapacitors,and solid oxide fuel cells.In turn,the numerical validation has demonstrated the powerful function of the joint time–frequency analysis.The thorough model reduction of fractional impedance spectra addressed in the present work not only clarifies the relationship between time-domain transient analysis and frequency-domain stationary analysis but also enhances the reliability of the joint time–frequency analysis for electrochemical energy devices.

Construction of a Computational Scheme for the Fuzzy HIV/AIDS Epidemic Model with a Nonlinear Saturated Incidence Rate

This work aimed to construct an epidemic model with fuzzy parameters.Since the classical epidemic model doesnot elaborate on the successful interaction of susceptible and infective people,the constructed fuzzy epidemicmodel discusses the more detailed versions of the interactions between infective and susceptible people.Thenext-generation matrix approach is employed to find the reproduction number of a deterministic model.Thesensitivity analysis and local stability analysis of the systemare also provided.For solving the fuzzy epidemic model,a numerical scheme is constructed which consists of three time levels.The numerical scheme has an advantage overthe existing forward Euler scheme for determining the conditions of getting the positive solution.The establishedscheme also has an advantage over existing non-standard finite difference methods in terms of order of accuracy.The stability of the scheme for the considered fuzzy model is also provided.From the plotted results,it can beobserved that susceptible people decay by rising interaction parameters.

Predictive factors and model validation of post-colon polyp surgery Helicobacter pylori infection

BACKGROUND Recently,research has linked Helicobacter pylori(H.pylori)stomach infection to colonic inflammation,mediated by toxin production,potentially impacting colorectal cancer occurrence.AIM To investigate the risk factors for post-colon polyp surgery,H.pylori infection,and its correlation with pathologic type.METHODS Eighty patients who underwent colon polypectomy in our hospital between January 2019 and January 2023 were retrospectively chosen.They were then randomly split into modeling(n=56)and model validation(n=24)sets using R.The modeling cohort was divided into an H.pylori-infected group(n=37)and an H.pylori-uninfected group(n=19).Binary logistic regression analysis was used to analyze the factors influencing the occurrence of H.pylori infection after colon polyp surgery.A roadmap prediction model was established and validated.Finally,the correlation between the different pathological types of colon polyps and the occurrence of H.pylori infection was analyzed after colon polyp surgery.RESULTS Univariate results showed that age,body mass index(BMI),literacy,alcohol consumption,polyp pathology type,high-risk adenomas,and heavy diet were all influential factors in the development of H.pylori infection after intestinal polypectomy.Binary multifactorial logistic regression analysis showed that age,BMI,and type of polyp pathology were independent predictors of the occurrence of H.pylori infection after intestinal polypectomy.The area under the receiver operating characteristic curve was 0.969[95%confidence interval(95%CI):0.928–1.000]and 0.898(95%CI:0.773–1.000)in the modeling and validation sets,respectively.The slope of the calibration curve of the graph was close to 1,and the goodness-of-fit test was P>0.05 in the two sets.The decision analysis curve showed a high rate of return in both sets.The results of the correlation analysis between different pathological types and the occurrence of H.pylori infection after colon polyp surgery showed that hyperplastic polyps,inflammatory polyps,and the occurrence of H.pylori infection were not significantly correlated.In contrast,adenomatous polyps showed a significant positive correlation with the occurrence of H.pylori infection.CONCLUSION Age,BMI,and polyps of the adenomatous type were independent predictors of H.pylori infection after intestinal polypectomy.Moreover,the further constructed column-line graph prediction model of H.pylori infection after intestinal polypectomy showed good predictive ability.