MKEAH:Multimodal knowledge extraction and accumulation based on hyperplane embedding for knowledge-based visual question answering

Background External knowledge representations play an essential role in knowledge-based visual question and answering to better understand complex scenarios in the open world.Recent entity-relationship embedding approaches are deficient in representing some complex relations,resulting in a lack of topic-related knowledge and redundancy in topic-irrelevant information.Methods To this end,we propose MKEAH:Multimodal Knowledge Extraction and Accumulation on Hyperplanes.To ensure that the lengths of the feature vectors projected onto the hyperplane compare equally and to filter out sufficient topic-irrelevant information,two losses are proposed to learn the triplet representations from the complementary views:range loss and orthogonal loss.To interpret the capability of extracting topic-related knowledge,we present the Topic Similarity(TS)between topic and entity-relations.Results Experimental results demonstrate the effectiveness of hyperplane embedding for knowledge representation in knowledge-based visual question answering.Our model outperformed state-of-the-art methods by 2.12%and 3.24%on two challenging knowledge-request datasets:OK-VQA and KRVQA,respectively.Conclusions The obvious advantages of our model in TS show that using hyperplane embedding to represent multimodal knowledge can improve its ability to extract topic-related knowledge.

PAL-BERT:An Improved Question Answering Model

In the field of natural language processing(NLP),there have been various pre-training language models in recent years,with question answering systems gaining significant attention.However,as algorithms,data,and computing power advance,the issue of increasingly larger models and a growing number of parameters has surfaced.Consequently,model training has become more costly and less efficient.To enhance the efficiency and accuracy of the training process while reducing themodel volume,this paper proposes a first-order pruningmodel PAL-BERT based on the ALBERT model according to the characteristics of question-answering(QA)system and language model.Firstly,a first-order network pruning method based on the ALBERT model is designed,and the PAL-BERT model is formed.Then,the parameter optimization strategy of the PAL-BERT model is formulated,and the Mish function was used as an activation function instead of ReLU to improve the performance.Finally,after comparison experiments with traditional deep learning models TextCNN and BiLSTM,it is confirmed that PALBERT is a pruning model compression method that can significantly reduce training time and optimize training efficiency.Compared with traditional models,PAL-BERT significantly improves the NLP task’s performance.

Operational requirements analysis method based on question answering of WEKG

The weapon and equipment operational requirement analysis(WEORA) is a necessary condition to win a future war,among which the acquisition of knowledge about weapons and equipment is a great challenge. The main challenge is that the existing weapons and equipment data fails to carry out structured knowledge representation, and knowledge navigation based on natural language cannot efficiently support the WEORA. To solve above problem, this research proposes a method based on question answering(QA) of weapons and equipment knowledge graph(WEKG) to construct and navigate the knowledge related to weapons and equipment in the WEORA. This method firstly constructs the WEKG, and builds a neutral network-based QA system over the WEKG by means of semantic parsing for knowledge navigation. Finally, the method is evaluated and a chatbot on the QA system is developed for the WEORA. Our proposed method has good performance in the accuracy and efficiency of searching target knowledge, and can well assist the WEORA.

DPAL-BERT:A Faster and Lighter Question Answering Model

Recent advancements in natural language processing have given rise to numerous pre-training language models in question-answering systems.However,with the constant evolution of algorithms,data,and computing power,the increasing size and complexity of these models have led to increased training costs and reduced efficiency.This study aims to minimize the inference time of such models while maintaining computational performance.It also proposes a novel Distillation model for PAL-BERT(DPAL-BERT),specifically,employs knowledge distillation,using the PAL-BERT model as the teacher model to train two student models:DPAL-BERT-Bi and DPAL-BERTC.This research enhances the dataset through techniques such as masking,replacement,and n-gram sampling to optimize knowledge transfer.The experimental results showed that the distilled models greatly outperform models trained from scratch.In addition,although the distilled models exhibit a slight decrease in performance compared to PAL-BERT,they significantly reduce inference time to just 0.25%of the original.This demonstrates the effectiveness of the proposed approach in balancing model performance and efficiency.

ANSWERS模型及其应用

ANSWERS模型主要是针对欧洲平原地区研发的分散型物理模型。介绍了模型的研发历史、结构、输入和输出信息以及模型的应用。ANSWERS主要适用于缓坡地形区的径流模拟、侵蚀模拟和农业污染物运移模拟。如何根据中国的实际合理确定模型参数,使模型在我国复杂地形区应用,尚有许多问题需要研究。

土壤侵蚀建模中ANSWERS及地理信息系统ARC/INFO^R的应用研究

研究了土壤侵蚀模型ＡＮＳＷＥＲＳ和地理信息系统（ＧＩＳ）ＡＲＣ／ＩＮＦＯ之间的连结。采用ＡＲＣ／ＩＮＦＯ建立数据库和ＡＮＳＷＥＲＳ进行实际操作，加强了该模型在制定水保措施中的应用。同时，研究出的ＡＲＣＡＮＳ模型，使ＡＲＣ／ＩＮＦＯ和ＡＮＳＷＥＲＳ之间的连结更为容易、有效。最后，对四川紫色丘陵区的一个小流域实施了模拟，以展示连结情况和一些值得注意的问题。

AnswerSeeker:基于互联网挖掘的智能问答系统

智能问答系统是一种处理自然语言的新型的信息检索系统。介绍了AnswerSeeker智能问答系统,该系统采用了模块化和可扩展的框架,以便整合多种智能问答技术和多样化数据源。通过将与语言无关的代码和语言相关的代码分离,并且将语言相关的代码封装为组件,只要替换相应的组件,该系统可以适用于多种语言。由于很多自然语言处理技术还没有针对中文的,目前为止,我们系统的内核只支持英文,所以将以英语自然语言为例介绍AnswerSeeker的架构和工作原理。该系统采用了两种互联网挖掘的方法来寻找问题的答案:知识挖掘和知识诠释。AnswerSeeker使用网络作为一个知识源,当然它也可以使用其他小的语料库或面向专业领域的知识库作为知识源。此外,提出了一种新的问题的表示和答案提取的方法一文本模式,文本模式分为问题模式和答案模式;其中问题模式用来表示问题,答案模式用来提取精确的答案。AnswerSeeker通过将问题-答案对作为训练数据,自动学习答案模式。实验表明将互联网作为知识源,将模式学习和知识诠释的技术集成在同一系统中进行答案挖掘是一种这种很有前途的方法。

Google Answers及其对图书馆工作的启示

GoogleAnswers是Google推出的一项新服务。它将传统图书馆参考咨询服务技术有机的运用到网络中去并得到了用户的广泛好评。论文通过介绍GoogleAnswers的相关工作流程并将GoogleAn-swers与传统参考咨询进行对比,以期得到对当前图书馆事业发展的一些启示。

借鉴Google Answers构建高校图书馆咨询专家队伍

分析Google Answers,借鉴它的问答模式、用人政策等,从而构想依托高校专家教授的人力资源来建立高校图书馆的咨询专家队伍。

非点源污染模型ANSWERS-2000的水文子模型研究

非点源污染的前期过程，是在流域面上污染物质或是营养元素随着降雨径流的产生而产生。利用实验室大型土槽试验，研究ANSWERS-2000模型的水文子模型对于人工降雨事件的模拟精度，探索ANSWERS-2000在理想坡面上的适用情况，并且尽可能准确地给出其水文模型的部分参数的取值。经过计算发现该水文子模型模拟理想坡面的误差较小，但是存在系统偏大的情况；整个计算单元的Manning糙率取0．03～0．07。存在的问题有参数土表面结皮层厚度只能定性无法准确的定量描述；降雨装置测流装置对于径流模拟产生的影响较大。

ANSWER模型评估新疆咸水灌溉棉花产量与效益

利用咸水或微咸水进行农田灌溉是缓解中国新疆地区农业水资源供需矛盾从而保障当地棉花产业可持续发展的主要途径之一。为了明确不同咸水灌溉措施对棉花产量及经济效益的影响,该研究通过2 a的棉花膜下滴灌大田试验和文献检索获取了新疆9个不同试验地点的土壤、作物及灌溉等数据资料,评估作物产量-水盐胁迫响应分析模型(ANalytical Salt WatER,ANSWER)在新疆棉花产量评估中的适用性和可靠性,并结合经济收支平衡方法,模拟分析不同咸水灌溉措施(包括不同灌溉定额和灌溉水电导率的组合)对棉花产量与经济效益的影响。采用决定系数(R2)、均方根误差(root mean squared error,RMSE)、相对均方根误差(relative root mean squared error,RRMSE)评价模型精度。结果表明,在9个不同试验地点,ANSWER模型均可较准确地估算棉花的相对产量,其估算值与实测值之间的R^(2)≥0.54,RMSE≤0.14,RRMSE≤0.16;不同试验地点,优化获得的各个模型生物参数(与棉花根系吸水的水盐胁迫响应相关的参数)差异较小,变异系数的绝对值处于0.08~0.37之间;基于不同试验地点优化的各生物参数均值估算各地的棉花相对产量,其与实测值仍然吻合良好(R^(2)为0.59,RMSE为0.06,RRMSE为0.07);此外,当灌溉水电导率一定时,棉花净收益随灌溉定额增加呈先增后降的趋势,净收益达到峰值所需的灌溉定额随灌溉水电导率升高而迅速增加;当灌溉水电导率不大于10 dS/m时,通过加大供水量均可获得与淡水灌溉相当的净收益。研究可为新疆地区棉花产量与效益评估以及咸水资源合理开发利用提供理论依据。

The most important questions in cancer research and clinical oncology Question 2-5.Obesity-related cancers:more questions than answers

Obesity is recognized as the second highest risk factor for cancer. The pathogenic mechanisms underlying tobaccorelated cancers are well characterized and efective programs have led to a decline in smoking and related cancers, but there is a global epidemic of obesity without a clear understanding of how obesity causes cancer. Obesity is heterogeneous, and approximately 25% of obese individuals remain healthy(metabolically healthy obese, MHO), so which fat deposition(subcutaneous versus visceral, adipose versus ectopic) is "malignant"? What is the mechanism of carcinogenesis? Is it by metabolic dysregulation or chronic inflammation? Through which chemokines/genes/signaling pathways does adipose tissue influence carcinogenesis? Can selective inhibition of these pathways uncouple obesity from cancers? Do all obesity related cancers(ORCs) share a molecular signature? Are there common(overlapping) genetic loci that make individuals susceptible to obesity, metabolic syndrome, and cancers? Can we identify precursor lesions of ORCs and will early intervention of high risk individuals alter the natural history? It appears unlikely that the obesity epidemic will be controlled anytime soon; answers to these questions will help to reduce the adverse efect of obesity on human condition.

Analysis of community question-answering issues via machine learning and deep learning:State-of-the-art review

Over the last couple of decades,community question-answering sites(CQAs)have been a topic of much academic interest.Scholars have often leveraged traditional machine learning(ML)and deep learning(DL)to explore the ever-growing volume of content that CQAs engender.To clarify the current state of the CQA literature that has used ML and DL,this paper reports a systematic literature review.The goal is to summarise and synthesise the major themes of CQA research related to(i)questions,(ii)answers and(iii)users.The final review included 133 articles.Dominant research themes include question quality,answer quality,and expert identification.In terms of dataset,some of the most widely studied platforms include Yahoo!Answers,Stack Exchange and Stack Overflow.The scope of most articles was confined to just one platform with few cross-platform investigations.Articles with ML outnumber those with DL.Nonetheless,the use of DL in CQA research is on an upward trajectory.A number of research directions are proposed.

Questions and Answers

How to Differentiate and Treat Bi-syndrome by Acupuncture and Moxibustion?Bi-syndrome is the syndrome due to invasion of the exogenous pathogenic factors of wind, cold and dampness, which obstruct the channels and collaterals, leading to stagnated flow of qi and blood, characterized by such clinical manifestations as aching pain, numbness, heaviness, limited flexion and extension of the muscles, tendons and joints, or swelling and burning heat of the joints. This syndrome includes rheumatic arthritis, rheumatoid arthritis, osseous arthritis, and various neuralgia. The endogenous causative factors for the occurrence of Bi-syndrome are insufficiency of yang-qi, essence and blood, while the exogenous causative factors are the pathogenic wind, cold, and dampness. At the initial stage of the disease, the excessiveness of pathogen usually prevails, and the disease tends to be located in the limbs, skin and muscles, and channels and collaterals; while at the chronic stage, there often exists deficiency of the vital-qi or deficiency and excess intermixed, and the disease tends to be located deeper in the tendons and bones or in the zang-fu organs.

Expert Recommendation in Community Question Answering via Heterogeneous Content Network Embedding

ExpertRecommendation(ER)aims to identify domain experts with high expertise and willingness to provide answers to questions in Community Question Answering(CQA)web services.How to model questions and users in the heterogeneous content network is critical to this task.Most traditional methods focus on modeling questions and users based on the textual content left in the community while ignoring the structural properties of heterogeneous CQA networks and always suffering from textual data sparsity issues.Recent approaches take advantage of structural proximities between nodes and attempt to fuse the textual content of nodes for modeling.However,they often fail to distinguish the nodes’personalized preferences and only consider the textual content of a part of the nodes in network embedding learning,while ignoring the semantic relevance of nodes.In this paper,we propose a novel framework that jointly considers the structural proximity relations and textual semantic relevance to model users and questions more comprehensively.Specifically,we learn topology-based embeddings through a hierarchical attentive network learning strategy,in which the proximity information and the personalized preference of nodes are encoded and preserved.Meanwhile,we utilize the node’s textual content and the text correlation between adjacent nodes to build the content-based embedding through a meta-context-aware skip-gram model.In addition,the user’s relative answer quality is incorporated to promote the ranking performance.Experimental results show that our proposed framework consistently and significantly outperforms the state-of-the-art baselines on three real-world datasets by taking the deep semantic understanding and structural feature learning together.The performance of the proposed work is analyzed in terms of MRR,P@K,and MAP and is proven to be more advanced than the existing methodologies.

ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering

Recently,pre-trained language representation models such as bidirec-tional encoder representations from transformers(BERT)have been performing well in commonsense question answering(CSQA).However,there is a problem that the models do not directly use explicit information of knowledge sources existing outside.To augment this,additional methods such as knowledge-aware graph network(KagNet)and multi-hop graph relation network(MHGRN)have been proposed.In this study,we propose to use the latest pre-trained language model a lite bidirectional encoder representations from transformers(ALBERT)with knowledge graph information extraction technique.We also propose to applying the novel method,schema graph expansion to recent language models.Then,we analyze the effect of applying knowledge graph-based knowledge extraction techniques to recent pre-trained language models and confirm that schema graph expansion is effective in some extent.Furthermore,we show that our proposed model can achieve better performance than existing KagNet and MHGRN models in CommonsenseQA dataset.

On the Study of Teacher’s Question Types and Students’ Answers in Primary School English Teaching

Teachers’ questions have been regarded as an important component in foreign language teaching context. The present paper aims to present a brief investigation into teachers’ question types and students’ answers in primary school English teaching, and tries to draw some implications for primary school English teachers. The video was transcribed and analyzed by the researcher. According to what is surveyed in the study, some questioning strategies were put forward for primary English teaching in the future.