Editors Yang Wang,Xi'an Jiaotong University Dongbo Shi,Shanghai Jiaotong University Ye Sun,University College London Zhesi Shen,National Science Library,CAS Topic of the Special Issue What are the top questions to...Editors Yang Wang,Xi'an Jiaotong University Dongbo Shi,Shanghai Jiaotong University Ye Sun,University College London Zhesi Shen,National Science Library,CAS Topic of the Special Issue What are the top questions towards better science and innovation and the required data to answer these questions?展开更多
The described structural model tries to answer some open questions such as: Why do quarks not exist in the open state? Where are the antiparticles from the Big Bang?
Background External knowledge representations play an essential role in knowledge-based visual question and answering to better understand complex scenarios in the open world.Recent entity-relationship embedding appro...Background External knowledge representations play an essential role in knowledge-based visual question and answering to better understand complex scenarios in the open world.Recent entity-relationship embedding approaches are deficient in representing some complex relations,resulting in a lack of topic-related knowledge and redundancy in topic-irrelevant information.Methods To this end,we propose MKEAH:Multimodal Knowledge Extraction and Accumulation on Hyperplanes.To ensure that the lengths of the feature vectors projected onto the hyperplane compare equally and to filter out sufficient topic-irrelevant information,two losses are proposed to learn the triplet representations from the complementary views:range loss and orthogonal loss.To interpret the capability of extracting topic-related knowledge,we present the Topic Similarity(TS)between topic and entity-relations.Results Experimental results demonstrate the effectiveness of hyperplane embedding for knowledge representation in knowledge-based visual question answering.Our model outperformed state-of-the-art methods by 2.12%and 3.24%on two challenging knowledge-request datasets:OK-VQA and KRVQA,respectively.Conclusions The obvious advantages of our model in TS show that using hyperplane embedding to represent multimodal knowledge can improve its ability to extract topic-related knowledge.展开更多
In the field of natural language processing(NLP),there have been various pre-training language models in recent years,with question answering systems gaining significant attention.However,as algorithms,data,and comput...In the field of natural language processing(NLP),there have been various pre-training language models in recent years,with question answering systems gaining significant attention.However,as algorithms,data,and computing power advance,the issue of increasingly larger models and a growing number of parameters has surfaced.Consequently,model training has become more costly and less efficient.To enhance the efficiency and accuracy of the training process while reducing themodel volume,this paper proposes a first-order pruningmodel PAL-BERT based on the ALBERT model according to the characteristics of question-answering(QA)system and language model.Firstly,a first-order network pruning method based on the ALBERT model is designed,and the PAL-BERT model is formed.Then,the parameter optimization strategy of the PAL-BERT model is formulated,and the Mish function was used as an activation function instead of ReLU to improve the performance.Finally,after comparison experiments with traditional deep learning models TextCNN and BiLSTM,it is confirmed that PALBERT is a pruning model compression method that can significantly reduce training time and optimize training efficiency.Compared with traditional models,PAL-BERT significantly improves the NLP task’s performance.展开更多
The weapon and equipment operational requirement analysis(WEORA) is a necessary condition to win a future war,among which the acquisition of knowledge about weapons and equipment is a great challenge. The main challen...The weapon and equipment operational requirement analysis(WEORA) is a necessary condition to win a future war,among which the acquisition of knowledge about weapons and equipment is a great challenge. The main challenge is that the existing weapons and equipment data fails to carry out structured knowledge representation, and knowledge navigation based on natural language cannot efficiently support the WEORA. To solve above problem, this research proposes a method based on question answering(QA) of weapons and equipment knowledge graph(WEKG) to construct and navigate the knowledge related to weapons and equipment in the WEORA. This method firstly constructs the WEKG, and builds a neutral network-based QA system over the WEKG by means of semantic parsing for knowledge navigation. Finally, the method is evaluated and a chatbot on the QA system is developed for the WEORA. Our proposed method has good performance in the accuracy and efficiency of searching target knowledge, and can well assist the WEORA.展开更多
目的探讨Yes关联蛋白1(Yes-associated protein 1,YAP1)在食管鳞状细胞癌组织中的表达情况及临床意义。方法采用免疫组化技术检测439例食管鳞状细胞癌患者癌组织中YAP1的表达,分析YAP1阳性组与阴性组患者的临床病理参数差异。采用Kaplan...目的探讨Yes关联蛋白1(Yes-associated protein 1,YAP1)在食管鳞状细胞癌组织中的表达情况及临床意义。方法采用免疫组化技术检测439例食管鳞状细胞癌患者癌组织中YAP1的表达,分析YAP1阳性组与阴性组患者的临床病理参数差异。采用Kaplan-Meier生存曲线分析YAP1对患者生存的影响。结果食管鳞状细胞癌中,YAP1的阳性率为30.52%(134/439)。YAP1阳性组患者肿瘤浸润更深(P<0.001)。Kaplan-Meier生存曲线分析显示,在生存期长于30个月的患者中,YAP1阳性者无瘤生存期(disease-free survival,DFS)和总生存期(overall survival,OS)更长(P<0.05)。Cox多因素回归分析显示,浸润深度是影响患者DFS(HR=1.371,95%CI 0.993~1.894,P=0.035)和OS(HR=1.489,95%CI 1.066~2.080,P=0.020)的独立因素。结论YAP1在部分食管鳞状细胞癌中表达;对于生存期大于30个月的患者,YAP1表达阳性提示预后更好。展开更多
Recent advancements in natural language processing have given rise to numerous pre-training language models in question-answering systems.However,with the constant evolution of algorithms,data,and computing power,the ...Recent advancements in natural language processing have given rise to numerous pre-training language models in question-answering systems.However,with the constant evolution of algorithms,data,and computing power,the increasing size and complexity of these models have led to increased training costs and reduced efficiency.This study aims to minimize the inference time of such models while maintaining computational performance.It also proposes a novel Distillation model for PAL-BERT(DPAL-BERT),specifically,employs knowledge distillation,using the PAL-BERT model as the teacher model to train two student models:DPAL-BERT-Bi and DPAL-BERTC.This research enhances the dataset through techniques such as masking,replacement,and n-gram sampling to optimize knowledge transfer.The experimental results showed that the distilled models greatly outperform models trained from scratch.In addition,although the distilled models exhibit a slight decrease in performance compared to PAL-BERT,they significantly reduce inference time to just 0.25%of the original.This demonstrates the effectiveness of the proposed approach in balancing model performance and efficiency.展开更多
Questions which were conventionally designed to check reading comprehension can also be used to enhance understanding. Different types of questions can be designed to achieve different purposes in reading. While desig...Questions which were conventionally designed to check reading comprehension can also be used to enhance understanding. Different types of questions can be designed to achieve different purposes in reading. While designing questions, teachers should take into consideration such points as the language used, manner of presentation and types of questions etc. Moreover, once questions have been designed, it’s essential for teachers to think about the techniques for the use of these questions. If appro- priately used, questions contribute greatly to students’ understanding of what they’ re reading by helping to explore the meaning that language conveys, in addition to developing proper reading skills. Therefore, teachers should be able to teach reading with well-designed questions so that the ultimate goal of understanding the text is likely to be achieved.展开更多
In literature,differences in the description of female and male characters have been noticeable for a long time.In this study,the novel Jane Eyre is uses as a material to investigate whether there are in fact any sign...In literature,differences in the description of female and male characters have been noticeable for a long time.In this study,the novel Jane Eyre is uses as a material to investigate whether there are in fact any significant differences in the questions Mr.Rochester and Jane use and how the questions function to portray these two main characters.展开更多
In the fast reading classroom the main work for the teacher isto ask questionsfor the sake of checking students'comprehension of the text in question. Questions could be classified according to different criteria....In the fast reading classroom the main work for the teacher isto ask questionsfor the sake of checking students'comprehension of the text in question. Questions could be classified according to different criteria. This paper classifies the questions according to the teaching procedures,and suggests a few principles to ask questions.展开更多
Based on personal observation and students’ self-reports, this article studies the characteristics presented by students in answering questions. It is found that Chinese culture plays an important part in explaining ...Based on personal observation and students’ self-reports, this article studies the characteristics presented by students in answering questions. It is found that Chinese culture plays an important part in explaining their specific behaviors. Hence, in order to lessen the negative effect of it, the author offers her own suggestions.展开更多
文摘Editors Yang Wang,Xi'an Jiaotong University Dongbo Shi,Shanghai Jiaotong University Ye Sun,University College London Zhesi Shen,National Science Library,CAS Topic of the Special Issue What are the top questions towards better science and innovation and the required data to answer these questions?
文摘The described structural model tries to answer some open questions such as: Why do quarks not exist in the open state? Where are the antiparticles from the Big Bang?
基金Supported by National Nature Science Foudation of China(61976160,61906137,61976158,62076184,62076182)Shanghai Science and Technology Plan Project(21DZ1204800)。
文摘Background External knowledge representations play an essential role in knowledge-based visual question and answering to better understand complex scenarios in the open world.Recent entity-relationship embedding approaches are deficient in representing some complex relations,resulting in a lack of topic-related knowledge and redundancy in topic-irrelevant information.Methods To this end,we propose MKEAH:Multimodal Knowledge Extraction and Accumulation on Hyperplanes.To ensure that the lengths of the feature vectors projected onto the hyperplane compare equally and to filter out sufficient topic-irrelevant information,two losses are proposed to learn the triplet representations from the complementary views:range loss and orthogonal loss.To interpret the capability of extracting topic-related knowledge,we present the Topic Similarity(TS)between topic and entity-relations.Results Experimental results demonstrate the effectiveness of hyperplane embedding for knowledge representation in knowledge-based visual question answering.Our model outperformed state-of-the-art methods by 2.12%and 3.24%on two challenging knowledge-request datasets:OK-VQA and KRVQA,respectively.Conclusions The obvious advantages of our model in TS show that using hyperplane embedding to represent multimodal knowledge can improve its ability to extract topic-related knowledge.
基金Supported by Sichuan Science and Technology Program(2021YFQ0003,2023YFSY0026,2023YFH0004).
文摘In the field of natural language processing(NLP),there have been various pre-training language models in recent years,with question answering systems gaining significant attention.However,as algorithms,data,and computing power advance,the issue of increasingly larger models and a growing number of parameters has surfaced.Consequently,model training has become more costly and less efficient.To enhance the efficiency and accuracy of the training process while reducing themodel volume,this paper proposes a first-order pruningmodel PAL-BERT based on the ALBERT model according to the characteristics of question-answering(QA)system and language model.Firstly,a first-order network pruning method based on the ALBERT model is designed,and the PAL-BERT model is formed.Then,the parameter optimization strategy of the PAL-BERT model is formulated,and the Mish function was used as an activation function instead of ReLU to improve the performance.Finally,after comparison experiments with traditional deep learning models TextCNN and BiLSTM,it is confirmed that PALBERT is a pruning model compression method that can significantly reduce training time and optimize training efficiency.Compared with traditional models,PAL-BERT significantly improves the NLP task’s performance.
文摘The weapon and equipment operational requirement analysis(WEORA) is a necessary condition to win a future war,among which the acquisition of knowledge about weapons and equipment is a great challenge. The main challenge is that the existing weapons and equipment data fails to carry out structured knowledge representation, and knowledge navigation based on natural language cannot efficiently support the WEORA. To solve above problem, this research proposes a method based on question answering(QA) of weapons and equipment knowledge graph(WEKG) to construct and navigate the knowledge related to weapons and equipment in the WEORA. This method firstly constructs the WEKG, and builds a neutral network-based QA system over the WEKG by means of semantic parsing for knowledge navigation. Finally, the method is evaluated and a chatbot on the QA system is developed for the WEORA. Our proposed method has good performance in the accuracy and efficiency of searching target knowledge, and can well assist the WEORA.
基金supported by Sichuan Science and Technology Program(2023YFSY0026,2023YFH0004).
文摘Recent advancements in natural language processing have given rise to numerous pre-training language models in question-answering systems.However,with the constant evolution of algorithms,data,and computing power,the increasing size and complexity of these models have led to increased training costs and reduced efficiency.This study aims to minimize the inference time of such models while maintaining computational performance.It also proposes a novel Distillation model for PAL-BERT(DPAL-BERT),specifically,employs knowledge distillation,using the PAL-BERT model as the teacher model to train two student models:DPAL-BERT-Bi and DPAL-BERTC.This research enhances the dataset through techniques such as masking,replacement,and n-gram sampling to optimize knowledge transfer.The experimental results showed that the distilled models greatly outperform models trained from scratch.In addition,although the distilled models exhibit a slight decrease in performance compared to PAL-BERT,they significantly reduce inference time to just 0.25%of the original.This demonstrates the effectiveness of the proposed approach in balancing model performance and efficiency.
文摘Questions which were conventionally designed to check reading comprehension can also be used to enhance understanding. Different types of questions can be designed to achieve different purposes in reading. While designing questions, teachers should take into consideration such points as the language used, manner of presentation and types of questions etc. Moreover, once questions have been designed, it’s essential for teachers to think about the techniques for the use of these questions. If appro- priately used, questions contribute greatly to students’ understanding of what they’ re reading by helping to explore the meaning that language conveys, in addition to developing proper reading skills. Therefore, teachers should be able to teach reading with well-designed questions so that the ultimate goal of understanding the text is likely to be achieved.
文摘In literature,differences in the description of female and male characters have been noticeable for a long time.In this study,the novel Jane Eyre is uses as a material to investigate whether there are in fact any significant differences in the questions Mr.Rochester and Jane use and how the questions function to portray these two main characters.
文摘In the fast reading classroom the main work for the teacher isto ask questionsfor the sake of checking students'comprehension of the text in question. Questions could be classified according to different criteria. This paper classifies the questions according to the teaching procedures,and suggests a few principles to ask questions.
文摘Based on personal observation and students’ self-reports, this article studies the characteristics presented by students in answering questions. It is found that Chinese culture plays an important part in explaining their specific behaviors. Hence, in order to lessen the negative effect of it, the author offers her own suggestions.
