A method to predict the peak shear strength of rock joints based on machine learning

In geotechnical and tunneling engineering,accurately determining the mechanical properties of jointed rock holds great significance for project safety assessments.Peak shear strength(PSS),being the paramount mechanical property of joints,has been a focal point in the research field.There are limitations in the current peak shear strength(PSS)prediction models for jointed rock:(i)the models do not comprehensively consider various influencing factors,and a PSS prediction model covering seven factors has not been established,including the sampling interval of the joints,the surface roughness of the joints,the normal stress,the basic friction angle,the uniaxial tensile strength,the uniaxial compressive strength,and the joint size for coupled joints;(ii)the datasets used to train the models are relatively limited;and(iii)there is a controversy regarding whether compressive or tensile strength should be used as the strength term among the influencing factors.To overcome these limitations,we developed four machine learning models covering these seven influencing factors,three relying on Support Vector Regression(SVR)with different kernel functions(linear,polynomial,and Radial Basis Function(RBF))and one using deep learning(DL).Based on these seven influencing factors,we compiled a dataset comprising the outcomes of 493 published direct shear tests for the training and validation of these four models.We compared the prediction performance of these four machine learning models with Tang’s and Tatone’s models.The prediction errors of Tang’s and Tatone’s models are 21.8%and 17.7%,respectively,while SVR_linear is at 16.6%,SVR_poly is at 14.0%,and SVR_RBF is at 12.1%.DL outperforms the two existing models with only an 8.5%error.Additionally,we performed shear tests on granite joints to validate the predictive capability of the DL-based model.With the DL approach,the results suggest that uniaxial tensile strength is recommended as the material strength term in the PSS model for more reliable outcomes.

Knowledge-enriched joint-learning model for implicit emotion cause extraction

Emotion cause extraction(ECE)task that aims at extracting potential trigger events of certain emotions has attracted extensive attention recently.However,current work neglects the implicit emotion expressed without any explicit emotional keywords,which appears more frequently in application scenarios.The lack of explicit emotion information makes it extremely hard to extract emotion causes only with the local context.Moreover,an entire event is usually across multiple clauses,while existing work merely extracts cause events at clause level and cannot effectively capture complete cause event information.To address these issues,the events are first redefined at the tuple level and a span-based tuple-level algorithm is proposed to extract events from different clauses.Based on it,a corpus for implicit emotion cause extraction that tries to extract causes of implicit emotions is constructed.The authors propose a knowledge-enriched jointlearning model of implicit emotion recognition and implicit emotion cause extraction tasks(KJ-IECE),which leverages commonsense knowledge from ConceptNet and NRC_VAD to better capture connections between emotion and corresponding cause events.Experiments on both implicit and explicit emotion cause extraction datasets demonstrate the effectiveness of the proposed model.

基于Q-learning的碳-电联合套利策略

针对发电企业在电力低碳转型过程中,部署可再生能源发电设备的成本问题,研究了一种基于Q-learning的碳-电联合套利策略。利用电力市场和碳市场价格实时波动的特点,在电力市场中在低价时存储电能,高价时卖出电能。在碳市场中,在低价时购入碳排放权。采取Q-learning算法学习碳-电联合套利策略,以欧洲的3个城市为研究对象,仿真结果表明,应用碳-电联合套利策略可提升可再生能源发电售电收入的1%,减少31%购买碳排放权开支,实现最大化套利目标。由于部署可再生能源发电带来的减排效益,使得碳排放开支再次减少10%-20%。通过将碳市场与电力市场相结合套利,使得套利利润得到了显著提升,验证了所提方法的有效性。

Multi-Model Fusion Framework Using Deep Learning for Visual-Textual Sentiment Classification

Multimodal Sentiment Analysis(SA)is gaining popularity due to its broad application potential.The existing studies have focused on the SA of single modalities,such as texts or photos,posing challenges in effectively handling social media data with multiple modalities.Moreover,most multimodal research has concentrated on merely combining the two modalities rather than exploring their complex correlations,leading to unsatisfactory sentiment classification results.Motivated by this,we propose a new visualtextual sentiment classification model named Multi-Model Fusion(MMF),which uses a mixed fusion framework for SA to effectively capture the essential information and the intrinsic relationship between the visual and textual content.The proposed model comprises three deep neural networks.Two different neural networks are proposed to extract the most emotionally relevant aspects of image and text data.Thus,more discriminative features are gathered for accurate sentiment classification.Then,a multichannel joint fusion modelwith a self-attention technique is proposed to exploit the intrinsic correlation between visual and textual characteristics and obtain emotionally rich information for joint sentiment classification.Finally,the results of the three classifiers are integrated using a decision fusion scheme to improve the robustness and generalizability of the proposed model.An interpretable visual-textual sentiment classification model is further developed using the Local Interpretable Model-agnostic Explanation model(LIME)to ensure the model’s explainability and resilience.The proposed MMF model has been tested on four real-world sentiment datasets,achieving(99.78%)accuracy on Binary_Getty(BG),(99.12%)on Binary_iStock(BIS),(95.70%)on Twitter,and(79.06%)on the Multi-View Sentiment Analysis(MVSA)dataset.These results demonstrate the superior performance of our MMF model compared to single-model approaches and current state-of-the-art techniques based on model evaluation criteria.

Joint learning based on multi-shaped filters for knowledge graph completion

To solve the problem of missing many valid triples in knowledge graphs(KGs),a novel model based on a convolutional neural network(CNN)called ConvKG is proposed,which employs a joint learning strategy for knowledge graph completion(KGC).Related research work has shown the superiority of convolutional neural networks(CNNs)in extracting semantic features of triple embeddings.However,these researches use only one single-shaped filter and fail to extract semantic features of different granularity.To solve this problem,ConvKG exploits multi-shaped filters to co-convolute on the triple embeddings,joint learning semantic features of different granularity.Different shaped filters cover different sizes on the triple embeddings and capture pairwise interactions of different granularity among triple elements.Experimental results confirm the strength of joint learning,and compared with state-of-the-art CNN-based KGC models,ConvKG achieves the better mean rank(MR)and Hits@10 metrics on dataset WN18 RR,and the better MR on dataset FB15k-237.

Joint Access Point Selection and Resource Allocation in MEC-Assisted Network:A Reinforcement Learning Based Approach

A distributed reinforcement learning(RL)based resource management framework is proposed for a mobile edge computing(MEC)system with both latency-sensitive and latency-insensitive services.We investigate joint optimization of both computing and radio resources to achieve efficient on-demand matches of multi-dimensional resources and diverse requirements of users.A multi-objective integer programming problem is formulated by two subproblems,i.e.,access point(AP)selection and subcarrier allocation,which can be solved jointly by our proposed distributed RL-based approach with a heuristic iteration algorithm.The proposed algorithm allows for the reduction in complexity since each user needs to consider only its own selection of AP without knowing full global information.Simulation results show that our algorithm can achieve near-optimal performance while reducing computational complexity significantly.Compared with other algorithms that only optimize either of the two sub-problems,the proposed algorithm can serve more users with much less power consumption and content delivery latency.

Enhanced Deep Autoencoder Based Feature Representation Learning for Intelligent Intrusion Detection System

In the era of Big data,learning discriminant feature representation from network traffic is identified has as an invariably essential task for improving the detection ability of an intrusion detection system(IDS).Owing to the lack of accurately labeled network traffic data,many unsupervised feature representation learning models have been proposed with state-of-theart performance.Yet,these models fail to consider the classification error while learning the feature representation.Intuitively,the learnt feature representation may degrade the performance of the classification task.For the first time in the field of intrusion detection,this paper proposes an unsupervised IDS model leveraging the benefits of deep autoencoder(DAE)for learning the robust feature representation and one-class support vector machine(OCSVM)for finding the more compact decision hyperplane for intrusion detection.Specially,the proposed model defines a new unified objective function to minimize the reconstruction and classification error simultaneously.This unique contribution not only enables the model to support joint learning for feature representation and classifier training but also guides to learn the robust feature representation which can improve the discrimination ability of the classifier for intrusion detection.Three set of evaluation experiments are conducted to demonstrate the potential of the proposed model.First,the ablation evaluation on benchmark dataset,NSL-KDD validates the design decision of the proposed model.Next,the performance evaluation on recent intrusion dataset,UNSW-NB15 signifies the stable performance of the proposed model.Finally,the comparative evaluation verifies the efficacy of the proposed model against recently published state-of-the-art methods.

The Impact of Semi-Supervised Learning on the Performance of Intelligent Chatbot System

Artificial intelligent based dialog systems are getting attention from both business and academic communities.The key parts for such intelligent chatbot systems are domain classification,intent detection,and named entity recognition.Various supervised,unsupervised,and hybrid approaches are used to detect each field.Such intelligent systems,also called natural language understanding systems analyze user requests in sequential order:domain classification,intent,and entity recognition based on the semantic rules of the classified domain.This sequential approach propagates the downstream error;i.e.,if the domain classification model fails to classify the domain,intent and entity recognition fail.Furthermore,training such intelligent system necessitates a large number of user-annotated datasets for each domain.This study proposes a single joint predictive deep neural network framework based on long short-term memory using only a small user-annotated dataset to address these issues.It investigates value added by incorporating unlabeled data from user chatting logs into multi-domain spoken language understanding systems.Systematic experimental analysis of the proposed joint frameworks,along with the semi-supervised multi-domain model,using open-source annotated and unannotated utterances shows robust improvement in the predictive performance of the proposed multi-domain intelligent chatbot over a base joint model and joint model based on adversarial learning.

Multi-Domain Malicious Behavior Knowledge Base Framework for Multi-Type DDoS Behavior Detection

Due to the many types of distributed denial-of-service attacks(DDoS)attacks and the large amount of data generated,it becomes a chal-lenge to manage and apply the malicious behavior knowledge generated by DDoS attacks.We propose a malicious behavior knowledge base framework for DDoS attacks,which completes the construction and application of a multi-domain malicious behavior knowledge base.First,we collected mali-cious behavior traffic generated by five mainstream DDoS attacks.At the same time,we completed the knowledge collection mechanism through data pre-processing and dataset design.Then,we designed a malicious behavior category graph and malicious behavior structure graph for the characteristic information and spatial structure of DDoS attacks and completed the knowl-edge learning mechanism using a graph neural network model.To protect the data privacy of multiple multi-domain malicious behavior knowledge bases,we implement the knowledge-sharing mechanism based on federated learning.Finally,we store the constructed knowledge graphs,graph neural network model,and Federated model into the malicious behavior knowledge base to complete the knowledge management mechanism.The experimental results show that our proposed system architecture can effectively construct and apply the malicious behavior knowledge base,and the detection capability of multiple DDoS attacks occurring in the network reaches above 0.95,while there exists a certain anti-interference capability for data poisoning cases.

钢筋混凝土板柱节点冲切性能研究进展

为提高板柱节点冲切性能从而促进其工程应用,比较了各类抗冲切元件的不同布置形式、形状尺寸、几何参数以及组合形式对节点抗冲切承载力的影响,概括了受损板柱节点修复与加固的研究现状,梳理了不同开洞尺寸、距离、数量、形状及偏心荷载作用下开洞板柱试件抗冲切性能的研究成果,归纳了有无抗冲切钢筋和配置型钢剪力架板柱节点的抗冲切承载力计算方法以及基于机器学习的板柱节点冲切承载力预测方法。结果表明:各类抗冲切元件可通过改变布置形式、形状尺寸、几何参数以及元件组合从而改善板柱节点的冲切性能;板件开洞的尺寸越大、距离越远、数量越多,对节点的抗冲切性能越不利;基于数值模拟和规范改进得出的冲切承载力计算公式仅对特定试验有较高的预测精度,尚未形成较为统一的承载力计算公式,而基于机器学习的冲切承载力预测模型是未来研究的重点;需进一步开展关于受损板柱节点修复与加固方法的研究,对完善板柱节点抗冲切性能研究理论体系具有重要意义。

AMFRel:一种中文电子病历实体关系联合抽取方法

中文电子病历实体关系抽取是构建医疗知识图谱,服务下游子任务的重要基础。目前,中文电子病例进行实体关系抽取仍存在因医疗文本关系复杂、实体密度大而造成医疗名词识别不准确的问题。针对这一问题,提出了基于对抗学习与多特征融合的中文电子病历实体关系联合抽取模型AMFRel(adversarial learning and multi-feature fusion for relation triple extraction),提取电子病历的文本和词性特征,得到融合词性信息的编码向量;利用编码向量联合对抗训练产生的扰动生成对抗样本,抽取句子主语;利用信息融合模块丰富文本结构特征,并根据特定的关系信息抽取出相应的宾语,得到医疗文本的三元组。采用CHIP2020关系抽取数据集和糖尿病数据集进行实验验证,结果显示:AMFRel在CHIP2020关系抽取数据集上的Precision为63.922%,Recall为57.279%,F1值为60.418%;在糖尿病数据集上的Precision、Recall和F1值分别为83.914%,67.021%和74.522%,证明了该模型的三元组抽取性能优于其他基线模型。

基于联合深度统计特征对齐的鱼类目标识别方法

水下鱼类目标识别技术是认识海洋、经略海洋、向海图强的重要技术之一.基于深度学习的水下目标识别技术已成为研究热点,但是针对水下鱼类数据小样本甚至零样本识别性能亟待提高.本文基于迁移学习,提出了联合深度统计特征对齐(Joint Deep Statistical Feature Alignment, JDSFA)方法,解决小样本下的鱼类目标识别问题.以ResNet-50作为骨干网络,将均方和协方差纳入权重选择算法用来构建自适应损失函数,对齐源域和目标域之间的特征分布,联合源域损失与领域间的自适应损失,设计全局损失函数,建立深度学习识别模型,实现鱼类目标识别任务.利用公开的水下鱼类数据集QUT进行实验验证,相比目前代表性的DADAN、PMTrans、DSAN方法,JDSFA方法的鱼类识别性能分别提升了3.59%、4.96%、5.91%,结果表明了本文JDSFA方法的有效性,并对鱼类目标识别具有良好的应用价值.

多区域注意力的细粒度图像分类网络

目前细粒度图像分类的难点在于如何精准定位图像中高度可辨的局部区域以及其他辅助判别特征。提出一种多区域注意力的细粒度图像分类网络来解决这个问题。首先使用Inception-V3对图像特征进行提取,通过重复使用注意力擦除的方法使模型关注次要特征;然后通过背景去除以及上采样的方法获取图像更精准的局部图像,对提取到的局部特征进行位置统计,并以矩形框的方式获取图像整体,减少细节信息丢失;最后对局部与整体图像进行更加细致的学习。此外,设计联合损失函数,通过动态平衡难易样本和缩小类内差距的方法改善模型的识别效果。实验结果表明,该方法在公开的细粒度图像数据集CUB-200-2011、Stanford-Cars和FGVC-Aircraft上的准确率分别达到89.2%、94.8%、94.0%,相较于对比方法性能更优。

面向病理图像分割的边缘感知网络

提出了一种针对病理切片图像的端到端语义分割方法--边缘感知网络(BPNet),以提高病理图像分割精度。BPNet网络首先在解码器阶段增加边缘感知模块,改善网络对于病理图像边缘的特征信息提取能力。然后,采用自适应通道注意力模块弥补不同层次特征间的语义差距,进一步加强网络的特征聚合能力。在此基础上,设计了一种基于结构和边缘的联合损失函数,以实现最佳的病理图像分割结果。在GlaS和MoNuSeg两个公开病理数据集上的分割实验结果表明,所提方法的Dice系数得分在两个数据集上分别达到92.21%和81.18%,有效提升了病理图像的分割精度。

基于声发射信号时频图深度学习的桥梁钢桁架焊接节点损伤程度识别

针对桥梁钢桁架疲劳损伤识别难度大、精度低的现状,提出基于声发射信号时频分析与深度学习的钢桁架焊接节点损伤程度识别方法。对桁架节点在桥梁运营状态下产生的声发射信号进行小波变换,表征不同损伤程度信号的时频能量分布模式,然后建立卷积神经网络(convolutional neural network,CNN)模型对时频图进行损伤特征提取,并通过迁移学习思想提升模型的训练效率和学习能力,从而实现桁架焊接节点严重损伤、轻微损伤和噪声工况的准确识别。进一步对模型各卷积层激活区域进行可视化分析,解剖模型的损伤特征学习过程及分类逻辑。某悬索桥中央纵向腹板钢桁架焊接节点现场试验结果表明:相较于利用时域波形进行特征学习的一维卷积神经网络模型,时频图包含了更丰富的损伤信息,所建立的二维卷积神经网络模型对钢桁架焊接节点三种损伤程度的识别准确率超过94%,具有更强鲁棒性和实际应用价值。

E-TUP:融合E-CP与TUP的联合知识图谱学习推荐方法

目前,大部分将知识图谱引入推荐系统的方法只是将已知的表层知识图谱实体进行引入,没有对图谱的内在关系进行预测和挖掘,因此无法利用知识图谱中的隐藏关系。针对上述问题,提出联合学习推荐模型E-TUP(enhance towards understanding of user preference),使用E-CP(enhance canonical polyadic)进行知识图谱补全并将完整信息进行传递。利用储存空间负采样方法,将优质负例三元组进行存储,并随训练过程进行更新,以提高知识图谱补全中负例三元组的质量。链接预测实验结果显示,储存空间方法使E-TUP模型链接预测准确率对比现有模型最高提升10.3%。在MovieLens-1m和DBbook2014数据集上进行推荐实验,在多个评价指标上取得最佳结果,对比现有模型实现最高5.5%的提升,表明E-TUP可以有效利用知识图谱中的隐藏关系提高模型推荐准确率。基于汽车维修数据进行推荐实验,结果表明E-TUP可以有效推荐相关知识。

深度学习用于肩关节影像学研究进展

肩痛在肌肉骨骼疼痛中居第三位,人群患病率较高,早期诊断至关重要。深度学习(DL)技术用于肩关节影像学有利于临床诊治肩部疾病及评估预后。本文对DL技术在肩关节影像学中的研究进展进行综述。

机理模型与集成学习混合驱动的机器人关节摩擦建模方法

机器人一体化关节广泛应用于医疗、协作机器人等领域,其摩擦特性是影响机器人性能的关键因素.为此,提出了一种机理模型与集成学习混合驱动的机器人关节摩擦建模方法,以提高模型精度.首先,综合考虑转速、负载等关节摩擦特性的影响因素及其周期波动特性,基于先验知识和物理分析分别建立了伺服电机与谐波减速器的参数化机理模型,描述摩擦特性的变化规律.然后,针对机理建模中因线性假设、忽略高阶项等产生的非线性残差,提出了基于eXtreme gradient boosting(XGBoost)的残差补偿模型建模方法,通过采用Boosting集成学习策略,提高残差补偿模型的泛化能力.同时,采用贝叶斯优化方法进行XGBoost模型的超参数寻优,以提高模型精度和训练效率.相比于传统的参数化机理模型,本文所提出的混合驱动模型具有更高精度.与反向传播神经网络、支持向量机、长短时记忆神经网络等多种典型方法的对比实验表明,本文所提出的基于XGBoost的残差补偿模型具有更强的特征提取能力,能够较好地预测强非线性的波动摩擦残差,有效地提高了整体模型的精度.

内容感知的可解释性路面病害检测模型

针对实际场景中高分辨路面图像难以直接作为现有卷积神经网络(convolutional neural network,CNN)的输入、现有预处理及下采样算法无法有效感知并保留原始路面图像中低占比的病害区域信息等问题,借助于可视化解释的技术手段,设计了一种即插即用的图像内容自适应感知模块(adaptive perception module,APM),既平衡了高分辨路面图像与CNN输入限制,又能够自适应感知激活前景病害区域,从而实现高分辨路面图像中病害类型的快速准确检测,构建可信路面病害视觉检测软件系统.APM利用大卷积核和下采样残差操作降低原始图像分辨率并获取图像浅层特征表示;通过注意力机制自适应感知并激活图像中路面病害区域信息,过滤无关的背景信息.利用联合学习的方式,无需额外监督信息完成对APM的训练.通过可视化解释方法辅助选择和设计APM的具体结构,在最新公开数据集CQUBPMDD上的实验结果表明:APM相比于现有的图像预处理采样算法均有明显提升,分类准确率最高为84.47%;在CQU-BPDD上的实验结果及APM决策效果可视化分析表明APM具备良好的泛化性与鲁棒性.实验代码已开源:https://github.com/Li-Ao-Git/apm.

基于局部Transformer的泰语分词和词性标注联合模型

泰语分词和词性标注任务二者之间存在高关联性,已有研究表明将分词和词性标注任务进行联合学习可以有效提升模型性能,为此,提出了一种针对泰语拼写和构词特点的分词和词性标注联合模型。针对泰语中字符构成音节,音节组成词语的特点,采用局部Transformer网络从音节序列中学习分词特征;考虑到词根和词缀等音节与词性的关联,将用于分词的音节特征融入词语序列特征,缓解未知词的词性标注特征缺失问题。在此基础上,模型采用线性分类层预测分词标签,采用线性条件随机场建模词性序列的依赖关系。在泰语数据集LST20上的试验结果表明,模型分词F1、词性标注微平均F1和宏平均F1分别达到96.33%、97.06%和85.98%,相较基线模型分别提升了0.33%、0.44%和0.12%。