摘要
轨道交通系统是当今社会中交通运力的主要承载系统,对安全性有极高的要求。轨道交通系统的多个组件由于直接暴露在环境中,受多种外界因素影响,易出现故障。这些故障可能会导致列车延误、乘客滞留、服务暂停,甚至是灾难性的生命或资产损失。因此,需要设计针对轨道交通系统的实时故障检测方案,进而才能采取有效的维护措施。不同于基于传统的机器学习(Machine Learning,ML)的故障检测工作,本研究采用中文双向编码器表示转换器(Bidirectional Encoder Representation from Transformer,BERT)深度学习(Deep Learing,DL)模型进行实时的智能故障检测。该模型能够在处理故障检测任务时获取双向上下文的理解,从而更准确地捕捉句子中的语义关系,使得其对故障描述的理解更为精准。BERT的训练需要大量的数据支持,而轨道交通领域中存在多个运营商,它们各自持有独立的故障检测数据。由于数据的保密性,这些数据无法进行共享,从而限制了模型的训练,故采用了联邦边云计算方法,允许多个运营商在保持数据隐私的前提下共同训练BERT模型。联邦学习结合边云计算方法,在本地对轨道交通各运营商的数据进行初步处理,然后将汇总后的梯度上传至云端进行模型训练,最终将训练得到的模型参数发送回各边缘设备,实现模型的更新。研究结果表明,采用联邦边云计算方法进行BERT模型训练,在轨道交通领域的故障检测任务中优于目前已有的先进方案。这一方法在解决数据保密性问题的同时,有效提升了轨道交通故障检测的准确性与可靠性。
Rail transit systems are the main carrying system of transportation capacity in the current society.It is extremely sensitive to safety.Because multiple components of the system are directly exposed to the environment,they are affected by various environments and are prone to failures,which may cause train delays,passenger retention,service outage,or even catastrophic loss of life or property.Therefore,it is necessary to design a fault detection scheme so that effective maintenance measures can be taken.Different from traditional machine learning(ML)based fault classification work,this paper adopts Chinese bidirectional encoder representation from transformer(BERT)deep learning(DL)model for intelligent fault detection.The model can obtain bidirectional contextual understanding when dealing with fault detection tasks,so as to more accurately capture the semantic relationship in sentences,and understand the fault descriptions more accurately.The training of BERT requires a large amount of data support,and there are multiple operators in the field of rail transit,each of which holds independent fault detection data.Due to the confidentiality of the data,these data cannot be shared,which limits the training of the BERT model.This paper designs and adopts the federated edge cloud computing method,allowing multiple operators to jointly train the BERT model while maintaining data privacy.Federated learning combined with the edge cloud computing method allows the data of rail transit operators to be preliminary processed locally,and then the summarized gradients are uploaded to the cloud for model training,and finally the trained model parameters are sent back to each edge device to realize model updates.The research results show that the BERT model training using the federated edge cloud computing method is superior to the existing advanced solutions in the fault detection task in the field of rail transit.This method not only solves the problem of data confidentiality,but also effectively improves the accuracy and reliability of fault detection.
作者
李志
林森
张强
LI Zhi;LIN Sen;ZHANG Qiang(School of Automation and Intelligence,Beijing Jiaotong University,Beijing 100044,China;The 15th Research Institute of China Electronics Technology Group Corporation,Beijing 100083,China;The Chinese People’s Liberation Army 61741 Unit,Beijing 100070,China)
出处
《计算机科学》
CSCD
北大核心
2024年第9期331-337,共7页
Computer Science
关键词
轨道交通
故障检测
边云计算
联邦学习
BERT
Rail transit
Fault detection
Edge cloud computing
Federated learning
Bidirectional encoder representation from transformer