工业数据由于技术故障和人为因素通常导致数据异常,现有基于约束的方法因约束阈值设置的过于宽松或严格会导致修复错误,基于统计的方法因平滑修复机制导致对时间步长较远的异常值修复准确度较低.针对上述问题,提出了基于奖励机制的最小...工业数据由于技术故障和人为因素通常导致数据异常,现有基于约束的方法因约束阈值设置的过于宽松或严格会导致修复错误,基于统计的方法因平滑修复机制导致对时间步长较远的异常值修复准确度较低.针对上述问题,提出了基于奖励机制的最小迭代修复和改进WGAN混合模型的时序数据修复方法.首先,在预处理阶段,保留异常数据,进行信息标注等处理,从而充分挖掘异常值与真实值之间的特征约束.其次,在噪声模块提出了近邻参数裁剪规则,用于修正最小迭代修复公式生成的噪声向量.将其传递至模拟分布模块的生成器中,同时设计了一个动态时间注意力网络层,用于提取时序特征权重并与门控循环单元串联组合捕捉不同步长的特征依赖,并引入递归多步预测原理共同提升模型的表达能力;在判别器中设计了Abnormal and Truth奖励机制和Weighted Mean Square Error损失函数共同反向优化生成器修复数据的细节和质量.最后,在公开数据集和真实数据集上的实验结果表明,该方法的修复准确度与模型稳定性显著优于现有方法.展开更多
As the scale of software systems expands,maintaining their stable operation has become an extraordinary challenge.System logs are semi-structured text generated by the recording function in the source code and have im...As the scale of software systems expands,maintaining their stable operation has become an extraordinary challenge.System logs are semi-structured text generated by the recording function in the source code and have important research significance in software service anomaly detection.Existing log anomaly detection methods mainly focus on the statistical characteristics of logs,making it difficult to distinguish the semantic differences between normal and abnormal logs,and performing poorly on real-world industrial log data.In this paper,we propose an unsupervised framework for log anomaly detection based on generative pre-training-2(GPT-2).We apply our approach to two industrial systems.The experimental results on two datasets show that our approach outperforms state-of-the-art approaches for log anomaly detection.展开更多
Hybrid beamforming(HBF)has become an attractive and important technology in massive multiple-input multiple-output(MIMO)millimeter-wave(mmWave)systems.There are different hybrid architectures in HBF depending on diffe...Hybrid beamforming(HBF)has become an attractive and important technology in massive multiple-input multiple-output(MIMO)millimeter-wave(mmWave)systems.There are different hybrid architectures in HBF depending on different connection strategies of the phase shifter network between antennas and radio frequency chains.This paper investigates HBF optimization with different hybrid architectures in broadband point-to-point mmWave MIMO systems.The joint hybrid architecture and beamforming optimization problem is divided into two sub-problems.First,we transform the spectral efficiency maximization problem into an equivalent weighted mean squared error minimization problem,and propose an algorithm based on the manifold optimization method for the hybrid beamformer with a fixed hybrid architecture.The overlapped subarray architecture which balances well between hardware costs and system performance is investigated.We further propose an algorithm to dynamically partition antenna subarrays and combine it with the HBF optimization algorithm.Simulation results are presented to demonstrate the performance improvement of our proposed algorithms.展开更多
Rate splitting multiple access(RSMA)has shown great potentials for the next generation communication systems.In this work,we consider a two-user system in hybrid satellite terrestrial network(HSTN)where one of them is...Rate splitting multiple access(RSMA)has shown great potentials for the next generation communication systems.In this work,we consider a two-user system in hybrid satellite terrestrial network(HSTN)where one of them is heavily shadowed and the other uses cooperative RSMA to improve the transmission quality.The non-convex weighted sum rate(WSR)problem formulated based on this model is usually optimized by computational burdened weighted minimum mean square error(WMMSE)algorithm.We propose to apply deep unfolding to solve the optimization problem,which maps WMMSE iterations into a layer-wise network and could achieve better performance within limited iterations.We also incorporate momentum accelerated projection gradient descent(PGD)algorithm to circumvent the complicated operations in WMMSE that are not amenable for unfolding and mapping.The momentum and step size in deep unfolding network are selected as trainable parameters for training.As shown in the simulation results,deep unfolding scheme has WSR and convergence speed advantages over original WMMSE algorithm.展开更多
文摘工业数据由于技术故障和人为因素通常导致数据异常,现有基于约束的方法因约束阈值设置的过于宽松或严格会导致修复错误,基于统计的方法因平滑修复机制导致对时间步长较远的异常值修复准确度较低.针对上述问题,提出了基于奖励机制的最小迭代修复和改进WGAN混合模型的时序数据修复方法.首先,在预处理阶段,保留异常数据,进行信息标注等处理,从而充分挖掘异常值与真实值之间的特征约束.其次,在噪声模块提出了近邻参数裁剪规则,用于修正最小迭代修复公式生成的噪声向量.将其传递至模拟分布模块的生成器中,同时设计了一个动态时间注意力网络层,用于提取时序特征权重并与门控循环单元串联组合捕捉不同步长的特征依赖,并引入递归多步预测原理共同提升模型的表达能力;在判别器中设计了Abnormal and Truth奖励机制和Weighted Mean Square Error损失函数共同反向优化生成器修复数据的细节和质量.最后,在公开数据集和真实数据集上的实验结果表明,该方法的修复准确度与模型稳定性显著优于现有方法.
文摘As the scale of software systems expands,maintaining their stable operation has become an extraordinary challenge.System logs are semi-structured text generated by the recording function in the source code and have important research significance in software service anomaly detection.Existing log anomaly detection methods mainly focus on the statistical characteristics of logs,making it difficult to distinguish the semantic differences between normal and abnormal logs,and performing poorly on real-world industrial log data.In this paper,we propose an unsupervised framework for log anomaly detection based on generative pre-training-2(GPT-2).We apply our approach to two industrial systems.The experimental results on two datasets show that our approach outperforms state-of-the-art approaches for log anomaly detection.
基金supported by ZTE Industry-University-Institute Cooperation Funds,the Natural Science Foundation of Shanghai under Grant No.23ZR1407300the National Natural Science Foundation of China un⁃der Grant No.61771147.
文摘Hybrid beamforming(HBF)has become an attractive and important technology in massive multiple-input multiple-output(MIMO)millimeter-wave(mmWave)systems.There are different hybrid architectures in HBF depending on different connection strategies of the phase shifter network between antennas and radio frequency chains.This paper investigates HBF optimization with different hybrid architectures in broadband point-to-point mmWave MIMO systems.The joint hybrid architecture and beamforming optimization problem is divided into two sub-problems.First,we transform the spectral efficiency maximization problem into an equivalent weighted mean squared error minimization problem,and propose an algorithm based on the manifold optimization method for the hybrid beamformer with a fixed hybrid architecture.The overlapped subarray architecture which balances well between hardware costs and system performance is investigated.We further propose an algorithm to dynamically partition antenna subarrays and combine it with the HBF optimization algorithm.Simulation results are presented to demonstrate the performance improvement of our proposed algorithms.
基金sponsored by National Natural Science Foundation of China (No. 61871422, No.62027801)
文摘Rate splitting multiple access(RSMA)has shown great potentials for the next generation communication systems.In this work,we consider a two-user system in hybrid satellite terrestrial network(HSTN)where one of them is heavily shadowed and the other uses cooperative RSMA to improve the transmission quality.The non-convex weighted sum rate(WSR)problem formulated based on this model is usually optimized by computational burdened weighted minimum mean square error(WMMSE)algorithm.We propose to apply deep unfolding to solve the optimization problem,which maps WMMSE iterations into a layer-wise network and could achieve better performance within limited iterations.We also incorporate momentum accelerated projection gradient descent(PGD)algorithm to circumvent the complicated operations in WMMSE that are not amenable for unfolding and mapping.The momentum and step size in deep unfolding network are selected as trainable parameters for training.As shown in the simulation results,deep unfolding scheme has WSR and convergence speed advantages over original WMMSE algorithm.