This paper proposes a cascade deep convolutional neural network to address the loosening detection problem of bolts on axlebox covers.Firstly,an SSD network based on ResNet50 and CBAM module by improving bolt image fe...This paper proposes a cascade deep convolutional neural network to address the loosening detection problem of bolts on axlebox covers.Firstly,an SSD network based on ResNet50 and CBAM module by improving bolt image features is proposed for locating bolts on axlebox covers.And then,theA2-PFN is proposed according to the slender features of the marker lines for extracting more accurate marker lines regions of the bolts.Finally,a rectangular approximationmethod is proposed to regularize themarker line regions asaway tocalculate the angle of themarker line and plot all the angle values into an angle table,according to which the criteria of the angle table can determine whether the bolt with the marker line is in danger of loosening.Meanwhile,our improved algorithm is compared with the pre-improved algorithmin the object localization stage.The results show that our proposed method has a significant improvement in both detection accuracy and detection speed,where ourmAP(IoU=0.75)reaches 0.77 and fps reaches 16.6.And in the saliency detection stage,after qualitative comparison and quantitative comparison,our method significantly outperforms other state-of-the-art methods,where our MAE reaches 0.092,F-measure reaches 0.948 and AUC reaches 0.943.Ultimately,according to the angle table,out of 676 bolt samples,a total of 60 bolts are loose,69 bolts are at risk of loosening,and 547 bolts are tightened.展开更多
To generate realistic three-dimensional animation of virtual character,capturing real facial expression is the primary task.Due to diverse facial expressions and complex background,facial landmarks recognized by exist...To generate realistic three-dimensional animation of virtual character,capturing real facial expression is the primary task.Due to diverse facial expressions and complex background,facial landmarks recognized by existing strategies have the problem of deviations and low accuracy.Therefore,a method for facial expression capture based on two-stage neural network is proposed in this paper which takes advantage of improved multi-task cascaded convolutional networks(MTCNN)and high-resolution network.Firstly,the convolution operation of traditional MTCNN is improved.The face information in the input image is quickly filtered by feature fusion in the first stage and Octave Convolution instead of the original ones is introduced into in the second stage to enhance the feature extraction ability of the network,which further rejects a large number of false candidates.The model outputs more accurate facial candidate windows for better landmarks recognition and locates the faces.Then the images cropped after face detection are input into high-resolution network.Multi-scale feature fusion is realized by parallel connection of multi-resolution streams,and rich high-resolution heatmaps of facial landmarks are obtained.Finally,the changes of facial landmarks recognized are tracked in real-time.The expression parameters are extracted and transmitted to Unity3D engine to drive the virtual character’s face,which can realize facial expression synchronous animation.Extensive experimental results obtained on the WFLW database demonstrate the superiority of the proposed method in terms of accuracy and robustness,especially for diverse expressions and complex background.The method can accurately capture facial expression and generate three-dimensional animation effects,making online entertainment and social interaction more immersive in shared virtual space.展开更多
Nowadays,the cloud environment faces numerous issues like synchronizing information before the switch over the data migration.The requirement for a centralized internet of things(IoT)-based system has been restricted ...Nowadays,the cloud environment faces numerous issues like synchronizing information before the switch over the data migration.The requirement for a centralized internet of things(IoT)-based system has been restricted to some extent.Due to low scalability on security considerations,the cloud seems uninteresting.Since healthcare networks demand computer operations on large amounts of data,the sensitivity of device latency evolved among health networks is a challenging issue.In comparison to cloud domains,the new paradigms of fog computing give fresh alternatives by bringing resources closer to users by providing low latency and energy-efficient data processing solutions.Previous fog computing frameworks have various flaws,such as overvaluing response time or ignoring the accuracy of the result yet handling both at the same time compromises the network community.In this proposed work,Health Fog is integrated with the Optimized Cascaded Convolution Neural Network framework for diagnosing heart disease.Initially,the data is collected,and then pre-processing is done by Linear Discriminant Analysis.Then the features are extracted and optimized using Galactic Swarm Optimization.The optimized features are given into the Health Fog framework for diagnosing heart disease patients.It uses ensemble-based deep learning in edge computing devices,which automatically monitors real-life health networks such as heart disease analysis.Finally,the classifiers such as bagging,boosting,XGBoost,Multi-Layer Perceptron(MLP),and Partitions(PART)are used for classifying the data.Then the majority voting classifier predicts the result.This work uses FogBus architecture and evaluates the execution of power usage,bandwidth of the network,latency,execution time,and accuracy.展开更多
Transient stability batch assessment(TSBA)is es-sential for dynamic security check in both power system planning and day-ahead dispatch.It is also a necessary technique to generate sufficient training data for data-dr...Transient stability batch assessment(TSBA)is es-sential for dynamic security check in both power system planning and day-ahead dispatch.It is also a necessary technique to generate sufficient training data for data-driven online transient stability assessment(TSA).However,most existing work suffers from various problems including high computational burden,low model adaptability,and low performance robustness.Therefore,it is still a significant challenge in modern power systems,with numerous scenarios(e.g.,operating conditions and"N-k"contin-gencies)to be assessed at the same time.The purpose of this work is to construct a data-driven method to early terminate time-domain simulation(TDS)and dynamically schedule TSBA task queue a prior,in order to reduce computational burden without compromising accuracy.To achieve this goal,a time-adaptive cas-caded convolutional neural networks(CNNs)model is developed to predict stability and early terminate TDS.Additionally,an information entropy based prioritization strategy is designed to distinguish informative samples,dynamically schedule TSBA task queue and timely update model,thus further reducing simulation time.Case study in IEEE 39-bus system validates the effectiveness of the proposed method.展开更多
文摘This paper proposes a cascade deep convolutional neural network to address the loosening detection problem of bolts on axlebox covers.Firstly,an SSD network based on ResNet50 and CBAM module by improving bolt image features is proposed for locating bolts on axlebox covers.And then,theA2-PFN is proposed according to the slender features of the marker lines for extracting more accurate marker lines regions of the bolts.Finally,a rectangular approximationmethod is proposed to regularize themarker line regions asaway tocalculate the angle of themarker line and plot all the angle values into an angle table,according to which the criteria of the angle table can determine whether the bolt with the marker line is in danger of loosening.Meanwhile,our improved algorithm is compared with the pre-improved algorithmin the object localization stage.The results show that our proposed method has a significant improvement in both detection accuracy and detection speed,where ourmAP(IoU=0.75)reaches 0.77 and fps reaches 16.6.And in the saliency detection stage,after qualitative comparison and quantitative comparison,our method significantly outperforms other state-of-the-art methods,where our MAE reaches 0.092,F-measure reaches 0.948 and AUC reaches 0.943.Ultimately,according to the angle table,out of 676 bolt samples,a total of 60 bolts are loose,69 bolts are at risk of loosening,and 547 bolts are tightened.
基金This research was funded by College Student Innovation and Entrepreneurship Training Program,grant number 2021055Z and S202110082031the Special Project for Cultivating Scientific and Technological Innovation Ability of College and Middle School Students in Hebei Province,Grant Number 2021H011404.
文摘To generate realistic three-dimensional animation of virtual character,capturing real facial expression is the primary task.Due to diverse facial expressions and complex background,facial landmarks recognized by existing strategies have the problem of deviations and low accuracy.Therefore,a method for facial expression capture based on two-stage neural network is proposed in this paper which takes advantage of improved multi-task cascaded convolutional networks(MTCNN)and high-resolution network.Firstly,the convolution operation of traditional MTCNN is improved.The face information in the input image is quickly filtered by feature fusion in the first stage and Octave Convolution instead of the original ones is introduced into in the second stage to enhance the feature extraction ability of the network,which further rejects a large number of false candidates.The model outputs more accurate facial candidate windows for better landmarks recognition and locates the faces.Then the images cropped after face detection are input into high-resolution network.Multi-scale feature fusion is realized by parallel connection of multi-resolution streams,and rich high-resolution heatmaps of facial landmarks are obtained.Finally,the changes of facial landmarks recognized are tracked in real-time.The expression parameters are extracted and transmitted to Unity3D engine to drive the virtual character’s face,which can realize facial expression synchronous animation.Extensive experimental results obtained on the WFLW database demonstrate the superiority of the proposed method in terms of accuracy and robustness,especially for diverse expressions and complex background.The method can accurately capture facial expression and generate three-dimensional animation effects,making online entertainment and social interaction more immersive in shared virtual space.
基金This work was supported by Taif University Researchers Supporting Project(TURSP)under number(TURSP-2020/73),Taif University,Taif,Saudi Arabia.
文摘Nowadays,the cloud environment faces numerous issues like synchronizing information before the switch over the data migration.The requirement for a centralized internet of things(IoT)-based system has been restricted to some extent.Due to low scalability on security considerations,the cloud seems uninteresting.Since healthcare networks demand computer operations on large amounts of data,the sensitivity of device latency evolved among health networks is a challenging issue.In comparison to cloud domains,the new paradigms of fog computing give fresh alternatives by bringing resources closer to users by providing low latency and energy-efficient data processing solutions.Previous fog computing frameworks have various flaws,such as overvaluing response time or ignoring the accuracy of the result yet handling both at the same time compromises the network community.In this proposed work,Health Fog is integrated with the Optimized Cascaded Convolution Neural Network framework for diagnosing heart disease.Initially,the data is collected,and then pre-processing is done by Linear Discriminant Analysis.Then the features are extracted and optimized using Galactic Swarm Optimization.The optimized features are given into the Health Fog framework for diagnosing heart disease patients.It uses ensemble-based deep learning in edge computing devices,which automatically monitors real-life health networks such as heart disease analysis.Finally,the classifiers such as bagging,boosting,XGBoost,Multi-Layer Perceptron(MLP),and Partitions(PART)are used for classifying the data.Then the majority voting classifier predicts the result.This work uses FogBus architecture and evaluates the execution of power usage,bandwidth of the network,latency,execution time,and accuracy.
基金This work was supported by China scholarship council under Grant 201906320221.
文摘Transient stability batch assessment(TSBA)is es-sential for dynamic security check in both power system planning and day-ahead dispatch.It is also a necessary technique to generate sufficient training data for data-driven online transient stability assessment(TSA).However,most existing work suffers from various problems including high computational burden,low model adaptability,and low performance robustness.Therefore,it is still a significant challenge in modern power systems,with numerous scenarios(e.g.,operating conditions and"N-k"contin-gencies)to be assessed at the same time.The purpose of this work is to construct a data-driven method to early terminate time-domain simulation(TDS)and dynamically schedule TSBA task queue a prior,in order to reduce computational burden without compromising accuracy.To achieve this goal,a time-adaptive cas-caded convolutional neural networks(CNNs)model is developed to predict stability and early terminate TDS.Additionally,an information entropy based prioritization strategy is designed to distinguish informative samples,dynamically schedule TSBA task queue and timely update model,thus further reducing simulation time.Case study in IEEE 39-bus system validates the effectiveness of the proposed method.