A Lightweight Network with Dual Encoder and Cross Feature Fusion for Cement Pavement Crack Detection

Automatic crack detection of cement pavement chiefly benefits from the rapid development of deep learning,with convolutional neural networks(CNN)playing an important role in this field.However,as the performance of crack detection in cement pavement improves,the depth and width of the network structure are significantly increased,which necessitates more computing power and storage space.This limitation hampers the practical implementation of crack detection models on various platforms,particularly portable devices like small mobile devices.To solve these problems,we propose a dual-encoder-based network architecture that focuses on extracting more comprehensive fracture feature information and combines cross-fusion modules and coordinated attention mechanisms formore efficient feature fusion.Firstly,we use small channel convolution to construct shallow feature extractionmodule(SFEM)to extract low-level feature information of cracks in cement pavement images,in order to obtainmore information about cracks in the shallowfeatures of images.In addition,we construct large kernel atrous convolution(LKAC)to enhance crack information,which incorporates coordination attention mechanism for non-crack information filtering,and large kernel atrous convolution with different cores,using different receptive fields to extract more detailed edge and context information.Finally,the three-stage feature map outputs from the shallow feature extraction module is cross-fused with the two-stage feature map outputs from the large kernel atrous convolution module,and the shallow feature and detailed edge feature are fully fused to obtain the final crack prediction map.We evaluate our method on three public crack datasets:DeepCrack,CFD,and Crack500.Experimental results on theDeepCrack dataset demonstrate the effectiveness of our proposed method compared to state-of-the-art crack detection methods,which achieves Precision(P)87.2%,Recall(R)87.7%,and F-score(F1)87.4%.Thanks to our lightweight crack detectionmodel,the parameter count of the model in real-world detection scenarios has been significantly reduced to less than 2M.This advancement also facilitates technical support for portable scene detection.

Remaining Useful Life Prediction of Rail Based on Improved Pulse Separable Convolution Enhanced Transformer Encoder

In order to prevent possible casualties and economic loss, it is critical to accurate prediction of the Remaining Useful Life (RUL) in rail prognostics health management. However, the traditional neural networks is difficult to capture the long-term dependency relationship of the time series in the modeling of the long time series of rail damage, due to the coupling relationship of multi-channel data from multiple sensors. Here, in this paper, a novel RUL prediction model with an enhanced pulse separable convolution is used to solve this issue. Firstly, a coding module based on the improved pulse separable convolutional network is established to effectively model the relationship between the data. To enhance the network, an alternate gradient back propagation method is implemented. And an efficient channel attention (ECA) mechanism is developed for better emphasizing the useful pulse characteristics. Secondly, an optimized Transformer encoder was designed to serve as the backbone of the model. It has the ability to efficiently understand relationship between the data itself and each other at each time step of long time series with a full life cycle. More importantly, the Transformer encoder is improved by integrating pulse maximum pooling to retain more pulse timing characteristics. Finally, based on the characteristics of the front layer, the final predicted RUL value was provided and served as the end-to-end solution. The empirical findings validate the efficacy of the suggested approach in forecasting the rail RUL, surpassing various existing data-driven prognostication techniques. Meanwhile, the proposed method also shows good generalization performance on PHM2012 bearing data set.

Feature Enhanced Stacked Auto Encoder for Diseases Detection in Brain MRI

The detection of brain disease is an essential issue in medical and research areas.Deep learning techniques have shown promising results in detecting and diagnosing brain diseases using magnetic resonance imaging(MRI)images.These techniques involve training neural networks on large datasets of MRI images,allowing the networks to learn patterns and features indicative of different brain diseases.However,several challenges and limitations still need to be addressed further to improve the accuracy and effectiveness of these techniques.This paper implements a Feature Enhanced Stacked Auto Encoder(FESAE)model to detect brain diseases.The standard stack auto encoder’s results are trivial and not robust enough to boost the system’s accuracy.Therefore,the standard Stack Auto Encoder(SAE)is replaced with a Stacked Feature Enhanced Auto Encoder with a feature enhancement function to efficiently and effectively get non-trivial features with less activation energy froman image.The proposed model consists of four stages.First,pre-processing is performed to remove noise,and the greyscale image is converted to Red,Green,and Blue(RGB)to enhance feature details for discriminative feature extraction.Second,feature Extraction is performed to extract significant features for classification using DiscreteWavelet Transform(DWT)and Channelization.Third,classification is performed to classify MRI images into four major classes:Normal,Tumor,Brain Stroke,and Alzheimer’s.Finally,the FESAE model outperforms the state-of-theart,machine learning,and deep learning methods such as Artificial Neural Network(ANN),SAE,Random Forest(RF),and Logistic Regression(LR)by achieving a high accuracy of 98.61% on a dataset of 2000 MRI images.The proposed model has significant potential for assisting radiologists in diagnosing brain diseases more accurately and improving patient outcomes.

Brain Functional Network Generation Using Distribution-Regularized Adversarial Graph Autoencoder with Transformer for Dementia Diagnosis

The topological connectivity information derived from the brain functional network can bring new insights for diagnosing and analyzing dementia disorders.The brain functional network is suitable to bridge the correlation between abnormal connectivities and dementia disorders.However,it is challenging to access considerable amounts of brain functional network data,which hinders the widespread application of data-driven models in dementia diagnosis.In this study,a novel distribution-regularized adversarial graph auto-Encoder(DAGAE)with transformer is proposed to generate new fake brain functional networks to augment the brain functional network dataset,improving the dementia diagnosis accuracy of data-driven models.Specifically,the label distribution is estimated to regularize the latent space learned by the graph encoder,which canmake the learning process stable and the learned representation robust.Also,the transformer generator is devised to map the node representations into node-to-node connections by exploring the long-term dependence of highly-correlated distant brain regions.The typical topological properties and discriminative features can be preserved entirely.Furthermore,the generated brain functional networks improve the prediction performance using different classifiers,which can be applied to analyze other cognitive diseases.Attempts on the Alzheimer’s Disease Neuroimaging Initiative(ADNI)dataset demonstrate that the proposed model can generate good brain functional networks.The classification results show adding generated data can achieve the best accuracy value of 85.33%,sensitivity value of 84.00%,specificity value of 86.67%.The proposed model also achieves superior performance compared with other related augmentedmodels.Overall,the proposedmodel effectively improves cognitive disease diagnosis by generating diverse brain functional networks.

Multi-scale attention encoder for street-to-aerial image geo-localization

The goal of street-to-aerial cross-view image geo-localization is to determine the location of the query street-view image by retrieving the aerial-view image from the same place.The drastic viewpoint and appearance gap between the aerial-view and the street-view images brings a huge challenge against this task.In this paper,we propose a novel multiscale attention encoder to capture the multiscale contextual information of the aerial/street-view images.To bridge the domain gap between these two view images,we first use an inverse polar transform to make the street-view images approximately aligned with the aerial-view images.Then,the explored multiscale attention encoder is applied to convert the image into feature representation with the guidance of the learnt multiscale information.Finally,we propose a novel global mining strategy to enable the network to pay more attention to hard negative exemplars.Experiments on standard benchmark datasets show that our approach obtains 81.39%top-1 recall rate on the CVUSA dataset and 71.52%on the CVACT dataset,achieving the state-of-the-art performance and outperforming most of the existing methods significantly.

从隐空间理解编码器(Encoder)

1前言当我们在阅读关于AIGC的文章时,常常会看到Encoder和Decoder名词。它们是AI(即ML)的核心模型,如果能深入理解它们的涵意和功能,就能更流畅地理解相关文章的内容,以及图示。例如,关于Diffusion(扩张模型)的文章里常看到如图1。

A New Speech Encoder Based on Dynamic Framing Approach

Latent information is difficult to get from the text in speech synthesis.Studies show that features from speech can get more information to help text encoding.In the field of speech encoding,a lot of work has been conducted on two aspects.The first aspect is to encode speech frame by frame.The second aspect is to encode the whole speech to a vector.But the scale in these aspects is fixed.So,encoding speech with an adjustable scale for more latent information is worthy of investigation.But current alignment approaches only support frame-by-frame encoding and speech-to-vector encoding.It remains a challenge to propose a new alignment approach to support adjustable scale speech encoding.This paper presents the dynamic speech encoder with a new alignment approach in conjunction with frame-by-frame encoding and speech-to-vector encoding.The speech feature fromourmodel achieves three functions.First,the speech feature can reconstruct the origin speech while the length of the speech feature is equal to the text length.Second,our model can get text embedding fromspeech,and the encoded speech feature is similar to the text embedding result.Finally,it can transfer the style of synthesis speech and make it more similar to the given reference speech.

ENCODE计划和功能基因组研究

人类基因组计划完成以来,科学家们一直在努力阐释基因组信息所代表的生物学意义。自2003年开始,美国国家人类基因组研究所(National Human Genome Research Institute,NHGRI)投资近3亿美元启动"DNA元件百科全书(Encyclopedia of DNA Elements,ENCODE)"计划,集结了来自美国、中国、英国、日本、西班牙和新加坡等国家的32个实验室的440余名科学家,共同鉴定并分析人类基因组中所有的功能调控元件。高通量测序技术等实验手段的发展和生物信息学技术的不断完善使得ENCODE计划取得了丰硕的成果:确定了甲基化和组蛋白修饰等表观修饰区域及其对染色质结构的作用,进而确定染色质结构的改变影响基因表达;确定了转录因子及其结合位点的信息,并构建了转录因子调控网络;进一步修订更新了假基因和非编码RNA数据库;并确定了调控序列的单核苷酸多态性(Single nucleotide polymorphism,SNP)并与疾病相关联。这些发现一方面有助于系统解析基因和基因组信息、调控元件的调控作用以及非编码区转录调控等分子机制;同时也将为转化医学等生命科学研究领域提供丰富的数据来源。文章综述了高通量测序技术等实验手段的发展和生物信息学技术的不断完善对ENCODE计划的贡献、表观遗传学研究与ENCODE计划的关联性、ENCODE计划的主要科学成果等,同时展望了ENCODE计划对基础医学、临床医学和转化医学等生命科学研究领域的巨大推动作用。

ASP源代码加密程序Script Encoder算法研究

微软为了保护脚本代码的安全性 ,以 COM组件的形式提供了一种对脚本代码进行编码加密的技术 .但其安全性到底如何呢 ?本文将通过“反编译”的方式对其加密。

基于ENCODER_ATT机制的远程监督关系抽取

在信息抽取中,关系抽取是一项准确识别自然语言中实体间关系的关键技术。针对关系抽取模型中容易丢失关键语义特征问题及远程监督的基本假设容易引入噪声数据的问题,本文提出一种基于远程监督的ENCODER_ATT关系抽取模型。基于循环神经网络构造的ENCODER模型在以词级别进行特征记忆提取,并在句子层面进行语义特征信息整合,保证不遗失关键语义特征的同时去除冗余特征。然后在句子层面引入了注意力机制来降低噪声数据对实验结果的影响。在真实的数据集上进行实验,并绘制准确率-召回率曲线,实验结果表明ENCODER_ATT模型对比同类型的关系抽取方法有明显的提升。

在Flash中基于Adobe Media Encoder组件的视频导入与应用方法

在flash cs6的默认情况下,Flash cs6只支持flv和f4v格式的视频.如果不是这种格式的视频,我们可以使用Flash cs6自带的视频转换组件Adobe Media Encoder将其他视频格式转换成FLV和F4V格式.本文主要讲解如何使用flash自带的Adobe Media Encoder组件进行视频文件的转换,导入和使用.

基于改进Encoder-Decoder模型的新闻摘要生成方法

针对通过Extractive方式实现自动文摘而存在文本连贯性欠缺和出现未登录词问题,提出一种基于改进Encoder-Decoder模型的新闻摘要生成方法。首先,在数据预处理的过程中融入额外的语言特征,如词语的词性和TF-IDF,使词语具有多维度的含义;其次,采用Decoder/Pointer机制在摘要中指向原文本中的位置对低频词进行处理;最后,采用注意力机制来协助模型记忆输入数据并确定其注意程度。在News2016zh数据集上进行实验,结果表明基于改进Encoder-Decoder模型与基线Encoder-Decoder相比,ROUGE-1、ROUGE-2和ROUGE-L值分别提高了32.1%、30.5%和32.5%,在摘要连贯性方面也得到了较好提升。

A correction method of encoder bias in satellite laser ranging system

In a satellite laser ranging telescope system, well-aligned encoders of the elevation and azimuth axes are essential for tracking objects. However, it is very difficult and time-consuming to correct the bias between the absolute-position indices of the encoders and the astronomical coordinates, especially in the absence of a finder scope for our system. To solve this problem, a method is presented based on the phenomenon that all stars move anti-clockwise around Polaris in the northern hemisphere. Tests of the proposed adjustment procedure in a satellite laser ranging （SLR）system demonstrated the effectiveness and the time saved by using the approach, which greatly facilitates the optimization of a trackin~ svstem.

Determination of optimal period of absolute encoders with single track cyclic gray code

Low cost and miniaturized rotary encoders are important in automatic and precise production. Presented here is a code called Single Track Cyclic Gray Code (STCGC) that is an image etched on a single circular track of a rotary encoder disk read by a group of even spread reading heads to provide a unique codeword for every angular position and features such that every two adjacent words differ in exactly one component, thus avoiding coarse error. The existing construction or combination methods are helpful but not sufficient in determining the period of the STCGC of large word length and the theoretical approach needs further development to extend the word length. Three principles, such as the seed combination, short code removal and ergodicity examination were put forward that suffice determination of the optimal period for such absolute rotary encoders using STCGC with even spread heads. The optimal periods of STCGC in 3 through 29 bit length were determined and listed.

Application of Instantaneous Rotational Speed to Detect Gearbox Faults Based on Double Encoders

Considerable studies have been carried out on fault diagnosis of gears, with most of them concentrated on conventional vibration analysis. However, besides the complexity of gear dynamics, the diagnosis results in terms of vibration signal are easily misjudged owing to the interference of sensor position or other components. In this paper, an alternative gearbox fault detection method based on the instantaneous rotational speed is proposed because of its advantages over vibration analysis. Depending on the timer/counter-based method for the pulse signal of the optical encoder, the varying rotational speed can be obtained e ectively. Owing to the coupling and meshing of gears in transmission, the excitations are the same for the instantaneous rotational speed of the input and output shafts. Thus, the di erential signal of instantaneous rotational speeds can be adopted to eliminate the e ect of the interference excitations and extract the associated feature of the localized fault e ectively. With the experiments on multistage gearbox test system, the di erential signal of instantaneous speeds is compared with other signals. It is proved that localized faults in the gearbox generate small angular speed fluctuations, which are measurable with an optical encoder. Using the di erential signal of instantaneous speeds, the fault characteristics are extracted in the spectrum where the deterministic frequency component and its harmonics corresponding to crack fault characteristics are displayed clearly.

System-Level Performance Evaluation of Very High Complexity Media Applications : A H264/AVC Encoder Case Study

Given the substantially increasing complexity of embedded systems, the use of relatively detailed clock cycle-accurate simulators for the design-space exploration is impractical in the early design stages. Raising the abstraction level is nowadays widely seen as a solution to bridge the gap between the increasing system complexity and the low design productivity. For this, several system-level design tools and methodologies have been introduced to efficiently explore the design space of heterogeneous signal processing systems. In this paper, we demonstrate the effectiveness and the flexibility of the Sesame/Artemis system-level modeling and simulation methodology for efficient peformance evaluation and rapid architectural exploration of the increasing complexity heterogeneous embedded media systems. For this purpose, we have selected a system level design of a very high complexity media application;a H.264/AVC (Advanced Video Codec) video encoder. The encoding performances will be evaluated using system-level simulations targeting multiple heterogeneous multiprocessors platforms.

Genetically encoded fluorescent biosensor of histone 3 lysine 79 in MEFs

Introduction Post-translational modifications of core histones have emerged as a critical player in dynamical regulation of gene expression and accurate chromatin structures[1-2].In recent years it has been demonstrated that,histone lysine methylation is particularly prominent as one of the most important epigenetic modifications during cell cycles,development and differentiation,and in response to external stimuli,e.g.exogenous growth factors and mechanical stimulation.This epigenetic modification may also be an early event that regulates the gene expression dur-

Antitumor effects of cytokine gene-encoded vaccinia virus on murine melanoma

Recombinant vaccinia virus has many advantagesover more restricted vectors like retrovirus andadenovirus. The proven safety of vaccinia virus, which isrestricted to local and transitory infection, favors clinicalapplication of vaccinia virus to deliver cytokines locally.

Automatic UAV Positioning with Encoded Sign as Cooperative Target

In order to achieve the goal that unmanned aerial vehicle(UAV)automatically positioning during power inspection,a visual positioning method which utilizes encoded sign as cooperative target is proposed.Firstly,we discuss how to design the encoded sign and propose a robust decoding algorithm based on contour.Secondly,the Adaboost algorithm is used to train a classifier which can detect the encoded sign from image.Lastly,the position of UAV can be calculated by using the projective relation between the object points and their corresponding image points.Experiment includes two parts.First,simulated video data is used to verify the feasibility of the proposed method,and the results show that the average absolute error in each direction is below 0.02 m.Second,a video,acquired from an actual UAV flight,is used to calculate the position of UAV.The results show that the calculated trajectory is consistent with the actual flight path.The method runs at a speed of 0.153 sper frame.

Application of deep autoencoder model for structural condition monitoring

Damage detection in structures is performed via vibra-tion based structural identification. Modal information, such as fre-quencies and mode shapes, are widely used for structural dama-ge detection to indicate the health conditions of civil structures.The deep learning algorithm that works on a multiple layer neuralnetwork model termed as deep autoencoder is proposed to learnthe relationship between the modal information and structural stiff-ness parameters. This is achieved via dimension reduction of themodal information feature and a non-linear regression against thestructural stiffness parameters. Numerical tests on a symmetri-cal steel frame model are conducted to generate the data for thetraining and validation, and to demonstrate the efficiency of theproposed approach for vibration based structural damage detec-tion.