Augmented Deep Multi-Granularity Pose-Aware Feature Fusion Network for Visible-Infrared Person Re-Identification

Visible-infrared Cross-modality Person Re-identification(VI-ReID)is a critical technology in smart public facilities such as cities,campuses and libraries.It aims to match pedestrians in visible light and infrared images for video surveillance,which poses a challenge in exploring cross-modal shared information accurately and efficiently.Therefore,multi-granularity feature learning methods have been applied in VI-ReID to extract potential multi-granularity semantic information related to pedestrian body structure attributes.However,existing research mainly uses traditional dual-stream fusion networks and overlooks the core of cross-modal learning networks,the fusion module.This paper introduces a novel network called the Augmented Deep Multi-Granularity Pose-Aware Feature Fusion Network(ADMPFF-Net),incorporating the Multi-Granularity Pose-Aware Feature Fusion(MPFF)module to generate discriminative representations.MPFF efficiently explores and learns global and local features with multi-level semantic information by inserting disentangling and duplicating blocks into the fusion module of the backbone network.ADMPFF-Net also provides a new perspective for designing multi-granularity learning networks.By incorporating the multi-granularity feature disentanglement(mGFD)and posture information segmentation(pIS)strategies,it extracts more representative features concerning body structure information.The Local Information Enhancement(LIE)module augments high-performance features in VI-ReID,and the multi-granularity joint loss supervises model training for objective feature learning.Experimental results on two public datasets show that ADMPFF-Net efficiently constructs pedestrian feature representations and enhances the accuracy of VI-ReID.

How do temporal and spectral features .matter in crop classification in Heilongjiang Province, China？

How to fully use spectral and temporal information for efficient identification of crops becomes a crucial issue since each crop has its specific seasonal dynamics. A thorough understanding on the relative usefulness of spectral and temporal features is thus essential for better organization of crop classification information. This study, taking Heilongjiang Province as the study area, aims to use time-series moderate resolution imaging spectroradiometer （MODIS） surface reflectance product （MOD09A1） data to evaluate the importance of spectral and temporal features for crop classification. In doing so, a feature selection strategy based on separability index （SI） was first used to rank the most important spectro-temporal features for crop classification. Ten feature scenarios with different spectral and temporal variable combinations were then devised, which were used for crop classification using the support vector machine and their accuracies were finally assessed with the same crop samples. The results show that the normalized difference tillage index （NDTI）, land surface water index （LSWl） and enhanced vegetation index （EVI） are the most informative spectral features and late August to early September is the most informative temporal window for identifying crops in Heilongjiang for the observed year 2011. Spectral diversity and time variety are both vital for crop classification, and their combined use can improve the accuracy by about 30% in comparison with single image. The feature selection technique based on SI analysis is superior for achieving high crop classification accuracy （producers＇ accuracy of 94.03% and users＇ accuracy of 93.77%） with a small number of features. Increasing temporal resolution is not necessarily important for improving the classification accuracies for crops, and a relatively high classification accuracy can be achieved as long as the images associated with key phenological phrases are retained.

Spectral matching algorithm based on nonsubsampled contourlet transform and scale-invariant feature transform

A new spectral matching algorithm is proposed by us- ing nonsubsampled contourlet transform and scale-invariant fea- ture transform. The nonsubsampled contourlet transform is used to decompose an image into a low frequency image and several high frequency images, and the scale-invariant feature transform is employed to extract feature points from the low frequency im- age. A proximity matrix is constructed for the feature points of two related images. By singular value decomposition of the proximity matrix, a matching matrix （or matching result） reflecting the match- ing degree among feature points is obtained. Experimental results indicate that the proposed algorithm can reduce time complexity and possess a higher accuracy.

Evaluation of effective spectral features for glacial lake mapping by using Landsat-8 OLI imagery

Glacial lake mapping provides the most feasible way for investigating the water resources and monitoring the flood outburst hazards in High Mountain Region.However,various types of glacial lakes with different properties bring a constraint to the rapid and accurate glacial lake mapping over a large scale.Existing spectral features to map glacial lakes are diverse but some are generally limited to the specific glaciated regions or lake types,some have unclear applicability,which hamper their application for the large areas.To this end,this study provides a solution for evaluating the most effective spectral features in glacial lake mapping using Landsat-8 imagery.The 23 frequently-used lake mapping spectral features,including single band reflectance features,Water Index features and image transformation features were selected,then the insignificant features were filtered out based on scoring calculated from two classical feature selection methods-random forest and decision tree algorithm.The result shows that the three most prominent spectral features(SF)with high scores are NDWI1,EWI,and NDWI3(renamed as SF8,SF19 and SF12 respectively).Accuracy assessment of glacial lake mapping results in five different test sites demonstrate that the selected features performed well and robustly in classifying different types of glacial lakes without any influence from the mountain shadows.SF8 and SF19 are superior for the detection of large amount of small glacial lakes,while some lake areas extracted by SF12 are incomplete.Moreover,SF8 achieved better accuracy than the other two features in terms of both Kappa Coefficient(0.8812)and Prediction(0.9025),which further indicates that SF8 has great potential for large scale glacial lake mapping in high mountainous area.

Stacked spectral feature space patch: An advanced spectral representation for precise crop classification based on convolutional neural network

Spectral and spatial features in remotely sensed data play an irreplaceable role in classifying crop types for precision agriculture. Despite the thriving establishment of the handcrafted features, designing or selecting such features valid for specific crop types requires prior knowledge and thus remains an open challenge. Convolutional neural networks(CNNs) can effectively overcome this issue with their advanced ability to generate high-level features automatically but are still inadequate in mining spectral features compared to mining spatial features. This study proposed an enhanced spectral feature called Stacked Spectral Feature Space Patch(SSFSP) for CNN-based crop classification. SSFSP is a stack of twodimensional(2 D) gridded spectral feature images that record various crop types’ spatial and intensity distribution characteristics in a 2 D feature space consisting of two spectral bands. SSFSP can be input into2 D-CNNs to support the simultaneous mining of spectral and spatial features, as the spectral features are successfully converted to 2 D images that can be processed by CNN. We tested the performance of SSFSP by using it as the input to seven CNN models and one multilayer perceptron model for crop type classification compared to using conventional spectral features as input. Using high spatial resolution hyperspectral datasets at three sites, the comparative study demonstrated that SSFSP outperforms conventional spectral features regarding classification accuracy, robustness, and training efficiency. The theoretical analysis summarizes three reasons for its excellent performance. First, SSFSP mines the spectral interrelationship with feature generality, which reduces the required number of training samples.Second, the intra-class variance can be largely reduced by grid partitioning. Third, SSFSP is a highly sparse feature, which reduces the dependence on the CNN model structure and enables early and fast convergence in model training. In conclusion, SSFSP has great potential for practical crop classification in precision agriculture.

Detecting soil salinity with arid fraction integrated index and salinity index in feature space using Landsat TM imagery

Modeling soil salinity in an arid salt-affected ecosystem is a difficult task when using remote sensing data because of the complicated soil context （vegetation cover, moisture, surface roughness, and organic matter） and the weak spectral features of salinized soil. Therefore, an index such as the salinity index （SI） that only uses soil spectra may not detect soil salinity effectively and quantitatively. The use of vegetation reflectance as an indirect indicator can avoid limitations associated with the direct use of soil reflectance. The normalized difference vegetation index （NDVI）, as the most common vegetation index, was found to be responsive to salinity but may not be available for retrieving sparse vegetation due to its sensitivity to background soil in arid areas. Therefore, the arid fraction integrated index （AFⅡ） was created as supported by the spectral mixture analysis （SMA）, which is more appropriate for analyzing variations in vegetation cover （particularly halophytes） than NDVI in the study area. Using soil and vegetation separately for detecting salinity perhaps is not feasible. Then, we developed a new and operational model, the soil salinity detecting model （SDM） that combines AFⅡ and SI to quantitatively estimate the salt content in the surface soil. SDMs, including SDM1 and SDM2, were constructed through analyzing the spatial characteristics of soils with different salinization degree by integrating AFⅡ and SI using a scatterplot. The SDMs were then compared to the combined spectral response index （COSRI） from field measurements with respect to the soil salt content. The results indicate that the SDM values are highly correlated with soil salinity, in contrast to the performance of COSRI. Strong exponential relationships were observed between soil salinity and SDMs （R2〉0.86, RMSE〈6.86） compared to COSRI （R2=0.71, RMSE=16.21）. These results suggest that the feature space related to biophysical properties combined with AFII and SI can effectively provide information on soil salinity.

Different Feature Selection of Soil Attributes Influenced Clustering Performance on Soil Datasets

Feature selection is very important to obtain meaningful and interpretive clustering results from a clustering analysis. In the application of soil data clustering, there is a lack of good understanding of the response of clustering performance to different features subsets. In the present paper, we analyzed the performance differences between k-means, fuzzy c-means, and spectral clustering algorithms in the conditions of different feature subsets of soil data sets. The experimental results demonstrated that the performances of spectral clustering algorithm were generally better than those of k-means and fuzzy c-means with different features subsets. The feature subsets containing environmental attributes helped to improve clustering performances better than those having spatial attributes and produced more accurate and meaningful clustering results. Our results demonstrated that combination of spectral clustering algorithm with the feature subsets containing environmental attributes rather than spatial attributes may be a better choice in applications of soil data clustering.

Sanxingdui Cultural Relics Recognition Algorithm Based on Hyperspectral Multi-Network Fusion

Sanxingdui cultural relics are the precious cultural heritage of humanity with high values of history,science,culture,art and research.However,mainstream analytical methods are contacting and detrimental,which is unfavorable to the protection of cultural relics.This paper improves the accuracy of the extraction,location,and analysis of artifacts using hyperspectral methods.To improve the accuracy of cultural relic mining,positioning,and analysis,the segmentation algorithm of Sanxingdui cultural relics based on the spatial spectrum integrated network is proposed with the support of hyperspectral techniques.Firstly,region stitching algorithm based on the relative position of hyper spectrally collected data is proposed to improve stitching efficiency.Secondly,given the prominence of traditional HRNet(High-Resolution Net)models in high-resolution data processing,the spatial attention mechanism is put forward to obtain spatial dimension information.Thirdly,in view of the prominence of 3D networks in spectral information acquisition,the pyramid 3D residual network model is proposed to obtain internal spectral dimensional information.Fourthly,four kinds of fusion methods at the level of data and decision are presented to achieve cultural relic labeling.As shown by the experiment results,the proposed network adopts an integrated method of data-level and decision-level,which achieves the optimal average accuracy of identification 0.84,realizes shallow coverage of cultural relics labeling,and effectively supports the mining and protection of cultural relics.

A double-layer model for improving the estimation of wheat canopy nitrogen content from unmanned aerial vehicle multispectral imagery

The accurate and rapid estimation of canopy nitrogen content(CNC)in crops is the key to optimizing in-season nitrogen fertilizer application in precision agriculture.However,the determination of CNC from field sampling data for leaf area index(LAI),canopy photosynthetic pigments(CPP;including chlorophyll a,chlorophyll b and carotenoids)and leaf nitrogen concentration(LNC)can be time-consuming and costly.Here we evaluated the use of high-precision unmanned aerial vehicle(UAV)multispectral imagery for estimating the LAI,CPP and CNC of winter wheat over the whole growth period.A total of 23 spectral features(SFs;five original spectrum bands,17 vegetation indices and the gray scale of the RGB image)and eight texture features(TFs;contrast,entropy,variance,mean,homogeneity,dissimilarity,second moment,and correlation)were selected as inputs for the models.Six machine learning methods,i.e.,multiple stepwise regression(MSR),support vector regression(SVR),gradient boosting decision tree(GBDT),Gaussian process regression(GPR),back propagation neural network(BPNN)and radial basis function neural network(RBFNN),were compared for the retrieval of winter wheat LAI,CPP and CNC values,and a double-layer model was proposed for estimating CNC based on LAI and CPP.The results showed that the inversion of winter wheat LAI,CPP and CNC by the combination of SFs+TFs greatly improved the estimation accuracy compared with that by using only the SFs.The RBFNN and BPNN models outperformed the other machine learning models in estimating winter wheat LAI,CPP and CNC.The proposed double-layer models(R^(2)=0.67-0.89,RMSE=13.63-23.71 mg g^(-1),MAE=10.75-17.59 mg g^(-1))performed better than the direct inversion models(R^(2)=0.61-0.80,RMSE=18.01-25.12 mg g^(-1),MAE=12.96-18.88 mg g^(-1))in estimating winter wheat CNC.The best winter wheat CNC accuracy was obtained by the double-layer RBFNN model with SFs+TFs as inputs(R^(2)=0.89,RMSE=13.63 mg g^(-1),MAE=10.75 mg g^(-1)).The results of this study can provide guidance for the accurate and rapid determination of winter wheat canopy nitrogen content in the field.

Automated Pulse-Based Diagnosis: Role of TIM Diagnostic Features

Emanated from the idea of reinvestigating ancient medical system of Ayurveda—Traditional Indian Medicine (TIM), our recent study had shown significant applications of analysis of arterial pulse waveforms for non-invasive diagnosis of cardiovascular functions. Here we present results of further investigations analyzing the relation of pulse-characteristics with some clinical and pathological parameters and other features that are of diagnostic importance in Ayurveda.

Novel Face Recognition Method by Combining Spatial Domain and Selected Complex Wavelet Features

A novel face recognition method based on fusion of spatial and frequency features was presented to improve recognition accuracy. Dual-Tree Complex Wavelet Transform derives desirable facial features to cope with the variation due to the illumination and facial expression changes. By adopting spectral regression and complex fusion technologies respectively, two improved neighborhood preserving discriminant analysis feature extraction methods were proposed to capture the face manifold structures and locality discriminatory information. Extensive experiments have been made to compare the recognition performance of the proposed method with some popular dimensionality reduction methods on ORL and Yale face databases. The results verify the effectiveness of the proposed method.

A dive into spectral inference networks: improved algorithms for self-supervised learning of continuous spectral representations

We propose a self-supervising learning framework for finding the dominant eigenfunction-eigenvalue pairs of linear and self-adjoint operators.We represent target eigenfunctions with coordinate-based neural networks and employ the Fourier positional encodings to enable the approximation of high-frequency modes.We formulate a self-supervised training objective for spectral learning and propose a novel regularization mechanism to ensure that the network finds the exact eigenfunctions instead of a space spanned by the eigenfunctions.Furthermore,we investigate the effect of weight normalization as a mechanism to alleviate the risk of recovering linear dependent modes,allowing us to accurately recover a large number of eigenpairs.The effectiveness of our methods is demonstrated across a collection of representative benchmarks including both local and non-local diffusion operators,as well as high-dimensional time-series data from a video sequence.Our results indicate that the present algorithm can outperform competing approaches in terms of both approximation accuracy and computational cost.

Automated Autism Spectral Disorder Classification Using Optimal Machine Learning Model

Autism Spectrum Disorder (ASD) refers to a neuro-disorder wherean individual has long-lasting effects on communication and interaction withothers.Advanced information technologywhich employs artificial intelligence(AI) model has assisted in early identify ASD by using pattern detection.Recent advances of AI models assist in the automated identification andclassification of ASD, which helps to reduce the severity of the disease.This study introduces an automated ASD classification using owl searchalgorithm with machine learning (ASDC-OSAML) model. The proposedASDC-OSAML model majorly focuses on the identification and classificationof ASD. To attain this, the presentedASDC-OSAML model follows minmaxnormalization approach as a pre-processing stage. Next, the owl searchalgorithm (OSA)-based feature selection (OSA-FS) model is used to derivefeature subsets. Then, beetle swarm antenna search (BSAS) algorithm withIterative Dichotomiser 3 (ID3) classification method was implied for ASDdetection and classification. The design of BSAS algorithm helps to determinethe parameter values of the ID3 classifier. The performance analysis of theASDC-OSAML model is performed using benchmark dataset. An extensivecomparison study highlighted the supremacy of the ASDC-OSAML modelover recent state of art approaches.

基于OFMD和FSC的滚动轴承复合故障诊断

针对滚动轴承的复合故障诊断问题,深入研究了一种基于优化特征模态分解和快速谱相关的复合故障诊断方法。首先,通过理论分析,提出脉冲能量因子指标来实现特征模态分解的参数选择以及最优分量的选取;然后,基于快速谱相关原理设计谱相关相对强度曲线和改进快速谱相关图,用于确定不同故障调制后对应的最优载波,对最优载波进行包络处理,从而分离轴承的复合故障特征,最终实现复合故障的准确性诊断。通过模拟故障试验和工程案例分析结果表明,该文所提方法相比于经验模态分解能够有效滤除噪声干扰,具有良好的鲁棒性,同时,避免了解卷积方法设定参数的缺陷,且与Autogram方法相比,能够有效分离复合故障特征,避免复合故障特征成分耦合。

基于5 kHz平面激光诱导荧光的射流火焰局部熄火时空特性分析

基于高频光学测量手段研究射流火焰局部熄火的分布特性,对于分析燃烧场不稳定性机理有重要意义。建立5 kHz的平面激光诱导荧光测量系统,对高速射流火焰开展实验研究,并获得火焰结构的动态发展过程;将双边滤波、竖直滑窗局部自适应阈值等图像处理方法引入平面激光诱导荧光图像的预处理,在局部断裂结构数量特征的基础上,提取局部断裂结构长度和空间位置等特征;基于上述特征深入解析局部熄火的时空分布特性,进一步完善高频平面激光诱导荧光诊断与分析方法。研究表明:双边滤波算法处理后,图像峰值信噪比为34.3 dB,结构相似度为0.93,噪声水平显著降低,获得了较好的去噪效果;使用竖直滑窗局部自适应方法进行图像分割的F1分数达到93.30%;断裂结构累计数量随时间线性增加,当射流马赫数由0.5增至1.6时,单侧图像断裂结构的每秒累计数量从790.7增至9 217.2,并且局部熄火频率与射流马赫数呈指数关系;断裂结构主要分布区域为火焰臂及上侧中央燃料区。本研究进一步拓展了高频平面激光诱导荧光技术的应用能力,证明了高频平面激光诱导荧光技术用于局部熄火时空分布特性研究的可行性。

基于光流估计的“珠海一号”高光谱卫星遥感数据的固体废弃物识别方法——以河南省济源示范区为例

本文提出了一种基于光流估计的高光谱卫星遥感数据的固体废弃物识别方法。首先,从序列数据的角度看待高光谱数据,引入DeepFlow光流估计技术提取光谱维度的亮度变化信息,作为更具判别性的光谱运动特征;然后,将提取的光谱运动特征与原始光谱特征相结合后输入至常用的支持向量机进行固废识别;最后,进一步提出固废识别后处理方法改善识别效果,并利用“珠海一号”高光谱卫星遥感数据,以河南省济源示范区为研究区展开试验。试验结果表明,本文方法能够对露天堆放的工业固体废弃物进行大范围的快速精准识别,初步锁定济源示范区内存在固废遗留和违规堆放行为的11个地域风险点,且识别精度优于传统的光谱特征提取和分类方法,为后期人工现地勘察固废和“清废”行动显著节省了时间和工作量。

二维层状盆地地震动附加放大特征研究:SV波入射

发展了一种基于谱元法和多次透射边界的平面SV波入射下二维复杂场地波动数值模拟方法。基于该方法,模拟分析了31条地震波输入下二维典型层状沉积盆地中的各场点相比其对应的一维土层模型的模拟地震动的附加放大特征,分析了放大系数对于输入地震波的敏感性。结果表明,该方法具有较高精度和良好的高频稳定性。不同地震波输入下,盆地地面运动及其放大特征存在较大差别。水平分量上平均反应谱放大系数的较大值(最大1.2左右)集中在盆地边缘区域及周期等于0.5倍~0.7倍自振周期附近,垂直分量上较大放大系数(最大0.9左右)紧邻盆地角点且周期为0.3倍自振周期处。同时,盆地对不同周期地震动的放大特征,以及不同位置点的谱放大系数随周期的变化规律均表现出明显不同,相对短周期地震动的盆地边缘效应最为强烈,而相对长周期地震动的放大作用明显减弱。此外,盆地边缘区域的放大系数对输入波最为敏感,不同地震波输入下放大系数值在较大范围内变化;而盆地中间区域的放大系数对输入波不敏感,其值的变化范围相对较小。

考虑关联波段特性的光谱相似图像分类方法

光谱相似图像分类性能过差会增加光谱信息冗余度,降低地物勘探与军事防御等多种领域的光谱探测效率。为了多元素匀质区分光谱信息与光谱曲线,提出考虑关联波段特性的光谱相似图像分类方法。该方法首先利用光谱匹配消除光谱相似图像白色光源过曝现象。然后提取优化图像的关联波段,并将其作为聚类特征输入支持向量机中。最后根据支持向量机的输出结果,实现光谱相似图像分类。实验结果表明,所提方法分类结果清晰度较高,分类误差或像素块填色错误小,混淆矩阵中同行同列矩形块的分类精度较高。

基于累积和事件段识别与改进谱聚类的锂离子电池储能系统内短路故障检测方法

锂离子电池系统的内短路故障可能导致严重安全事故,其检测受到在线检测实时性以及故障特征获得性制约,是当下锂离子电池储能系统安全运行亟待解决的问题。该文提出一种基于累积和(cumulative sum,CUSUM)事件段检测与改进谱聚类的锂离子电池储能系统内短路故障检测方法。首先,考虑内短路故障时的电压/温度变化特性,基于累积和事件突变点识别方法,识别疑似内短路故障事件段。其次,构建三维故障特征,刻画检测对象内短路故障特征属性。然后,构建基于Wasserstein测度的内短路故障特征距离矩阵,检测三维空间各点稀疏特性,客观划定故障聚类,实现内短路故障检测。搭建锂离子电池内短路实验平台、建立锂离子电池电–热耦合仿真模型,算例结果表明该文方法能够准确识别疑似内短路故障事件段,在不同串并联形式及故障类型下实现故障检测,证明了该文方法的正确性与可行性。