Salient pairwise spatio-temporal interest points for real-time activity recognition

Real-time Human action classification in complex scenes has applications in various domains such as visual surveillance, video retrieval and human robot interaction. While, the task is challenging due to computation efficiency, cluttered backgrounds and intro-variability among same type of actions. Spatio-temporal interest point （STIP） based methods have shown promising results to tackle human action classification in complex scenes efficiently. However, the state-of-the-art works typically utilize bag-of-visual words （BoVW） model which only focuses on the word distribution of STIPs and ignore the distinctive character of word structure. In this paper, the distribution of STIPs is organized into a salient directed graph, which reflects salient motions and can be divided into a time salient directed graph and a space salient directed graph, aiming at adding spatio-temporal discriminant to BoVW. Generally speaking, both salient directed graphs are constructed by labeled STIPs in pairs. In detail, the ＂directional co-occurrence＂ property of different labeled pairwise STIPs in same frame is utilized to represent the time saliency, and the space saliency is reflected by the ＂geometric relationships＂ between same labeled pairwise STIPs across different frames. Then, new statistical features namely the Time Salient Pairwise feature （TSP） and the Space Salient Pairwise feature （SSP） are designed to describe two salient directed graphs, respectively. Experiments are carried out with a homogeneous kernel SVM classifier, on four challenging datasets KTH, ADL and UT-Interaction. Final results confirm the complementary of TSP and SSP, and our multi-cue representation TSP ＋ SSP ＋ BoVW can properly describe human actions with large intro-variability in real-time.

Improved spatio-temporal alignment measurement method for hull deformation

In this paper,an improved spatio-temporal alignment measurement method is presented to address the inertial matching measurement of hull deformation under the coexistence of time delay and large misalignment angle.Large misalignment angle and time delay often occur simultaneously and bring great challenges to the accurate measurement of hull deformation in space and time.The proposed method utilizes coarse alignment with large misalignment angle and time delay estimation of inertial measurement unit modeling to establish a brand-new spatiotemporal aligned hull deformation measurement model.In addition,two-step loop control is designed to ensure the accurate description of dynamic deformation angle and static deformation angle by the time-space alignment method of hull deformation.The experiments illustrate that the proposed method can effectively measure the hull deformation angle when time delay and large misalignment angle coexist.

Spatio-Temporal Change of Dispersal Areas of Greater Kudu (Tragelaphus strepsiceros) in Lake Bogoria Landscape, Kenya

Decline in wildlife populations is manifest globally, regionally and locally. A wildlife decline of 68% has been reported in Kenya’s rangelands with Baringo County experiencing more than 85% wildlife loss in the last four decades. Greater Kudu (Tragelaphus strepsiceros) is endemic to Lake Bogoria landscape in Baringo County and constitutes a major tourist attraction for the region necessitating use of its photo on the County’s logo and thus a flagship species. Tourism plays a central role in Baringo County’s economy and is a major source of potential growth and employment creation. The study was carried out to assess spatio-temporal change of dispersal areas of Greater Kudu (GK) in Lake Bogoria landscape in the last four years for enhanced adaptive management and improved livelihoods. GK population distribution primary data collected in December 2022 and secondary data acquired from Lake Bogoria National Game Reserve (LBNGR) for 2019 and 2020 were digitized using in a Geographic Information System (GIS). Measures of dispersion and point pattern analysis (PPA) were used to analyze dispersal of GK population using GIS. Spatio-temporal change of GK dispersal in LBNR was evident thus the null hypothesis was rejected. It is recommended that anthropogenic activities contributing to GK’s habitat degradation be curbed by providing alternative livelihood sources and promoting community adoption of sustainable technologies for improved livelihoods.

Epidemic Characteristics and Spatio-Temporal Patterns of HFRS in Qingdao City,China,2010-2022

Objective This study investigated the epidemic characteristics and spatio-temporal dynamics of hemorrhagic fever with renal syndrome(HFRS)in Qingdao City,China.Methods Information was collected on HFRS cases in Qingdao City from 2010 to 2022.Descriptive epidemiologic,seasonal decomposition,spatial autocorrelation,and spatio-temporal cluster analyses were performed.Results A total of 2,220 patients with HFRS were reported over the study period,with an average annual incidence of 1.89/100,000 and a case fatality rate of 2.52%.The male:female ratio was 2.8:1.75.3%of patients were aged between 16 and 60 years old,75.3%of patients were farmers,and 11.6%had both“three red”and“three pain”symptoms.The HFRS epidemic showed two-peak seasonality:the primary fall-winter peak and the minor spring peak.The HFRS epidemic presented highly spatially heterogeneous,street/township-level hot spots that were mostly distributed in Huangdao,Pingdu,and Jiaozhou.The spatio-temporal cluster analysis revealed three cluster areas in Qingdao City that were located in the south of Huangdao District during the fall-winter peak.Conclusion The distribution of HFRS in Qingdao exhibited periodic,seasonal,and regional characteristics,with high spatial clustering heterogeneity.The typical symptoms of“three red”and“three pain”in patients with HFRS were not obvious.

Dynamic adaptive spatio-temporal graph network for COVID-19 forecasting

Appropriately characterising the mixed space-time relations of the contagion process caused by hybrid space and time factors remains the primary challenge in COVID-19 forecasting.However,in previous deep learning models for epidemic forecasting,spatial and temporal variations are captured separately.A unified model is developed to cover all spatio-temporal relations.However,this measure is insufficient for modelling the complex spatio-temporal relations of infectious disease transmission.A dynamic adaptive spatio-temporal graph network(DASTGN)is proposed based on attention mechanisms to improve prediction accuracy.In DASTGN,complex spatio-temporal relations are depicted by adaptively fusing the mixed space-time effects and dynamic space-time dependency structure.This dual-scale model considers the time-specific,space-specific,and direct effects of the propagation process at the fine-grained level.Furthermore,the model characterises impacts from various space-time neighbour blocks under time-varying interventions at the coarse-grained level.The performance comparisons on the three COVID-19 datasets reveal that DASTGN achieves state-of-the-art results with a maximum improvement of 17.092%in the root mean-square error and 11.563%in the mean absolute error.Experimental results indicate that the mechanisms of designing DASTGN can effectively detect some spreading characteristics of COVID-19.The spatio-temporal weight matrices learned in each proposed module reveal diffusion patterns in various scenarios.In conclusion,DASTGN has successfully captured the dynamic spatio-temporal variations of COVID-19,and considering multiple dynamic space-time relationships is essential in epidemic forecasting.

An Intelligent Framework for Resilience Recovery of FANETs with Spatio-Temporal Aggregation and Multi-Head Attention Mechanism

Due to the time-varying topology and possible disturbances in a conflict environment,it is still challenging to maintain the mission performance of flying Ad hoc networks(FANET),which limits the application of Unmanned Aerial Vehicle(UAV)swarms in harsh environments.This paper proposes an intelligent framework to quickly recover the cooperative coveragemission by aggregating the historical spatio-temporal network with the attention mechanism.The mission resilience metric is introduced in conjunction with connectivity and coverage status information to simplify the optimization model.A spatio-temporal node pooling method is proposed to ensure all node location features can be updated after destruction by capturing the temporal network structure.Combined with the corresponding Laplacian matrix as the hyperparameter,a recovery algorithm based on the multi-head attention graph network is designed to achieve rapid recovery.Simulation results showed that the proposed framework can facilitate rapid recovery of the connectivity and coverage more effectively compared to the existing studies.The results demonstrate that the average connectivity and coverage results is improved by 17.92%and 16.96%,respectively compared with the state-of-the-art model.Furthermore,by the ablation study,the contributions of each different improvement are compared.The proposed model can be used to support resilient network design for real-time mission execution.

Warhead fragments motion trajectories tracking and spatio-temporal distribution reconstruction method based on high-speed stereo photography

High speed photography technique is potentially the most effective way to measure the motion parameter of warhead fragment benefiting from its advantages of high accuracy,high resolution and high efficiency.However,it faces challenge in dense objects tracking and 3D trajectories reconstruction due to the characteristics of small size and dense distribution of fragment swarm.To address these challenges,this work presents a warhead fragments motion trajectories tracking and spatio-temporal distribution reconstruction method based on high-speed stereo photography.Firstly,background difference algorithm is utilized to extract the center and area of each fragment in the image sequence.Subsequently,a multi-object tracking(MOT)algorithm using Kalman filtering and Hungarian optimal assignment is developed to realize real-time and robust trajectories tracking of fragment swarm.To reconstruct 3D motion trajectories,a global stereo trajectories matching strategy is presented,which takes advantages of epipolar constraint and continuity constraint to correctly retrieve stereo correspondence followed by 3D trajectories refinement using polynomial fitting.Finally,the simulation and experimental results demonstrate that the proposed method can accurately track the motion trajectories and reconstruct the spatio-temporal distribution of 1.0×10^(3)fragments in a field of view(FOV)of 3.2 m×2.5 m,and the accuracy of the velocity estimation can achieve 98.6%.

A cloud model target damage effectiveness assessment algorithm based on spatio-temporal sequence finite multilayer fragments dispersion

To solve the problem of target damage assessment when fragments attack target under uncertain projectile and target intersection in an air defense intercept,this paper proposes a method for calculating target damage probability leveraging spatio-temporal finite multilayer fragments distribution and the target damage assessment algorithm based on cloud model theory.Drawing on the spatial dispersion characteristics of fragments of projectile proximity explosion,we divide into a finite number of fragments distribution planes based on the time series in space,set up a fragment layer dispersion model grounded in the time series and intersection criterion for determining the effective penetration of each layer of fragments into the target.Building on the precondition that the multilayer fragments of the time series effectively assail the target,we also establish the damage criterion of the perforation and penetration damage and deduce the damage probability calculation model.Taking the damage probability of the fragment layer in the spatio-temporal sequence to the target as the input state variable,we introduce cloud model theory to research the target damage assessment method.Combining the equivalent simulation experiment,the scientific and rational nature of the proposed method were validated through quantitative calculations and comparative analysis.

Self-Attention Spatio-Temporal Deep Collaborative Network for Robust FDIA Detection in Smart Grids

False data injection attack(FDIA)can affect the state estimation of the power grid by tampering with the measured value of the power grid data,and then destroying the stable operation of the smart grid.Existing work usually trains a detection model by fusing the data-driven features from diverse power data streams.Data-driven features,however,cannot effectively capture the differences between noisy data and attack samples.As a result,slight noise disturbances in the power grid may cause a large number of false detections for FDIA attacks.To address this problem,this paper designs a deep collaborative self-attention network to achieve robust FDIA detection,in which the spatio-temporal features of cascaded FDIA attacks are fully integrated.Firstly,a high-order Chebyshev polynomials-based graph convolution module is designed to effectively aggregate the spatio information between grid nodes,and the spatial self-attention mechanism is involved to dynamically assign attention weights to each node,which guides the network to pay more attention to the node information that is conducive to FDIA detection.Furthermore,the bi-directional Long Short-Term Memory(LSTM)network is introduced to conduct time series modeling and long-term dependence analysis for power grid data and utilizes the temporal selfattention mechanism to describe the time correlation of data and assign different weights to different time steps.Our designed deep collaborative network can effectively mine subtle perturbations from spatiotemporal feature information,efficiently distinguish power grid noise from FDIA attacks,and adapt to diverse attack intensities.Extensive experiments demonstrate that our method can obtain an efficient detection performance over actual load data from New York Independent System Operator(NYISO)in IEEE 14,IEEE 39,and IEEE 118 bus systems,and outperforms state-of-the-art FDIA detection schemes in terms of detection accuracy and robustness.

Traveling Wave Solutions of a SIR Epidemic Model with Spatio-Temporal Delay

In this paper, we studied the traveling wave solutions of a SIR epidemic model with spatial-temporal delay. We proved that this result is determined by the basic reproduction number R0and the minimum wave speed c*of the corresponding ordinary differential equations. The methods used in this paper are primarily the Schauder fixed point theorem and comparison principle. We have proved that when R0>1and c>c*, the model has a non-negative and non-trivial traveling wave solution. However, for R01and c≥0or R0>1and 0cc*, the model does not have a traveling wave solution.

Multi-Scale Location Attention Model for Spatio-Temporal Prediction of Disease Incidence

Due to the increasingly severe challenges brought by various epidemic diseases,people urgently need intelligent outbreak trend prediction.Predicting disease onset is very important to assist decision-making.Most of the exist-ing work fails to make full use of the temporal and spatial characteristics of epidemics,and also relies on multi-variate data for prediction.In this paper,we propose a Multi-Scale Location Attention Graph Neural Networks(MSLAGNN)based on a large number of Centers for Disease Control and Prevention(CDC)patient electronic medical records research sequence source data sets.In order to understand the geography and timeliness of infec-tious diseases,specific neural networks are used to extract the geography and timeliness of infectious diseases.In the model framework,the features of different periods are extracted by a multi-scale convolution module.At the same time,the propagation effects between regions are simulated by graph convolution and attention mechan-isms.We compare the proposed method with the most advanced statistical methods and deep learning models.Meanwhile,we conduct comparative experiments on data sets with different time lengths to observe the predic-tion performance of the model in the face of different degrees of data collection.We conduct extensive experi-ments on real-world epidemic-related data sets.The method has strong prediction performance and can be readily used for epidemic prediction.

Research on the Spatio-Temporal Evolution and Driving Forces of Green Spaces in the Central Urban Area of Zunyi City

Green space,as a medium for carrying out urban functions and guiding urban development,is becoming a scarce resource along with the urbanization process and the intensification of environmental problems.In the face of the spatial mismatch between high demand and low supply,it is of great significance to clarify the evolution mechanism of green space to undertake national spatial planning,protect the natural strategic resources in the urban fringe area,and promote the sustainable development of the“three living spaces.”The study focuses on the Zunyi City Center,selecting the 20 years of rapid development following its establishment as a city as the study period.It explores the dynamic evolution of green space and the main driving forces during different periods using remote-sensing image data.The study shows that from 2003 to 2023,the total scale of green space has an obvious decreasing trend along with the expansion of the urban built-up area.A large amount of arable land is being converted to construction land,resulting in a sudden decrease in arable land area.In the past 10 years,the comprehensive land use dynamics have accelerated.Still,the spatial difference has gradually narrowed,indicating that the overall development intensity of Zunyi City’s central urban area has increased.There is a gradual spread of the trend to the hilly areas.The limiting effect of the mountainous natural environment on the city’s development has gradually diminished under the superposition of external factors,such as economic development,industrial technological upgrading,and policy orientation so the importance of the effective protection and rational utilization of urban green space has become more prominent.

Spatio-Temporal Context-Guided Algorithm for Lossless Point Cloud Geometry Compression

Point cloud compression is critical to deploy 3D representation of the physical world such as 3D immersive telepresence,autonomous driving,and cultural heritage preservation.However,point cloud data are distributed irregularly and discontinuously in spatial and temporal domains,where redundant unoccupied voxels and weak correlations in 3D space make achieving efficient compression a challenging problem.In this paper,we propose a spatio-temporal context-guided algorithm for lossless point cloud geometry compression.The proposed scheme starts with dividing the point cloud into sliced layers of unit thickness along the longest axis.Then,it introduces a prediction method where both intraframe and inter-frame point clouds are available,by determining correspondences between adjacent layers and estimating the shortest path using the travelling salesman algorithm.Finally,the few prediction residual is efficiently compressed with optimal context-guided and adaptive fastmode arithmetic coding techniques.Experiments prove that the proposed method can effectively achieve low bit rate lossless compression of point cloud geometric information,and is suitable for 3D point cloud compression applicable to various types of scenes.

“stppSim”: A Novel Analytical Tool for Creating Synthetic Spatio-Temporal Point Data

In crime science, understanding the dynamics and interactions between crime events is crucial for comprehending the underlying factors that drive their occurrences. Nonetheless, gaining access to detailed spatiotemporal crime records from law enforcement faces significant challenges due to confidentiality concerns. In response to these challenges, this paper introduces an innovative analytical tool named “stppSim,” designed to synthesize fine-grained spatiotemporal point records while safeguarding the privacy of individual locations. By utilizing the open-source R platform, this tool ensures easy accessibility for researchers, facilitating download, re-use, and potential advancements in various research domains beyond crime science.

基于轻量化PointNet网络的林果园喷雾作业靶标实时识别方法

为了进一步提高喷雾机器人靶标检测的精准性、实时性和应用部署的实用性,该研究提出一种基于轻量化PointNet网络的林果园喷雾作业靶标实时识别方法。首先通过区域提取降采样、地面分割和改进DBSCAN聚类等点云预处理方法提取原始点云中的靶标;然后通过移动最小二乘上采样将靶标点云转化为满足点云识别网络输入要求的点云数据;最终通过在PointNet网络中引入残差模块和改进循环剪枝算法轻量化PointNet网络,完成林果树靶标的实时识别。试验结果表明,在ModelNet40数据集上,轻量化PointNet网络可达89.7%的准确率;在实际苗圃环境的试验中,该研究方法对靶标的识别准确率可达92.49%,同时误识率与拒识率分别为13.4%和6.47%,相较PointNet网络识别准确率提升了4.38个百分点,误识率和拒识率分别降低了7.2和4.07个百分点;轻量化PointNet网络识别准确率仅比PointNet++网络低1.14个百分点,误识率和拒识率分别高了0.9和1.12个百分点。但是轻量化PointNet网络的模型参数量较PointNet网络和PointNet++网络的模型参数量显著减少,仅为PointNet网络的11.5%,PointNet++网络的27.02%;运算量相较PointNet网络、PointNet++网络分别减少13.3和76.79个百分点。该研究提出的轻量化PointNet网络具有较高的实时性、精确性和鲁棒性,能够满足林果园喷雾作业的靶标识别需求,可为林果园喷雾作业靶标实时识别提供参考。

Leveraging Transfer Learning for Spatio-Temporal Human Activity Recognition from Video Sequences

Human Activity Recognition(HAR)is an active research area due to its applications in pervasive computing,human-computer interaction,artificial intelligence,health care,and social sciences.Moreover,dynamic environments and anthropometric differences between individuals make it harder to recognize actions.This study focused on human activity in video sequences acquired with an RGB camera because of its vast range of real-world applications.It uses two-stream ConvNet to extract spatial and temporal information and proposes a fine-tuned deep neural network.Moreover,the transfer learning paradigm is adopted to extract varied and fixed frames while reusing object identification information.Six state-of-the-art pre-trained models are exploited to find the best model for spatial feature extraction.For temporal sequence,this study uses dense optical flow following the two-stream ConvNet and Bidirectional Long Short TermMemory(BiLSTM)to capture longtermdependencies.Two state-of-the-art datasets,UCF101 and HMDB51,are used for evaluation purposes.In addition,seven state-of-the-art optimizers are used to fine-tune the proposed network parameters.Furthermore,this study utilizes an ensemble mechanism to aggregate spatial-temporal features using a four-stream Convolutional Neural Network(CNN),where two streams use RGB data.In contrast,the other uses optical flow images.Finally,the proposed ensemble approach using max hard voting outperforms state-ofthe-art methods with 96.30%and 90.07%accuracies on the UCF101 and HMDB51 datasets.

Relationship between spatio-temporal evolution of soil pH and geological environment/surface cover in the eastern Nenjiang River Basin of Northeast China during the past 30 years

To illuminate the spatio-temporal variation characteristics and geochemical driving mechanism of soil pH in the Nenjiang River Basin,the National Multi-objective Regional Geochemical Survey data of topsoil,the Second National Soil Survey data and Normalized Difference Vegetation Index(NDVI)were analyzed.The areas of neutral and alkaline soil decreased by 21100 km^(2)and 30500 km^(2),respectively,while that of strongly alkaline,extremely alkaline,and strongly acidic soil increased by 19600 km^(2),18200 km^(2),and 15500 km^(2),respectively,during the past 30 years.NDVI decreased with the increase of soil pH when soil pH>8.0,and it was reversed when soil pH<5.0.There were significant differences in soil pH with various surface cover types,which showed an ascending order:Arbor<reed<maize<rice<high and medium-covered meadow<low-covered meadow<Puccinellia.The weathering products of minerals rich in K_(2)O,Na_(2)O,CaO,and MgO entered into the low plain and were enriched in different parts by water transportation and lake deposition,while Fe and Al remained in the low hilly areas,which was the geochemical driving mechanism.The results of this study will provide scientific basis for making scientific and rational decisions on soil acidification and salinization.

基于PointNet++的邻域特征增强点云语义分割方法

随着智能驾驶、机器人导航等以点云为基础的应用蓬勃发展,点云语义分割逐渐成为研究热点。然而,现有的点云语义分割方法存在局部特征提取不充分、特征融合不完整的缺陷。针对这些不足,提出了对应的解决方案。对于局部特征提取不充分的现象,通过嵌入邻域点的坐标、方向、距离等相关信息去关联邻域点的显式特征。对于特征融合不完整的现象,提出了一种最大池化与自注意力池化相结合的混合池化方法。网络架构基于PointNet++,并结合提出的局部特征提取和融合方法,在S3DIS数据集上的实验结果表明,与基线方法PointNet++相比,各评价指标都有不同程度的提高,证实了新方法的有效性和优越性。

Spatio-temporal point pattern analysis on Wenchuan strong earthquake

For exploring the aftershock occurrence process of the 2008 Wenchuan strong earthquake, the spatio-temporal point pattern analysis method is employed to study the sequences of aflershocks with magnitude M≥4.0, M≥4.5, and M≥5.0. It is found that these data exhibit the spatio-temporal clustering on a certain distance scale and on a certain time scale. In particular, the space-time interaction obviously strengthens when the distance is less than 60 km and the time is less than 260 h for the first two aftershock sequences; however, it becomes strong when the distance scale is less than 80 km and the time scale is less than 150 h for the last aftershock sequence. The completely spatial randomness analysis on the data regardless of time component shows that the spatial clustering of the aftershocks gradually strengthens on the condition that the distance is less than 60 km. The results are valuable for exploring the occurrence rules of the Wenchuan strong earthquake and for predicting the aftershocks.

基于Point Transformer v2的点云枝叶分离方法研究

准确高效的点云枝叶分离对精确计算森林树木的垂直参数至关重要。然而,当前的研究方法计算成本高,且依赖先验知识导致泛化能力不足。针对以上问题,文章提出利用基于点特征的Transformer网络进行自动化的森林场景三维点云的枝叶分离研究。该方法使用Point Transformer v2网络,首先利用网格编码模块提取可学习的局部结构关系,保留点云的几何拓扑结构;其次使用分组注意力实现多通道联合学习,降低特征的冗余度,提高计算的效率;最后构建了基于点的Transformer网络实现高精度森林树木三维点云语义分割,降低了对于先验知识的需求。使用地基激光扫描仪获取的加拿大和芬兰7个不同树种样地的三维点云数据,进行枝叶分离实验和精度评价。实验结果表明,网络整体精度(OA)为94.42%,mIoU为78.89%,能够适应不同树种、不同点云密度的森林场景的枝叶分离。