Remote sensing image encryption algorithm based on novel hyperchaos and an elliptic curve cryptosystem

Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential.In this paper,a novel Fibonacci sine exponential map is designed,the hyperchaotic performance of which is particularly suitable for image encryption algorithms.An encryption algorithm tailored for handling the multi-band attributes of remote sensing images is proposed.The algorithm combines a three-dimensional synchronized scrambled diffusion operation with chaos to efficiently encrypt multiple images.Moreover,the keys are processed using an elliptic curve cryptosystem,eliminating the need for an additional channel to transmit the keys,thus enhancing security.Experimental results and algorithm analysis demonstrate that the algorithm offers strong security and high efficiency,making it suitable for remote sensing image encryption tasks.

Road Traffic Monitoring from Aerial Images Using Template Matching and Invariant Features

Road traffic monitoring is an imperative topic widely discussed among researchers.Systems used to monitor traffic frequently rely on cameras mounted on bridges or roadsides.However,aerial images provide the flexibility to use mobile platforms to detect the location and motion of the vehicle over a larger area.To this end,different models have shown the ability to recognize and track vehicles.However,these methods are not mature enough to produce accurate results in complex road scenes.Therefore,this paper presents an algorithm that combines state-of-the-art techniques for identifying and tracking vehicles in conjunction with image bursts.The extracted frames were converted to grayscale,followed by the application of a georeferencing algorithm to embed coordinate information into the images.The masking technique eliminated irrelevant data and reduced the computational cost of the overall monitoring system.Next,Sobel edge detection combined with Canny edge detection and Hough line transform has been applied for noise reduction.After preprocessing,the blob detection algorithm helped detect the vehicles.Vehicles of varying sizes have been detected by implementing a dynamic thresholding scheme.Detection was done on the first image of every burst.Then,to track vehicles,the model of each vehicle was made to find its matches in the succeeding images using the template matching algorithm.To further improve the tracking accuracy by incorporating motion information,Scale Invariant Feature Transform(SIFT)features have been used to find the best possible match among multiple matches.An accuracy rate of 87%for detection and 80%accuracy for tracking in the A1 Motorway Netherland dataset has been achieved.For the Vehicle Aerial Imaging from Drone(VAID)dataset,an accuracy rate of 86%for detection and 78%accuracy for tracking has been achieved.

Tree species classification using deep learning and RGB optical images obtained by an unmanned aerial vehicle

The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aerial vehicles(UAVs) provides a new research direction for urban tree species classification.We proposed an RGB optical image dataset with 10 urban tree species,termed TCC10,which is a benchmark for tree canopy classification(TCC).TCC10 dataset contains two types of data:tree canopy images with simple backgrounds and those with complex backgrounds.The objective was to examine the possibility of using deep learning methods(AlexNet,VGG-16,and ResNet-50) for individual tree species classification.The results of convolutional neural networks(CNNs) were compared with those of K-nearest neighbor(KNN) and BP neural network.Our results demonstrated:(1) ResNet-50 achieved an overall accuracy(OA) of 92.6% and a kappa coefficient of 0.91 for tree species classification on TCC10 and outperformed AlexNet and VGG-16.(2) The classification accuracy of KNN and BP neural network was less than70%,while the accuracy of CNNs was relatively higher.(3)The classification accuracy of tree canopy images with complex backgrounds was lower than that for images with simple backgrounds.For the deciduous tree species in TCC10,the classification accuracy of ResNet-50 was higher in summer than that in autumn.Therefore,the deep learning is effective for urban tree species classification using RGB optical images.

Seamless integration of above-and undercanopy unmanned aerial vehicle laser scanning for forest investigation

Background:Current automated forest investigation is facing a dilemma over how to achieve high tree-and plotlevel completeness while maintaining a high cost and labor efficiency.This study tackles the challenge by exploring a new concept that enables an efficient fusion of aerial and terrestrial perspectives for digitizing and characterizing individual trees in forests through an Unmanned Aerial Vehicle(UAV)that flies above and under canopies in a single operation.The advantage of such concept is that the aerial perspective from the above-canopy UAV and the terrestrial perspective from the under-canopy UAV can be seamlessly integrated in one flight,thus grants the access to simultaneous high completeness,high efficiency,and low cost.Results:In the experiment,an approximately 0.5 ha forest was covered in ca.10 min from takeoff to landing.The GNSS-IMU based positioning supports a geometric accuracy of the produced point cloud that is equivalent to that of the mobile mapping systems,which leads to a 2–4 cm RMSE of the diameter at the breast height estimates,and a 4–7 cm RMSE of the stem curve estimates.Conclusions:Results of the experiment suggested that the integrated flight is capable of combining the high completeness of upper canopies from the above-canopy perspective and the high completeness of stems from the terrestrial perspective.Thus,it is a solution to combine the advantages of the terrestrial static,the mobile,and the above-canopy UAV observations,which is a promising step forward to achieve a fully autonomous in situ forest inventory.Future studies should be aimed to further improve the platform positioning,and to automatize the UAV operation.

Heat transfer and temperature evolution in underground mininginduced overburden fracture and ground fissures: Optimal time window of UAV infrared monitoring

Heat transfer and temperature evolution in overburden fracture and ground fissures are one of the essential topics for the identification of ground fissures via unmanned aerial vehicle(UAV) infrared imager. In this study, discrete element software UDEC was employed to investigate the overburden fracture field under different mining conditions. Multiphysics software COMSOL were employed to investigate heat transfer and temperature evolution of overburden fracture and ground fissures under the influence of mining condition, fissure depth, fissure width, and month alternation. The UAV infrared field measurements also provided a calibration for numerical simulation. The results showed that for ground fissures connected to underground goaf(Fissure Ⅰ), the temperature difference increased with larger mining height and shallow buried depth. In addition, Fissure Ⅰ located in the boundary of the goaf have a greater temperature difference and is easier to be identified than fissures located above the mining goaf. For ground fissures having no connection to underground goaf(Fissure Ⅱ), the heat transfer is affected by the internal resistance of the overlying strata fracture when the depth of Fissure Ⅱ is greater than10 m, the temperature of Fissure Ⅱ gradually equals to the ground temperature as the fissures’ depth increases, and the fissures are difficult to be identified. The identification effect is most obvious for fissures larger than 16 cm under the same depth. In spring and summer, UAV infrared identification of mining fissures should be carried out during nighttime. This study provides the basis for the optimal time and season for the UAV infrared identification of different types of mining ground fissures.

Machine learning algorithm partially reconfigured on FPGA for an image edge detection system

Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for this process is to combine inertial navigation system sensor information with the global navigation satellite system(GNSS)signal.However,some factors can interfere with the GNSS signal,such as ionospheric scintillation,jamming,or spoofing.One alternative method to avoid using the GNSS signal is to apply an image processing approach by matching UAV images with georeferenced images.But a high effort is required for image edge extraction.Here a support vector regression(SVR)model is proposed to reduce this computational load and processing time.The dynamic partial reconfiguration(DPR)of part of the SVR datapath is implemented to accelerate the process,reduce the area,and analyze its granularity by increasing the grain size of the reconfigurable region.Results show that the implementation in hardware is 68 times faster than that in software.This architecture with DPR also facilitates the low power consumption of 4 mW,leading to a reduction of 57%than that without DPR.This is also the lowest power consumption in current machine learning hardware implementations.Besides,the circuitry area is 41 times smaller.SVR with Gaussian kernel shows a success rate of 99.18%and minimum square error of 0.0146 for testing with the planning trajectory.This system is useful for adaptive applications where the user/designer can modify/reconfigure the hardware layout during its application,thus contributing to lower power consumption,smaller hardware area,and shorter execution time.

Relationship between Vegetation Index and Forest Surface Fuel Load in UAV Multispectral Remote Sensing

[Objectives]To explore the relationship between vegetation index and forest surface fuel load.[Methods]UAV multispectral remote sensing was used to obtain large-scale forest images and obtain structural data of forest surface fuel load.This experimental area was located in Gaoming District,Foshan City,Guangdong Province.The average surface fuel load of the experimental area was as high as 39.33 t/ha,and the forest surface fuel load of Pinus elliottii was the highest.[Results]The normalized difference vegetation index(NDVI)and enhanced vegetation index(EVI)had a moderately strong correlation with the forest surface fuel load.The regression model of NDVI(X)and forest surface fuel load(Y)was established:Y=-5.9354X+8.4663,and the regression model of EVI(X)and forest surface fuel load(Y)was established:Y=-5.8485X+6.7271.The study also found that the linear relationship between NDVI and surface fuel load was more significant.[Conclusions]Both NDVI and EVI have moderately strong correlations with forest surface fuel load.NDVI is moderately or strongly correlated with the surface fuel load of Pinus massoniana forest,shrub grassland,broad-leaf forest and bamboo forest,while EVI is only strongly correlated with surface fuel load of broad-leaf forest and bamboo forest.It is expected that the relationship between other vegetation indices and forest surface fuel load can be obtained by the method in this study,so as to find a more universal vegetation index for calculating surface fuel load.

3D modeling of Unmanned Aerial Vehicles Tilt Photogrammetry

Unmanned Aerial Vehicles(UAV)tilt photogrammetry technology can quickly acquire image data in a short time.This technology has been widely used in all walks of life with the rapid development in recent years especially in the rapid acquisition of high-resolution remote sensing images,because of its advantages of high efficiency,reliability,low cost and high precision.Fully using the UAV tilt photogrammetry technology,the construction image progress can be observed by stages,and the construction site can be reasonably and optimally arranged through three-dimensional modeling to create a civilized,safe and tidy construction environment.

Online Multi-Object Tracking Under Moving Unmanned Aerial Vehicle Platform Based on Object Detection and Feature Extraction Network

In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion module is studied.Furthermore,a joint network of object detection and feature extraction is studied to construct a real-time multi-object tracking algorithm.For the problem of object association failure caused by UAV movement,image registration is applied to multi-object tracking and a camera motion discrimination model is proposed to improve the speed of the multi-object tracking algorithm.The simulation results show that the algorithm proposed in this study can improve the accuracy of multi-object tracking under the UAV platform,and effectively solve the problem of association failure caused by UAV movement.

Geometrical feature analysis and disaster assessment of the Xinmo landslide based on remote sensing data

At 5:39 am on June 24, 2017, a landslide occurred in the village of Xinmo in Maoxian County, Aba Tibet and Qiang Autonomous Prefecture(Sichuan Province, Southwest China). On June 25, aerial images were acquired from an unmanned aerial vehicle(UAV), and a digital elevation model(DEM) was processed. Landslide geometrical features were then analyzed. These are the front and rear edge elevation, accumulation area and horizontal sliding distance. Then, the volume and the spatial distribution of the thickness of the deposit were calculated from the difference between the DEM available before the landslide, and the UAV-derived DEM collected after the landslide. Also, the disaster was assessed using high-resolution satellite images acquired before the landslide. These include Quick Bird, Pleiades-1 and GF-2 images with spatial resolutions of 0.65 m, 0.70 m, and 0.80 m, respectively, and the aerial images acquired from the UAV after the landslide with a spatial resolution of 0.1 m. According to the analysis, the area of the landslide was 1.62 km2, and the volume of the landslide was 7.70 ± 1.46 million m3. The average thickness of the landslide accumulation was approximately 8 m. The landslide destroyed a total of 103 buildings. The area of destroyed farmlands was 2.53 ha, and the orchard area was reduced by 28.67 ha. A 2-km section of Songpinggou River was blocked and a 2.1-km section of township road No. 104 was buried. Constrained by the terrain conditions, densely populated and more economically developed areas in the upper reaches of the Minjiang River basin are mainly located in the bottom of the valleys. This is a dangerous area regarding landslide, debris flow and flash flood events Therefore, in mountainous, high-risk disaster areas, it is important to carefully select residential sites to avoid a large number of casualties.

Exploring Image Generation for UAV Change Detection

Change detection(CD)is becoming indispensable for unmanned aerial vehicles(UAVs),especially in the domain of water landing,rescue and search.However,even the most advanced models require large amounts of data for model training and testing.Therefore,sufficient labeled images with different imaging conditions are needed.Inspired by computer graphics,we present a cloning method to simulate inland-water scene and collect an auto-labeled simulated dataset.The simulated dataset consists of six challenges to test the effects of dynamic background,weather,and noise on change detection models.Then,we propose an image translation framework that translates simulated images to synthetic images.This framework uses shared parameters(encoder and generator)and 22×22 receptive fields(discriminator)to generate realistic synthetic images as model training sets.The experimental results indicate that:1)different imaging challenges affect the performance of change detection models;2)compared with simulated images,synthetic images can effectively improve the accuracy of supervised models.

Adaptive cropping shallow attention network for defect detection of bridge girder steel using unmanned aerial vehicle images

Bridges are an important part of railway infrastructure and need regular inspection and maintenance.Using unmanned aerial vehicle(UAV)technology to inspect railway infrastructure is an active research issue.However,due to the large size of UAV images,flight distance,and height changes,the object scale changes dramatically.At the same time,the elements of interest in railway bridges,such as bolts and corrosion,are small and dense objects,and the sample data set is seriously unbalanced,posing great challenges to the accurate detection of defects.In this paper,an adaptive cropping shallow attention network(ACSANet)is proposed,which includes an adaptive cropping strategy for large UAV images and a shallow attention network for small object detection in limited samples.To enhance the accuracy and generalization of the model,the shallow attention network model integrates a coordinate attention(CA)mechanism module and an alpha intersection over union(α-IOU)loss function,and then carries out defect detection on the bolts,steel surfaces,and railings of railway bridges.The test results show that the ACSANet model outperforms the YOLOv5s model using adaptive cropping strategy in terms of the total mAP(an evaluation index)and missing bolt mAP by 5%and 30%,respectively.Also,compared with the YOLOv5s model that adopts the common cropping strategy,the total mAP and missing bolt mAP are improved by 10%and 60%,respectively.Compared with the YOLOv5s model without any cropping strategy,the total mAP and missing bolt mAP are improved by 40%and 67%,respectively.

基于UAV-RS虚拟仿真系统的教学模式探究

针对无人机和遥感测绘(unmanned air vehicle for remote sensing,UAV-RS)相关专业在实际教学中存在的问题,如设备资源和实验时间无法满足学生需求,野外作业中无人机的安全难以管控,天气和环境条件要求苛刻等,以无人机遥感测绘外业为仿真对象,设计开发了虚拟仿真系统,改革实训教学模式。仿真系统确立了无人机飞行操控、地面场景模拟和遥感图像获取3个模块,引导学生自主完成无人机遥感测绘外业过程。评估实验中经过仿真系统学习的学生(实验组)的项目完成率为:初级90%、中级80%、高级75%,均明显高于对照组。表明基于仿真系统的教学模式可提升UAV-RS的外业教学效果,提高复杂项目完成率,并能够激发学生自主学习的积极性。

Intelligent Deep Data Analytics Based Remote Sensing Scene Classification Model

Latest advancements in the integration of camera sensors paves a way for newUnmannedAerialVehicles(UAVs)applications such as analyzing geographical(spatial)variations of earth science in mitigating harmful environmental impacts and climate change.UAVs have achieved significant attention as a remote sensing environment,which captures high-resolution images from different scenes such as land,forest fire,flooding threats,road collision,landslides,and so on to enhance data analysis and decision making.Dynamic scene classification has attracted much attention in the examination of earth data captured by UAVs.This paper proposes a new multi-modal fusion based earth data classification(MMF-EDC)model.The MMF-EDC technique aims to identify the patterns that exist in the earth data and classifies them into appropriate class labels.The MMF-EDC technique involves a fusion of histogram of gradients(HOG),local binary patterns(LBP),and residual network(ResNet)models.This fusion process integrates many feature vectors and an entropy based fusion process is carried out to enhance the classification performance.In addition,the quantum artificial flora optimization(QAFO)algorithm is applied as a hyperparameter optimization technique.The AFO algorithm is inspired by the reproduction and the migration of flora helps to decide the optimal parameters of the ResNet model namely learning rate,number of hidden layers,and their number of neurons.Besides,Variational Autoencoder(VAE)based classification model is applied to assign appropriate class labels for a useful set of feature vectors.The proposedMMF-EDCmodel has been tested using UCM and WHU-RS datasets.The proposed MMFEDC model attains exhibits promising classification results on the applied remote sensing images with the accuracy of 0.989 and 0.994 on the test UCM and WHU-RS dataset respectively.

Estimation and verification of green tide biomass based on UAV remote sensing

Since 2007,the Yellow Sea green tide has broken out every summer,causing great harm to the environment and society.Although satellite remote sensing(RS)has been used in biomass research,there are several shortcomings,such as mixed pixels,atmospheric interference,and difficult field validation.The biomass of green tide has been lacking a high-precision estimation method.In this study,high-resolution unmanned aerial vehicle(UAV)RS was used to quantitatively map the biomass of green tides.By utilizing experimental data from previous studies,a robust relationship was established to link biomass to the red-green-blue floating algae index(RGB-FAI).Then,the lab-based model for green tide biomass from visible images taken by the UAV camera was developed and validated by field measurements.Re sults show that the accurate and cost-effective method is able to estimate the green tide biomass and its changes in given local waters of the near and far seas.The study provided an effective complement to the traditional satellite RS,as well as high-precision quantitative techniques for decision-making in disaster management.

基于特征复用机制的航拍图像小目标检测算法

针对无人机(UAV)航拍图像检测存在的小目标检测精度低和模型参数量大的问题,提出轻量高效的航拍图像检测算法FS-YOLO.该算法以YOLOv8s为基准网络,通过降低通道维数和改进网络架构提出轻量的特征提取网络,实现对冗余特征信息的高效复用,在较少的参数量下产生更多特征图,提高模型对特征信息的提取和表达能力,同时显著减小模型大小.在特征融合阶段引入内容感知特征重组模块,加强对小目标显著语义信息的关注,提升网络对航拍图像的检测性能.使用无人机航拍数据集VisDrone进行实验验证,结果表明,所提算法以仅5.48 M的参数量实现了mAP0.5=47.0%的检测精度,比基准算法YOLOv8s的参数量降低了50.7%,精度提升了6.1%.在DIOR数据集上的实验表明,FS-YOLO的泛化能力较强,较其他先进算法更具竞争力.

基于时间序列植被指数的小麦条锈病抗性等级鉴定方法

条锈病严重影响小麦产量,培育抗条锈病的小麦品种至关重要。针对传统育种中抗性鉴定手段单一、效率低的问题,该研究提出了一种通过小麦冠层植被指数的时间序列实现对条锈病不同抗性等级的高效鉴定方法。该方法利用无人机采集自然发病的育种群体小麦(共600个样本,516个基因型)冠层多时相的光谱图像,使用随机蛙跳算法和ReliefF算法筛选出6个条锈病病害严重度的敏感特征:归一化色素叶绿素指数(normalized pigment chlorophyll index,NPCI)、沃尔贝克指数(woebbecke index,WI)、叶绿素红边指数(chlorophyll index rededge,CIrededge)、绿大气抵抗植被指数(green atmospherically resistant index,GARI)、归一化差分植被指数(normalized difference vi,NDVI)、叶绿素绿指数(chlorophyll index green,CIgreen),这些敏感特征在试验群体中的时间序列符合条锈病的发病规律,验证了其作为条锈病发病严重度敏感特征的有效性;基于支持向量机(support vector machine,SVM)算法使用上述敏感特征建立条锈病病害严重度等级分类模型,在测试集的表现中,与使用未经过筛选的原始特征所建立的模型相比在精度、平均准确率、平均召回率和F1分数上分别仅下降6.2%、3.3%、2.7%、4.0%,证明了所筛选敏感特征的有效性;针对一般机器学习算法难以捕捉不同抗性等级样本之间较小的特征变化差异的问题,提出了一种从植被指数时间序列转化生成的二维图像中提取特征实现条锈病抗性等级分类的方法。将敏感特征中能够较好区分不同抗病等级的4个时间序列植被指数(NPCI、GARI、NDVI、WI),通过格拉姆角场方法生成格拉姆角和场图像,并制作成数据集,使用DenseNet121网络进行训练,以实现不同条锈病抗病等级的分类。建立的条锈病抗性等级分类模型中,由NPCI时间序列图像建立的分类模型测试效果最佳,其准确率为0.837,召回率为0.834,F1分数可达0.833,能够较好地实现对群体小麦不同品种(系)的条锈病抗性等级差异的区分,表明基于光谱植被指数时间序列的小麦条锈病抗性等级识别方法可以用于小麦抗病育种中抗性等级的鉴定,并可为其他作物的病害抗性等级鉴定提供一定的参考。

基于通感融合的无人机预编码及飞行轨迹设计

无人机(UAVs)具有机动性强,低成本及易部署等特性,通过搭载通信及感知设备,支持通信与感知技术的高效资源共享,无人机可作为融合通信与传感技术的高性能空中平台。该文针对多输入多输出(MIMO)无人机使能的联合通信、感知场景,综合考虑无人机飞行能量、多天线传输及用户业务需求等限制条件,建模无人机通信、感知预编码及飞行轨迹联合优化问题为多目标优化问题,以实现通信用户最低速率最大化及目标最小发现概率最大化。由于通信用户最低速率最大化问题为非凸优化问题,难以直接求解,将原优化问题分解为通信预编码设计子问题及无人机轨迹设计子问题,并采用交替迭代法依次求解两个子问题直至算法收敛,其中,对于通信预编码设计子问题,提出一种基于迫零(ZF)算法的求解策略;对于无人机轨迹设计子问题,提出一种基于连续凸逼近(SCA)算法的求解策略。基于所得到的无人机最优轨迹,将无人机感知位置选择问题建模为加权距离和最小化问题,进而应用泛搜索算法优化确定目标感知位置,并设计基于ZF算法的通信感知预编码联合优化策略,以实现通信感知性能的联合优化。最后通过仿真验证了该文所提算法的有效性。

农田环境下无人机图像并行拼接识别算法

为改善在农田环境下无人机图像计算速度和效率,该研究提出了一种农田环境下无人机图像并行拼接识别算法。利用倒二叉树并行拼接识别算法,通过提取图像拼接中的变换矩阵,实现拼接识别同时进行。根据边缘设备的CPU核心数和图像数量自动将图像拼接识别任务划分为多个子进程,并分配到不同核心上执行,以提高在农田环境下的计算效率。试验结果表明:相同试验环境和数据集条件下,倒二叉树并行拼接算法的拼接耗时相较于其他算法平均减少了60%~90%左右;在农田环境下,倒二叉树并行拼接识别相较于串行拼接识别的耗时减少了70%,图像识别的平均像素交并比提升了10.17个百分点,说明在农田环境下采用多线程倒二叉树并行算法可以更好地利用农田环境下边缘设备的计算资源,大幅提升无人机图像的拼接和识别的速度,为无人机的快速实时监测提供技术支撑。

高阶深度可分离无人机图像小目标检测算法

当前无人机图像中存在小目标数量众多、背景复杂的特点,目标检测中易造成漏检误检率较高的问题,针对这些问题,提出一种高阶深度可分离无人机图像小目标检测算法.首先,结合CSPNet结构与ConvMixer网络,深度可分离卷积核,获取梯度结合信息,并引入递归门控卷积C3模块,提升模型的高阶空间交互能力,增强网络对小目标的敏感度;其次,检测头采用两个头部进行解耦,分别输出特征图分类和位置信息,加快模型收敛速度;最后,使用边框损失函数EIoU,提高检测框精准度.在VisDrone2019数据集上的实验结果表明,该模型检测精度达到了35.1%,模型漏检率和误检率有明显下降,能够有效地应用于无人机图像小目标检测任务.在DOTA 1.0数据集和HRSID数据集上进行模型泛化能力测试,实验结果表明,该模型具有良好的鲁棒性.