Road Traffic Monitoring from Aerial Images Using Template Matching and Invariant Features

Road traffic monitoring is an imperative topic widely discussed among researchers.Systems used to monitor traffic frequently rely on cameras mounted on bridges or roadsides.However,aerial images provide the flexibility to use mobile platforms to detect the location and motion of the vehicle over a larger area.To this end,different models have shown the ability to recognize and track vehicles.However,these methods are not mature enough to produce accurate results in complex road scenes.Therefore,this paper presents an algorithm that combines state-of-the-art techniques for identifying and tracking vehicles in conjunction with image bursts.The extracted frames were converted to grayscale,followed by the application of a georeferencing algorithm to embed coordinate information into the images.The masking technique eliminated irrelevant data and reduced the computational cost of the overall monitoring system.Next,Sobel edge detection combined with Canny edge detection and Hough line transform has been applied for noise reduction.After preprocessing,the blob detection algorithm helped detect the vehicles.Vehicles of varying sizes have been detected by implementing a dynamic thresholding scheme.Detection was done on the first image of every burst.Then,to track vehicles,the model of each vehicle was made to find its matches in the succeeding images using the template matching algorithm.To further improve the tracking accuracy by incorporating motion information,Scale Invariant Feature Transform(SIFT)features have been used to find the best possible match among multiple matches.An accuracy rate of 87%for detection and 80%accuracy for tracking in the A1 Motorway Netherland dataset has been achieved.For the Vehicle Aerial Imaging from Drone(VAID)dataset,an accuracy rate of 86%for detection and 78%accuracy for tracking has been achieved.

Enhancement Dataset for Low Altitude Unmanned Aerial Vehicle Detection

In recent years,the number of incidents involved with unmanned aerial vehicles(UAVs)has increased conspicuously,resulting in an increasingly urgent demand for developing anti-UAV systems. The vast requirements of high detection accuracy with respect to low altitude UAVs are put forward. In addition,the methods of UAV detection based on deep learning are of great potential in low altitude UAV detection. However,such methods need high-quality datasets to cope with the problem of high false alarm rate(FAR)and high missing alarm rate(MAR)in low altitude UAV detection,special high-quality low altitude UAV detection dataset is still lacking. A handful of known datasets for UAV detection have been rejected by their proposers for authorization and are of poor quality. In this paper,a comprehensive enhanced dataset containing UAVs and jamming objects is proposed. A large number of high-definition UAV images are obtained through real world shooting, web crawler, and data enhancement.Moreover,to cope with the challenge of low altitude UAV detection in complex backgrounds and long distance,as well as the puzzle caused by jamming objects,the noise with jamming characteristics is added to the dataset. Finally,the dataset is trained,validated,and tested by four mainstream deep learning models. The results indicate that by using data enhancement,adding noise contained jamming objects and images of UAV with complex backgrounds and long distance,the accuracy of UAV detection can be significantly improved. This work will promote the development of anti-UAV systems deeply,and more convincing evaluation criteria are provided for models optimization for UAV detection.

Small objects detection in UAV aerial images based on improved Faster R-CNN

In order to solve the problem of small objects detection in unmanned aerial vehicle(UAV)aerial images with complex background,a general detection method for multi-scale small objects based on Faster region-based convolutional neural network(Faster R-CNN)is proposed.The bird’s nest on the high-voltage tower is taken as the research object.Firstly,we use the improved convolutional neural network ResNet101 to extract object features,and then use multi-scale sliding windows to obtain the object region proposals on the convolution feature maps with different resolutions.Finally,a deconvolution operation is added to further enhance the selected feature map with higher resolution,and then it taken as a feature mapping layer of the region proposals passing to the object detection sub-network.The detection results of the bird’s nest in UAV aerial images show that the proposed method can precisely detect small objects in aerial images.

A cooperative detection game:UAV swarm vs.one fast intruder

This paper studies a special defense game using unmanned aerial vehicle(UAV)swarm against a fast intruder.The fast intruder applies an offensive strategy based on the artificial potential field method and Apollonius circle to scout a certain destination.As defenders,the UAVs are arranged into three layers:the forward layer,the midfield layer and the back layer.The co-defense mechanism,including the role derivation method of UAV swarm and a guidance law based on the co-defense front point,is introduced for UAV swarm to co-detect the intruder.Besides,five formations are designed for comparative analysis when ten UAVs are applied.Through Monte Carlo experiments and ablation experiment,the effectiveness of the proposed co-defense method has been verified.

A Novel Tensor Decomposition-Based Efficient Detector for Low-Altitude Aerial Objects With Knowledge Distillation Scheme

Unmanned aerial vehicles(UAVs) have gained significant attention in practical applications, especially the low-altitude aerial(LAA) object detection imposes stringent requirements on recognition accuracy and computational resources. In this paper, the LAA images-oriented tensor decomposition and knowledge distillation-based network(TDKD-Net) is proposed,where the TT-format TD(tensor decomposition) and equalweighted response-based KD(knowledge distillation) methods are designed to minimize redundant parameters while ensuring comparable performance. Moreover, some robust network structures are developed, including the small object detection head and the dual-domain attention mechanism, which enable the model to leverage the learned knowledge from small-scale targets and selectively focus on salient features. Considering the imbalance of bounding box regression samples and the inaccuracy of regression geometric factors, the focal and efficient IoU(intersection of union) loss with optimal transport assignment(F-EIoU-OTA)mechanism is proposed to improve the detection accuracy. The proposed TDKD-Net is comprehensively evaluated through extensive experiments, and the results have demonstrated the effectiveness and superiority of the developed methods in comparison to other advanced detection algorithms, which also present high generalization and strong robustness. As a resource-efficient precise network, the complex detection of small and occluded LAA objects is also well addressed by TDKD-Net, which provides useful insights on handling imbalanced issues and realizing domain adaptation.

Improved Weighted Local Contrast Method for Infrared Small Target Detection

In order to address the problem of high false alarm rate and low probabilities of infrared small target detection in complex low-altitude background,an infrared small target detection method based on improved weighted local contrast is proposed in this paper.First,the ratio information between the target and local background is utilized as an enhancement factor.The local contrast is calculated by incorporating the heterogeneity between the target and local background.Then,a local product weighted method is designed based on the spatial dissimilarity between target and background to further enhance target while suppressing background.Finally,the location of target is obtained by adaptive threshold segmentation.As experimental results demonstrate,the method shows superior performance in several evaluation metrics compared with six existing algorithms on different datasets containing targets such as unmanned aerial vehicles(UAV).

Machine learning algorithm partially reconfigured on FPGA for an image edge detection system

Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for this process is to combine inertial navigation system sensor information with the global navigation satellite system(GNSS)signal.However,some factors can interfere with the GNSS signal,such as ionospheric scintillation,jamming,or spoofing.One alternative method to avoid using the GNSS signal is to apply an image processing approach by matching UAV images with georeferenced images.But a high effort is required for image edge extraction.Here a support vector regression(SVR)model is proposed to reduce this computational load and processing time.The dynamic partial reconfiguration(DPR)of part of the SVR datapath is implemented to accelerate the process,reduce the area,and analyze its granularity by increasing the grain size of the reconfigurable region.Results show that the implementation in hardware is 68 times faster than that in software.This architecture with DPR also facilitates the low power consumption of 4 mW,leading to a reduction of 57%than that without DPR.This is also the lowest power consumption in current machine learning hardware implementations.Besides,the circuitry area is 41 times smaller.SVR with Gaussian kernel shows a success rate of 99.18%and minimum square error of 0.0146 for testing with the planning trajectory.This system is useful for adaptive applications where the user/designer can modify/reconfigure the hardware layout during its application,thus contributing to lower power consumption,smaller hardware area,and shorter execution time.

Analysis of Essential Meteorological Elements Surrounding Typhoon Sinlaku by Unmanned Aerial Vehicle

In this paper, a successful flight with an unmanned aerial vehicle (UAV) surrounded Typhoon Sinlaku on 15 Sept., 2008 and the preliminary analysis of all the collected data during the observation period has been presented. It is the first time to adopt surrounding method to observe typhoon in mainland of China. During the 3 h field campaign, the flight altitude is about 500 m to observe the essential meteorological elements in boundary layer of typhoon. The average temperature is 22.57&#176C and ranged from 21.50&#176C to 25.80&#176C, while about the relative humidity, the maximum is 100%, the minimum is 80.60% and the average is 97.98%. As for the wind, the average wind speed is 19.68 m/s and the maximum is 30.03 m/s. The typhoon center is a warm structure, the closer to the center, the higher the temperature is and the lower the wind speed is. In conclusion, the mini-UAV has the capability to observe the boundary layer of typhoon.

Exploring Image Generation for UAV Change Detection

Change detection(CD)is becoming indispensable for unmanned aerial vehicles(UAVs),especially in the domain of water landing,rescue and search.However,even the most advanced models require large amounts of data for model training and testing.Therefore,sufficient labeled images with different imaging conditions are needed.Inspired by computer graphics,we present a cloning method to simulate inland-water scene and collect an auto-labeled simulated dataset.The simulated dataset consists of six challenges to test the effects of dynamic background,weather,and noise on change detection models.Then,we propose an image translation framework that translates simulated images to synthetic images.This framework uses shared parameters(encoder and generator)and 22×22 receptive fields(discriminator)to generate realistic synthetic images as model training sets.The experimental results indicate that:1)different imaging challenges affect the performance of change detection models;2)compared with simulated images,synthetic images can effectively improve the accuracy of supervised models.

Safety Helmet Wearing Detection in Aerial Images Using Improved YOLOv4

In construction,it is important to check whether workers wear safety helmets in real time.We proposed using an unmanned aerial vehicle(UAV)to monitor construction workers in real time.As the small target of aerial photography poses challenges to safety-helmet-wearing detection,we proposed an improved YOLOv4 model to detect the helmet-wearing condition in aerial photography:(1)By increasing the dimension of the effective feature layer of the backbone network,the model’s receptive field is reduced,and the utilization rate of fine-grained features is improved.(2)By introducing the cross stage partial(CSP)structure into path aggregation network(PANet),the calculation amount of themodel is reduced,and the aggregation efficiency of effective features at different scales is improved.(3)The complexity of the YOLOv4 model is reduced by introducing group convolution and the pruning PANet multi-scale detection mode for de-redundancy.Experimental results show that the improved YOLOv4 model achieved the highest performance in the UAV helmet detection task,that the mean average precision(mAP)increased from83.67%of the original YOLOv4 model to 91.03%,and that the parameter amount of the model is reduced by 24.7%.The results prove that the improved YOLOv4 model can effectively respond to the requirements of real-time detection of helmet wearing by UAV aerial photography.

基于特征复用机制的航拍图像小目标检测算法

针对无人机(UAV)航拍图像检测存在的小目标检测精度低和模型参数量大的问题,提出轻量高效的航拍图像检测算法FS-YOLO.该算法以YOLOv8s为基准网络,通过降低通道维数和改进网络架构提出轻量的特征提取网络,实现对冗余特征信息的高效复用,在较少的参数量下产生更多特征图,提高模型对特征信息的提取和表达能力,同时显著减小模型大小.在特征融合阶段引入内容感知特征重组模块,加强对小目标显著语义信息的关注,提升网络对航拍图像的检测性能.使用无人机航拍数据集VisDrone进行实验验证,结果表明,所提算法以仅5.48 M的参数量实现了mAP0.5=47.0%的检测精度,比基准算法YOLOv8s的参数量降低了50.7%,精度提升了6.1%.在DIOR数据集上的实验表明,FS-YOLO的泛化能力较强,较其他先进算法更具竞争力.

改进YOLOv8的轻量化无人机目标检测算法

针对无人机目标检测算法计算复杂难以部署,且长尾分布的无人机数据导致检测精度较低的问题,提出了基于改进YOLOv8的轻量化无人机目标检测算法(PC-YOLOv8-n),可均衡网络检测精度与计算量,并对长尾分布数据有一定泛化能力。使用部分卷积层(PConv)替换YOLOv8中的3×3卷积层,对网络进行轻量化处理,解决网络冗余和计算量复杂的问题;融合双通道特征金字塔,增加自上而下的路径,将深层信息与浅层信息进行融合,同层引入轻量化注意力机制,提升网络的特征提取能力;采用均衡焦点损失(EFL)作为类别损失函数,通过均衡尾部类别在网络训练时的梯度权重,增加网络的类别检测能力。实验结果表明,PC-YOLOv8-n在VisDrone2019数据集中具有良好的表现,在mAP50精度上比原始YOLOv8-n算法提高了1.6个百分点,同时模型的参数和计算量分别降低为2.6×10^(6)和7.6 GFLOPs,检测速度达到77.2 FPS。

基于上下文信息与特征细化的无人机小目标检测算法

无人机航拍图像中的目标检测是近年来研究的热点,针对无人机视角下目标小而密集、背景复杂导致检测精度低的问题,提出一种基于上下文信息与特征细化的无人机小目标检测算法。通过上下文特征增强模块,利用多尺度扩张卷积捕获与周围区域像素点的潜在关系,为网络补充上下文信息,并根据不同尺度的特征层自适应生成各层级特征图的输出权重,动态优化特征图表达能力;由于不同特征图细粒度不同,使用特征细化模块来抑制特征融合中冲突信息的干扰,防止小目标特征淹没在冲突信息中;设计了一种带权重的损失函数,加快模型收敛速度,进一步提高小目标检测精度。在VisDrone2021数据集进行大量实验表明,改进后的模型较基准模型mAP50提高8.4个百分点,mAP50:95提高5.9个百分点,FPS为42,有效提高了无人机航拍图像中小目标的检测精度。

高阶深度可分离无人机图像小目标检测算法

当前无人机图像中存在小目标数量众多、背景复杂的特点,目标检测中易造成漏检误检率较高的问题,针对这些问题,提出一种高阶深度可分离无人机图像小目标检测算法.首先,结合CSPNet结构与ConvMixer网络,深度可分离卷积核,获取梯度结合信息,并引入递归门控卷积C3模块,提升模型的高阶空间交互能力,增强网络对小目标的敏感度;其次,检测头采用两个头部进行解耦,分别输出特征图分类和位置信息,加快模型收敛速度;最后,使用边框损失函数EIoU,提高检测框精准度.在VisDrone2019数据集上的实验结果表明,该模型检测精度达到了35.1%,模型漏检率和误检率有明显下降,能够有效地应用于无人机图像小目标检测任务.在DOTA 1.0数据集和HRSID数据集上进行模型泛化能力测试,实验结果表明,该模型具有良好的鲁棒性.

微多普勒辅助的城市环境无人机编队检测方法

针对城市复杂环境下电磁环境复杂、多径杂波和干扰信号密集等现象,传统的无人机(UAV)检测方法通过获取回波信号提取目标多普勒信息进行检测,易受到环境影响导致检测效果不理想。该文提出微多普勒辅助的城市环境无人机编队检测方法,充分利用无人机的微动特征,能够在复杂环境下提高检测精度。首先,参数化建模表征城市复杂环境下无人机旋翼的雷达回波微多普勒信号,利用YOLOv5s检测微多普勒闪烁脉冲,有效提取位置信息;然后,引入雷达信号分选方法的脉冲重复间隔(PRI)变换,分类获得无人机编队数量;最后,利用Kmeans算法验证无人机编队检测方法的准确性。结果表明,所提方法在信噪比2 dB时7架无人机的检测精度高于90%,能够用于城市复杂环境存在干扰脉冲、多径效应、局部脉冲丢失的无人机编队检测。

基于杂波拖尾分布的雷达无人机检测性能分析

固定翼无人机(unmanned aerial vehicle,UAV)给雷达低空监视提出了严峻挑战。分析雷达对固定翼UAV的检测性能,可为雷达UAV检测能力评估和技术升级提供重要参考。本文结合雷达探测低空固定翼UAV外场实测数据,首先分析了低空固定翼UAV雷达接收信号幅度统计分布,采用多项式对杂波拖尾导致的虚警概率进行拟合建模;然后,根据虚警概率分布得到雷达检测门限;进而根据UAV回波+杂波幅度分布理论推导得到雷达检测概率;最后,将理论分析性能与传统性能分析结果、雷达实际检测性能进行对比。结果表明,采用多项式对杂波拖尾导致的虚警概率进行单独建模,由此获得的雷达检测门限精度更高,从而使雷达UAV检测性能分析结果较传统性能分析结果更准确。

基于深度学习的无人机检测和识别研究综述

近年来,由于在各行各业发挥了不可替代作用,无人机产业和应用得到了迅速发展。然而,无人机的“黑飞”、携带危险物品等事件频繁发生,对社会安全构成了严重威胁。因此,无人机的检测和识别变得尤为迫切和必要。随着无人机类型不断地变化,传统的检测与识别方法已不再适应当前需求。深度学习技术的快速发展为无人机检测与识别提供了一种高效且准确的解决方案。深度学习模型具备自主学习特征的能力,能够从大规模数据中提取高级特征,并且在无人机检测与识别任务中表现出色。该模型不仅能够显著提高准确性,还能够适应各种复杂环境和无人机类型。对此,本文综述了基于深度学习的无人机检测与识别技术的最新进展,主要包括基于深度学习的无人机视觉检测和识别、基于深度学习的无人机音频检测和识别、基于深度学习的无人机雷达检测和识别以及基于深度学习的无人机射频检测和识别。最后,对目前无人机检测和识别现存问题进行分析,并展望了未来研究方向。

基于微型激光雷达的无人机智能化电力线路巡检技术研究

介绍了一种利用激光探测和测距(LiDAR)进行实时电力线检测的算法,并且对微型激光雷达无人机进行电力线路巡检抽象建模。通过使用平面分析法对巡检现场进行距离的比较来分割点云,并提取一组电力线候选点,这些点被拟合到线段上,线段根据它们的共线性质进一步分组比较。该方法可利用图像的共线特性完成特征检验,并在光线条件差以及线路背景复杂的环境下仍可获得较为可靠的巡检结果。案例中电力线路垂直平均误差最大为0.49 m,其他所有直线的估计平均误差都小于0.07 m,水平拟合时,所有平均误差都在0.14 m以内。验证了所提出基于微型激光雷达的无人机技术进行电力线路智能化巡检方法的有效性与可行性。

利用无人机有源标定仪开展天气雷达远场标定试验

文章针对天气雷达缺乏远场标定能力的现状,提出利用无人机有源标定仪开展天气雷达远场标定的方案。通过给出无人机有源标定仪开展天气雷达远场标定试验的测试项目与条件,完成了对雷达天线、发射通道和接收通道的标定测试,试验结果符合相关技术要求。后期将对标定仪做进一步改进和完善,以期更好地满足雷达标定业务需要。

城市森林结构多样性预测冠下地面温度的潜力研究

城市森林冠层具有调控城市森林微气候的能力,但现有研究尚未阐明冠层结构对冠下地面温度的影响及其预测潜力。文章基于无人机机载激光雷达(UAV-LiDAR)提取哈尔滨林业示范基地的城市森林冠层结构多样性特征指标,探究单一结构多样性特征对冠下地面温度的影响,以及结构多样性多因子组合对温度的预测潜力。结果表明:1)城市森林结构多样性的8个特征因子与冠下地面温度呈显著相关关系(P<0.05),其中深间隙(DG)、深间隙分数(DGF)、覆盖分数(CF)、间隙分数分布(GFP)表征了结构多样性的覆盖/开放度特征;冠层高度标准差(H_(std))、冠层高度最大值(H_(max))、95%分位点高度(ZQ_(95))表征了高度特征;垂直复杂指数(VCI)表征了异质性特征。2)城市森林冠层结构多样性的覆盖/开放度特征对冠下地面温度的响应更强(R^(2)为0.15~0.5),强于高度指标(R^(2)为0.14~0.19)以及异质性指标(R^(2)=0.14)。3)结合高度指标、覆盖/开放度指标以及异质性指标的多因子预测模型2(R^(2)=0.61,RMSE=0.51,MSE=0.26,AIC=62.74),对于冠下地面温度的预测性能更优。研究明晰了城市森林结构多样性的多因子变量及其特征组合预测冠下地面温度的潜力,为城市森林冠层结构调控内部小气候环境研究提供了科学参考。