Improved Weighted Local Contrast Method for Infrared Small Target Detection

In order to address the problem of high false alarm rate and low probabilities of infrared small target detection in complex low-altitude background,an infrared small target detection method based on improved weighted local contrast is proposed in this paper.First,the ratio information between the target and local background is utilized as an enhancement factor.The local contrast is calculated by incorporating the heterogeneity between the target and local background.Then,a local product weighted method is designed based on the spatial dissimilarity between target and background to further enhance target while suppressing background.Finally,the location of target is obtained by adaptive threshold segmentation.As experimental results demonstrate,the method shows superior performance in several evaluation metrics compared with six existing algorithms on different datasets containing targets such as unmanned aerial vehicles(UAV).

Infrared Small Target Detection Algorithm Based on ISTD-CenterNet

This paper proposes a real-time detection method to improve the Infrared small target detection CenterNet(ISTD-CenterNet)network for detecting small infrared targets in complex environments.The method eliminates the need for an anchor frame,addressing the issues of low accuracy and slow speed.HRNet is used as the framework for feature extraction,and an ECBAM attention module is added to each stage branch for intelligent identification of the positions of small targets and significant objects.A scale enhancement module is also added to obtain a high-level semantic representation and fine-resolution prediction map for the entire infrared image.Besides,an improved sensory field enhancement module is designed to leverage semantic information in low-resolution feature maps,and a convolutional attention mechanism module is used to increase network stability and convergence speed.Comparison experiments conducted on the infrared small target data set ESIRST.The experiments show that compared to the benchmark network CenterNet-HRNet,the proposed ISTD-CenterNet improves the recall by 22.85%and the detection accuracy by 13.36%.Compared to the state-of-the-art YOLOv5small,the ISTD-CenterNet recall is improved by 5.88%,the detection precision is improved by 2.33%,and the detection frame rate is 48.94 frames/sec,which realizes the accurate real-time detection of small infrared targets.

CAFUNeT:A small infrared target detection method in complex backgrounds

Small infrared target detection has widespread applications in various fields including military,aviation,and medicine.However,detecting small infrared targets in complex backgrounds remains challenging.To detect small infrared targets,we propose a variable-structure U-shaped network referred as CAFUNet.A central differential convolution-based encoder,ASPP,an Attention Fusion module,and a decoder module are the critical components of the CAFUNet.The encoder module based on central difference convolution effectively extracts shallow detail information from infrared images,complemented by rich contextual information obtained from the deep features in the decoder module.However,the direct fusion of the shallow detail features with semantic features may lead to feature mismatch.To address this,we incorporate an Attention Fusion(AF)module to enhance the network performance further.We performed ablation studies on each module to evaluate its effectiveness.The results show that our proposed algorithm outperforms the state-of-the-art methods on publicly available datasets.

Dim Moving Small Target Detection by Local and Global Variance Filtering on Temporal Profiles in Infrared Sequences

In this paper, the temporal different characteristics between the target and background pixels are used to detect dim moving targets in the slow-evolving complex background. A local and global variance filter on temporal profiles is presented that addresses the temporal characteristics of the target and background pixels to eliminate the large variation of background temporal profiles. Firstly, the temporal behaviors of different types of image pixels of practical infrared scenes are analyzed.Then, the new local and global variance filter is proposed. The baseline of the fluctuation level of background temporal profiles is obtained by using the local and global variance filter. The height of the target pulse signal is extracted by subtracting the baseline from the original temporal profiles. Finally, a new target detection criterion is designed. The proposed method is applied to detect dim and small targets in practical infrared sequence images. The experimental results show that the proposed algorithm has good detection performance for dim moving small targets in the complex background.

Infrared Image Small Target Detection Based on Bi-orthogonal Wavelet and Morphology

An image multi-scale edge detection method based on anti-symmetrical bi-orthogonal wavelet is given in theory. Convolution operation property and function as a differential operator are analyzed,which anti-symmetrical bi-orthogonal wavelet transform have. An algorithm for wavelet reconstruction in which multi-scale edge can be detected is put forward. Based on it, a detection method for small target in infrared image with sea or sky background based on the anti-symmetrical bi-orthogonal wavelet and morphology is proposed. The small target detection is considered as a process in which structural background is removed, correlative background is suppressed, and noise is restrained. In this approach, the multi-scale edge is extracted by means of the anti-symmetrical bi-orthogonal wavelet decomposition. Then, module maximum chains formed by complicated background of clouds, sea wave and sea-sky-line are removed, and the image background becomes smoother. Finally, the morphology based edge detection method is used to get small target and restrain undulate background and noise. Experiment results show that the approach can suppress clutter background and detect the small target effectively.

Novel detection method for infrared small targets using weighted information entropy

This paper presents a method for detecting the small infrared target under complex background. An algorithm, named local mutation weighted information entropy （LMWIE）, is proposed to suppress background. Then, the grey value of targets is enhanced by calculating the local energy. Image segmentation based on the adaptive threshold is used to solve the problems that the grey value of noise is enhanced with the grey value improvement of targets. Experimental results show that compared with the adaptive Butterworth high-pass filter method, the proposed algorithm is more effective and faster for the infrared small target detection.

Using deep learning to detect small targets in infrared oversampling images

According to the oversampling imaging characteristics, an infrared small target detection method based on deep learning is proposed. A 7-layer deep convolutional neural network(CNN) is designed to automatically extract small target features and suppress clutters in an end-to-end manner. The input of CNN is an original oversampling image while the output is a cluttersuppressed feature map. The CNN contains only convolution and non-linear operations, and the resolution of the output feature map is the same as that of the input image. The L1-norm loss function is used, and a mass of training data is generated to train the network effectively. Results show that compared with several baseline methods, the proposed method improves the signal clutter ratio gain and background suppression factor by 3–4 orders of magnitude, and has more powerful target detection performance.

Multi-Channel Based on Attention Network for Infrared Small Target Detection

Infrared detection technology has the advantages of all-weather detection and good concealment,which is widely used in long-distance target detection and tracking systems.However,the complex background,the strong noise,and the characteristics of small scale and weak intensity of targets bring great difficulties to the detection of infrared small targets.A multi-channel based on attention network is proposed in this paper,aimed at the problem of high missed detection rate and false alarm rate of traditional algorithms and the problem of large model,high complexity and poor detection performance of deep learning algorithms.First,given the difficulty in extracting the features of infrared multiscale and small dim targets,the multiple channels are designed based on dilated convolution to capture multiscale target features.Second,the coordinate attention block is incorporated in each channel to suppress background clutters adaptively and enhance target features.In addition,the fusion of shallow detail features and deep abstract semantic features is realized by synthesizing the contextual attention fusion block.Finally,it is verified that,compared with other state-of-the-art methods based on the datasets SIRST and MDFA,the proposed algorithm further improves the detection effect,and the model size and computational complexity are smaller.

基于跨越连接与融合注意力机制的红外弱小目标检测方法

针对复杂背景红外小弱目标信号弱、特征不明显、干扰虚警多等检测性能低问题,提出基于跨越连接与融合注意力机制的单阶段红外弱小目标检测算法。该方法融合注意力机制与残差网络提取小目标多特征,减少复杂背景干扰;双向跨越连接结构融合低层与高层各自的特征信息,凸显小弱目标特征表达能力;增加一个高分辨率检测层,重新聚类弱小目标先验框,增强目标与背景的特征差别学习能力;最后,建立真实目标和预测目标框的高斯分布模型,计算两者相似性,解决因IoU度量造成的目标损失回归偏差敏感问题,提升损失回归准确性。在公开红外小目标数据集上进行对比测试,实验结果表明该算法对多种复杂背景下红外小弱目标检测均取得了最佳性能,在平均精度和速度等方面都得到显著提升,模型最小,方便部署。

基于YOLOv5s的改进实时红外小目标检测

针对红外图像分辨率低、背景复杂、目标细节特征缺失等问题,提出了一种基于YOLOv5s的改进实时红外小目标检测模型Infrared-YOLOv5s。在特征提取阶段,采用SPD-Conv进行下采样,将特征图切分为特征子图并按通道拼接,避免了多尺度特征提取过程中下采样导致的特征丢失情况,设计了一种基于空洞卷积的改进空间金字塔池化模块,通过对具有不同感受野的特征进行融合来提高特征提取能力;在特征融合阶段,引入由深到浅的注意力模块,将深层特征语义特征嵌入到浅层空间特征中,增强浅层特征的表达能力;在预测阶段,裁减了网络中针对大目标检测的特征提取层、融合层及预测层,降低模型大小的同时提高了实时性。首先通过消融实验验证了提出各模块的有效性,实验结果表明,改进模型在SIRST数据集上平均精度均值达到了95.4%,较原始YOLOv5s提高了2.3%,且模型大小降低了72.9%,仅为4.5 M,在Nvidia Xavier上推理速度达到28 f/s,利于实际的部署和应用。在Infrared-PV数据集上的迁移实验进一步验证了改进算法的有效性。提出的改进模型在提高红外图像小目标检测性能的同时,能够满足实时性要求,因而适用于红外图像小目标实时检测任务。

基于全卷积网络的复杂背景红外弱小目标检测研究

针对复杂背景红外弱小目标检测过程中存在的检测误差率高,检测时间过长等问题,提出基于全卷积网络的复杂背景红外弱小目标检测方法。分析复杂背景红外弱小目标检测的研究进展,找出不同方法的缺陷,采集红外图像,提取目标检测特征,并采用全卷积网络设计弱小目标检测的分类器,实现复杂背景红外弱小目标检测。实验结果表明,该方法的复杂背景红外弱小目标检测精度超过97%,具有较高的实际应用价值。

HRformer:基于多级回归Transformer网络的红外小目标检测

红外小目标检测是指从低信噪比、复杂背景的红外图像中对小目标进行检测,在海上救援、交通管理等应用中具有重要实际意义。然而,由于图像分辨率低、目标尺寸小以及特征不突出等因素,导致红外目标很容易淹没在包含噪声和杂波的背景中,如何精确检测红外小目标的外形信息仍然是一个挑战。针对上述问题,构建了一种基于多级回归Transformer(HRformer)网络的红外小目标检测算法。具体来说,首先为了在获得多尺度信息的同时尽可能避免原始图像信息的损失,采用像素逆重组(PixelUnShuffle)操作对原始图像下采样来获取不同层级网络的输入,同时采用一种可学习的像素重组(PixelShuffle)操作对每一层级的输出特征图进行上采样,提升了网络的灵活性;接着,为实现网络中不同层级特征之间的信息交互,本文设计了一种包含空间注意力计算分支以及通道注意力计算分支在内的交叉注意力融合(cross attention fusion,CAF)模块实现特征高效融合以及信息互补;最后,为进一步提升网络的检测性能,结合普通Transformer结构具有较大感受野以及基于窗口的Transformer结构具有较少计算复杂度的优势,提出了一种局部-全局Transformer(LGT)结构,能够在提取局部上下文信息的同时对全局依赖关系进行建模,计算成本也得到节省。实验结果表明,与目前较为先进的一些红外小目标检测算法相比,本文所提出的算法具有更高的检测精度,同时具有较少的参数量,在解决实际问题中更有意义。

基于YOLOv5水下目标检测算法研究与改进

在水下目标生物的检测过程中,由于水下环境恶劣,水中光线衰弱,以及大多水下生物以小目标的形态出现等问题,使得目前的水下目标检测带来了精度损失问题,为解决相应问题,给出了一种基于YOLOv5s改进的YOLOv5s-water算法来解决。首先通过STR(Swin-Transformer)旋转窗口来对YOLOv5s的主干层(Backbone)部分进行更改,提高模型的泛化能力,进而解决水下环境恶劣以及检测目标形态变化带来的问题。使用FReLU激活函数与CBAM注意力神经机制结合成的FCM注意力机制,将其嵌入到YOLOv5s的骨干网(Neck)部分,以用来突出目标特征并抑制次要信息,从而提高算法精度,加强小目标的特征提取。小目标检测方面,在YOLOv5结构上增加小目标检测头,以提高感受野,进而提高小目标的检测精度。仿真和实验结果表明:所提方法相较于YOLOv5s检测准确率P上升1.47%,精确度mAP@0.5上升2.76%,小目标检测效果明显,证明了方法的有效性。

多尺度注意力特征增强融合的红外小目标检测新网络

为提高红外成像中小目标检测的性能,提高低空空域监管能力,提出一种基于多尺度注意力特征增强融合的红外小目标检测新网络。首先,使用Resnet34提取红外图像的多尺度特征;其次,使用多尺度空间注意力特征增强模块(MFEM)来提高特征提取能力;然后,在逐级上采样过程中使用双通道注意力特征融合模块(DFFM),融合语义信息和细节信息,以更好地保护红外小目标的特征;最后,与其他方法对比,并以地/空红外弱小飞机目标视频序列检测为例测试真实场景。结果表明:新方法与现有方法相比,交互比(IoU)、F值和漏检率(FNR)的评分均获得改进;通过多尺度注意力特征增强融合可准确地定位到目标并生成精细的分割结果;MFEM能够同时利用多尺度上下文信息和空间注意力机制来突出红外小目标;DFFM通过给不同通道特征的集合赋予权重,得到最合适的特征图进行特征融合,从而提高检测性能。

基于视觉Transformer和双解码器的红外小目标检测方法

当前基于卷积神经网络的红外小目标检测方法在编码器阶段受限于感受野,且解码器在多尺度特征融合中缺乏有效的特征交互。本文提出了一种基于编码器-解码器结构的新方法,针对现有红外小目标检测方法中的问题进行改进。该方法使用视觉Transformer作为编码器,能够有效地提取红外小目标图像的多尺度特征。视觉Transformer是一种新兴的深度学习架构,其通过自注意力机制捕捉图像中像素之间的全局关系,以处理长程依赖性和上下文信息。此外,本文还设计了一个由交互式解码器和辅助解码器组成的双解码器模块,旨在提高解码器对红外小目标的重构能力。该双解码器模块能够充分利用不同特征之间的互补信息,促进深层特征和浅层特征之间的交互,并通过将两个解码器的结果进行叠加,以更好地重构红外小目标。在广泛使用的公共数据集上的实验结果表明,本文提出的方法在F1和mIoU两个评价指标上的性能优于其他对比方法。

改进非凸估计与非对称时空正则化的红外小目标检测方法

针对复杂背景下的红外小目标检测,在非对称时空正则化约束的非凸张量低秩估计算法基础上,提出了一种新的核范数估计方法代替原算法中的估计方法。提出基于结构张量与多结构元顶帽(Top-Hat)滤波的自适应权重张量对目标张量进行约束,增强目标张量稀疏性的同时抑制其中残存的强边缘结构。实验结果表明,所提改进算法能够更好地消除图像中强边缘结构对检测结果的影响,在保证检测率的情况下,较原算法具有更低的虚警率。

A real-time detection and positioning method for small and weak targets using a 1D morphology-based approach in 2D images

A small and weak target detection method is proposed in this work that outperforms all other methods in terms of real-time capability.It is the first time that two-dimensional(2D)images are processed using only one-dimensional1D structuring elements in a morphology-based approach,enabling the real-time hardware implementation of the whole image processing method.A parallel image readout and processing structure is introduced to achieve an ultra-low latency time on the order of nanoseconds,and a hyper-frame resolution in the time domain can be achieved by combining the row-by-row structure and the electrical rolling shutter technique.Experimental results suggest that the expected target can be successfully detected under various interferences with an accuracy of 0.1 pixels(1σ)under the worst sky night test condition and that a centroiding precision of better than 0.03 pixels(1σ)can be reached for static tests.The real-time detection method with high robustness and accuracy is attractive for application to all types of real-time small target detection systems,such as medical imaging,infrared surveillance,and target measurement and tracking,where an ultra-high processing speed is required.

基于改进顶帽变换的红外弱小目标检测

天空背景下的红外弱小目标检测技术较为成熟,但在近地复杂背景下,红外弱小目标的检测存在准确率不高、虚警目标多、实时性差的问题。针对以上问题,该文提出一种基于改进顶帽变换的红外弱小目标检测算法(OTHOLCM)。该算法采用基于改进顶帽变换的图像预处理算法(OTH),通过对不同灰度值的图像采取不同的策略针对性地处理图像,达到目标增强、背景抑制的效果。并在此基础上,采用基于改进多尺度局部对比度的红外弱小目标检测算法(OLCM),通过针对目标尺寸特点进行尺度设计,使得在保证算法实时性的基础上扩大目标尺寸检测范围。实验证明:OTHOLCM算法可以保证实时性并明显提高目标检测准确率、减少虚警目标数量。与3层模板局部差异度量算法(TTLDM)、基于边角感知的时空张量模型(ECASTT)等先进算法相比,OTHOLCM算法可使真阳性率分别提高近79%,61%,假阳性率分别降低近77%,73%,目标检测速度达到每秒25帧。

一种多深度特征连接的红外弱小目标检测方法

针对红外弱小目标像元数量少、图像背景复杂、检测精度低且耗时较长的问题,文中提出了一种多深度特征连接的红外弱小目标检测模型(MFCNet)。首先,提出了多深度交叉连接主干形式以增加不同层间的特征传递,增强特征提取能力;其次,设计了注意力引导的金字塔结构对深层特征进行目标增强,分离背景与目标;提出非对称融合解码结构加强解码中纹理信息与位置信息保留;最后,引入点回归损失得到中心坐标。所提网络模型在SIRST公开数据集与自建长波红外弱小目标数据集上进行训练并测试,实验结果表明,与现有数据驱动和模型驱动算法相比,所提算法在复杂场景下具有更高的检测精度及更快的速度,模型的平均精度相比次优模型提升了5.41%,检测速度达到100.8 FPS。

基于扩张卷积条件生成对抗网络的红外小目标检测

基于深度神经网络的目标检测方法凭借自身强大的建模能力,在通用目标检测任务中取得了良好的表现。然而,在红外小目标信号弱、像素小的本质特征的影响下,深度神经网络层次的加深和池化操作的大量使用导致小目标语义信息丢失,使得现有方法的检测效果并不理想。文中从红外小目标特性这一关键问题出发,提出了一种新颖的基于扩张卷积条件生成对抗网络的目标检测算法。所提方法应用扩张卷积设计了生成网络,充分利用上下文信息建立层与层之间的关联,将红外小目标更多的语义信息保留到深层网络中,增强目标特征,进而提高检测性能。此外,设计了融合通道与空间维度的混合注意力模块,在特征提取时有选择性地放大目标信息,抑制背景信息;设计了自注意关联模块处理层与层之间信息融合过程中产生的语义冲突问题。文中使用多种评价指标将所提网络模型与目前先进的其他红外小目标检测方法进行对比,证明了该方法在复杂背景下目标检测性能的优越性。在公开的SIRST数据集上,所提模型的F分数为64.70%,相比传统方法提高了8.29%,相比深度学习方法提高了7.29%;在公开的ISOS数据集上,所提模型的F分数为64.54%,相比传统方法提高了23.59%,相比深度学习方法提高了6.58%。