IMTNet:Improved Multi-Task Copy-Move Forgery Detection Network with Feature Decoupling and Multi-Feature Pyramid

Copy-Move Forgery Detection(CMFD)is a technique that is designed to identify image tampering and locate suspicious areas.However,the practicality of the CMFD is impeded by the scarcity of datasets,inadequate quality and quantity,and a narrow range of applicable tasks.These limitations significantly restrict the capacity and applicability of CMFD.To overcome the limitations of existing methods,a novel solution called IMTNet is proposed for CMFD by employing a feature decoupling approach.Firstly,this study formulates the objective task and network relationship as an optimization problem using transfer learning.Furthermore,it thoroughly discusses and analyzes the relationship between CMFD and deep network architecture by employing ResNet-50 during the optimization solving phase.Secondly,a quantitative comparison between fine-tuning and feature decoupling is conducted to evaluate the degree of similarity between the image classification and CMFD domains by the enhanced ResNet-50.Finally,suspicious regions are localized using a feature pyramid network with bottom-up path augmentation.Experimental results demonstrate that IMTNet achieves faster convergence,shorter training times,and favorable generalization performance compared to existingmethods.Moreover,it is shown that IMTNet significantly outperforms fine-tuning based approaches in terms of accuracy and F_(1).

Two-Layer Attention Feature Pyramid Network for Small Object Detection

Effective small object detection is crucial in various applications including urban intelligent transportation and pedestrian detection.However,small objects are difficult to detect accurately because they contain less information.Many current methods,particularly those based on Feature Pyramid Network(FPN),address this challenge by leveraging multi-scale feature fusion.However,existing FPN-based methods often suffer from inadequate feature fusion due to varying resolutions across different layers,leading to suboptimal small object detection.To address this problem,we propose the Two-layerAttention Feature Pyramid Network(TA-FPN),featuring two key modules:the Two-layer Attention Module(TAM)and the Small Object Detail Enhancement Module(SODEM).TAM uses the attention module to make the network more focused on the semantic information of the object and fuse it to the lower layer,so that each layer contains similar semantic information,to alleviate the problem of small object information being submerged due to semantic gaps between different layers.At the same time,SODEM is introduced to strengthen the local features of the object,suppress background noise,enhance the information details of the small object,and fuse the enhanced features to other feature layers to ensure that each layer is rich in small object information,to improve small object detection accuracy.Our extensive experiments on challenging datasets such as Microsoft Common Objects inContext(MSCOCO)and Pattern Analysis Statistical Modelling and Computational Learning,Visual Object Classes(PASCAL VOC)demonstrate the validity of the proposedmethod.Experimental results show a significant improvement in small object detection accuracy compared to state-of-theart detectors.

改进ResNet50和FPN的多尺度目标检测算法研究

针对ResNet50和FPN结构无法将浅层的细节信息和深层的语义信息充分融合利用等问题,提出了一种改进ResNet50和FPN结构的算法,在ResNet50网络结构不同层次中引入了改进的通道和空间注意力模块,充分利用不同特征层的细节信息和语义信息。此外,在FPN结构中,为了能让浅层特征层更好的利用深层特征层的语义信息,在FPN自上而下的路径中,不同特征层之间增加了旁路来加强特征的重用。实验结果表明,在MS COCO数据集训练以后在PASCAL VOC 2012测试的均值平均精度(mAP)达到了83.2%,提升了2.7%,在MS COCO数据集上的mAP提升了1.5%,具有不错的检测性能。

基于L-FPN的无人机上小目标识别模型轻量化方法

由于遥感图像拍摄的高度和设备不同导致每张图像的地面采样间隔(GSD)也不同,许多小目标往往易被忽略,遥感图像中旋转框目标检测成为当下研究热点。现有的旋转框检测算法主要面向通用场景下的多尺度目标检测,特征金字塔中特征融合计算操作复杂且耗时,部署到无人机上的边缘端设备时面临很大的挑战。因此本文针对该场景下的小目标检测提出基于L-FPN的无人机上小目标识别模型轻量化方法,首先依据图像的GSD信息进行尺度归一化,然后去除特征金字塔中冗余的高层特征图,最后针对小目标检测调整锚框的尺寸。本方法在DOTA数据集上进行训练验证,结果表明本文提出的基于L-FPN的无人机上小目标识别模型轻量化方法在识别精度与传统模型一致的情况下,模型参数量较原模型减少2.7%,模型大小减少28%,推理速度提升13.24%。

基于LWKConv-DRSN-FPN的旋转机械故障诊断

针对传统旋转机械故障诊断方法难以应对强噪声干扰以及诊断准确率较低的问题,提出一种Laplace小波核卷积层(Laplace Wavelet Kernel Convolutional Layer,LWKConv)、深度残差收缩网络(Deep Residual Shrinkage Networks,DRSN)和特征金字塔网络(Feature Pyramid Networks,FPN)相结合的故障诊断方法。具体地,在DRSN模型结构基础上,构造LWKConv,通过更新尺度因子和平移因子,多尺度提取故障引起的突变冲击特征;引入FPN融合深层和浅层特征,提高模型对浅层细节信息的利用程度,实现对旋转机械的故障诊断。研究表明:所提的LWKConv-DRSN-FPN方法基于轴承和齿轮数据集的诊断准确率最高能达到100%,尤其在-4 dB强噪声干扰条件下的诊断准确率达到97.75%,能有效提取突变冲击特征,具有较好的通用性和抗强噪声干扰能力。

改进Faster RCNN with FPN的素布瑕疵检测的算法研究

纺织行业中的布匹检测仍存在采用人工检测的情况,人工检测效果受工人主观影响较大,易发生检测效率的降低和瑕疵的漏检误检。针对这种现状,探究素布瑕疵检测的算法,改进Faster RCNNwith FPN目标检测算法。首先,为了提升Faster RCNNwithFPN对于多尺度特征的融合能力,丰富各个特征层的上下文信息,引入跨尺度特征融合模块来改进特征金字塔网络结构。其次,为了更好的利用深层特征,加入尺度内特征交互模块来处理ResNet50输出的深层特征层,丰富高级特征层的语义信息。然后,为了增强对于极端尺寸瑕疵目标的检测能力,使用K-means++聚类和遗传算法,改进预设锚框。最后,由于素布瑕疵的尺寸较小,为了平衡正负样本,采用Focal Loss,增加对于素布瑕疵的检测效果。经过实验,使用COCO指标进行评价,该改进后的网络模型与Faster RCNNwithFPN相比,在mAP_(50)、mAP_(75)和mAP_(50:95)指标上分别提升6.5%、4.4%和4.0%,平均准确率有了明显提升,可以更好地完成素布瑕疵的检测任务。

基于FP-Growth算法的运毒嫌疑车辆智能推荐研究

毒品运输是毒品犯罪的重要环节,虽然毒品运输的手段越来越多样化,但公路运输仍然是主要的运输方式之一,而运毒人员有着各自经典的运毒模式。文中对运毒模式进行特征挖掘,发现存在前后车伴随的规律,根据实际业务中前后车行为以半小时为时间间隔导向,建模时选择PostgreSQL数据库。在数据库中建立过往车辆前半小时中间表、后半小时中间表、中间跨度表,运用人工智能数据挖掘技术实现从大量的通行车辆中抽取车辆伴随信息,采用FP-Growth算法挖掘频繁项集,查找高频出现车牌号,通过设定阈值并找到对应的关联规则,经过缉毒民警提供的黑名单进行过滤并排序,最后进行车辆嫌疑度的推荐,为民警拦截嫌疑车辆提供支持,能够在一定程度上提高对嫌疑车辆排查的针对性、准确性和有效性。

改进损失函数的增强型FPN水下小目标检测

针对水下小目标因携带特征信息少、定位不精准而导致检测精度低的问题,提出一种特征金字塔网络(FPN).首先,在FPN上采样过程中加入协同非局部注意力模块,利用卷积、横纵向池化挖掘特征图的静态和动态上下文信息;其次,在FPN通道调整过程中加入三叉戟特征增强模块,利用并行空洞卷积与高效通道注意力(ECANet)捕捉多尺度空间与通道特征信息;最后,在FasterR-CNN算法的回归损失函数中引入线性回归损失增益系数,增大对多尺度目标回归偏移量的惩罚,提高定位精度.实验结果表明,采用2020年全国水下目标检测大赛提供的数据集、PASCALVOC数据集和MSCOCO数据集进行实验,该算法比基线FasterR-CNN算法精度分别提升2.8%,2.2%和2.5%,结果证明了其有效性.

高频增强网络与FPN融合的水下目标检测

针对水下目标检测中目标对比度低以及水下图像多尺度问题,提出了高频增强网络与特征金字塔(FPN)融合的水下目标检测算法,以提高对水下目标边缘、轮廓信息以及目标底层信息的提取。首先引入八度卷积将卷积层的输出特征按频率分解,将主干网络提取到的特征图进行高、低频信息分离,鉴于水下目标的轮廓信息和噪声信息均包含于高频特征中,在高频信息通道中引入通道信息具有自适应增强特点的通道注意力机制,形成了一种高频增强卷积,以达到增强有用轮廓特征信息和抑制噪声的目的;其次,将增强的高频特征分量融入FPN的浅层网络中,提高原FPN对水下多尺度目标的特征表示能力,缓解多尺度目标漏检问题。最后,将所提方法与基线算法Faster R-CNN融合,在全国水下机器人大赛提供的数据集中进行实验。结果表明:改进算法识别准确率达到78.83%,相比基线提升2.61%,与其他类型目标检测算法相比,依然具备精度和实时检测优势,证明了从特征图频域角度提升前景和背景对比度的有效性。

基于YOLOX融合自注意力机制的FSA-FPN重构方法

随着目前目标检测任务输入图像分辨率的不断增大,在特征提取网络的感受野不变的情况下,网络提取的特征信息会越来越局限,相邻特征点之间的信息重合度也会越来越高。提出一种FSA(Fusion Self-Attention)-FPN,设计SAU(Self-Attention Upsample)模块,SAU内部结构通过CNN与自注意力机制(Self-Attention)进行交叉计算以进一步进行特征融合,并通过重构FCU(Feature Coupling Unit)消除二者之间的特征错位,弥补语义差距。以YOLOX-Darknet53为主干网络,在Pascal VOC2007数据集上进行了对比实验。实验结果表明,对比原网络的FPN,替换FSA-FPN后的平均精度值m AP@[.5:.95]提升了1.5%,预测框的位置也更为精准,在需要更高精度的检测场景下有更为出色的使用价值。

结合Graph-FPN与稳健优化的开放世界目标检测

开放世界目标检测(OWOD)要求检测图像中所有已知和未知的目标类别,同时模型必须逐步学习新的类别以自适应更新知识。针对ORE方法存在的未知目标召回率低以及增量学习的灾难性遗忘等问题,提出一种基于图特征金字塔的稳健优化开放世界目标检测方法(GARO-ORE)。首先,利用Graph-FPN中的超像素图像结构以及上下文层和层次层的分层设计,获取丰富的语义信息并帮助模型准确定位未知目标;之后,利用稳健优化方法对不确定性综合考量,提出了基于平坦极小值的基类学习策略,极大限度地保证模型在学习新类别的同时避免遗忘先前学习到的类别知识;最后,采用基于知识迁移的新增类别权值初始化方法提高模型对新类别的适应性。在OWOD数据集上的实验结果表明,GARO-ORE在未知类别召回率上取得较优的检测结果,在10+10、15+5、19+1三种增量目标检测(iOD)任务中,其mAP指标分别提升了1.38、1.42和1.44个百分点。可以看出,GARO-ORE能够较好地提高未知目标检测的召回率,并且在有效缓解旧任务灾难性遗忘问题的同时促进后续任务的学习。

Multi-scale object detection by top-down and bottom-up feature pyramid network

While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection of objects with multiple aspect ratios and scales is still a key problem. This paper proposes a top-down and bottom-up feature pyramid network(TDBU-FPN),which combines multi-scale feature representation and anchor generation at multiple aspect ratios. First, in order to build the multi-scale feature map, this paper puts a number of fully convolutional layers after the backbone. Second, to link neighboring feature maps, top-down and bottom-up flows are adopted to introduce context information via top-down flow and supplement suboriginal information via bottom-up flow. The top-down flow refers to the deconvolution procedure, and the bottom-up flow refers to the pooling procedure. Third, the problem of adapting different object aspect ratios is tackled via many anchor shapes with different aspect ratios on each multi-scale feature map. The proposed method is evaluated on the pattern analysis, statistical modeling and computational learning visual object classes(PASCAL VOC)dataset and reaches an accuracy of 79%, which exhibits a 1.8% improvement with a detection speed of 23 fps.

Bidirectional parallel multi-branch convolution feature pyramid network for target detection in aerial images of swarm UAVs

In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.

Dual Attention Based Feature Pyramid Network

Object detection could be recognized as an essential part of the research to scenarios such as automatic driving and pedestrian detection, etc. Among multiple types of target objects, the identification of small-scale objects faces significant challenges. We would introduce a new feature pyramid framework called Dual Attention based Feature Pyramid Network(DAFPN), which is designed to avoid predicament about multi-scale object recognition. In DAFPN, the attention mechanism is introduced by calculating the topdown pathway and lateral pathway, where the spatial attention, as well as channel attention, would participate, respectively, such that the pyramidal feature maps can be generated with enhanced spatial and channel interdependencies, which bring more semantical information for the feature pyramid. Using the COCO data set, which consists of a considerable quantity of small-scale objects, the experiments are implemented. The analysis results verify the optimized performance of DAFPN compared with the original Feature Pyramid Network(FPN) specifically for the identification on a small scale. The proposed DAFPN is promising for object detection in an era full of intelligent machines that need to detect multi-scale objects.

Neighborhood fusion-based hierarchical parallel feature pyramid network for object detection

In order to improve the detection accuracy of small objects,a neighborhood fusion-based hierarchical parallel feature pyramid network(NFPN)is proposed.Unlike the layer-by-layer structure adopted in the feature pyramid network(FPN)and deconvolutional single shot detector(DSSD),where the bottom layer of the feature pyramid network relies on the top layer,NFPN builds the feature pyramid network with no connections between the upper and lower layers.That is,it only fuses shallow features on similar scales.NFPN is highly portable and can be embedded in many models to further boost performance.Extensive experiments on PASCAL VOC 2007,2012,and COCO datasets demonstrate that the NFPN-based SSD without intricate tricks can exceed the DSSD model in terms of detection accuracy and inference speed,especially for small objects,e.g.,4%to 5%higher mAP(mean average precision)than SSD,and 2%to 3%higher mAP than DSSD.On VOC 2007 test set,the NFPN-based SSD with 300×300 input reaches 79.4%mAP at 34.6 frame/s,and the mAP can raise to 82.9%after using the multi-scale testing strategy.

An Improved Data-Driven Topology Optimization Method Using Feature Pyramid Networks with Physical Constraints

Deep learning for topology optimization has been extensively studied to reduce the cost of calculation in recent years.However,the loss function of the above method is mainly based on pixel-wise errors from the image perspective,which cannot embed the physical knowledge of topology optimization.Therefore,this paper presents an improved deep learning model to alleviate the above difficulty effectively.The feature pyramid network(FPN),a kind of deep learning model,is trained to learn the inherent physical law of topology optimization itself,of which the loss function is composed of pixel-wise errors and physical constraints.Since the calculation of physical constraints requires finite element analysis(FEA)with high calculating costs,the strategy of adjusting the time when physical constraints are added is proposed to achieve the balance between the training cost and the training effect.Then,two classical topology optimization problems are investigated to verify the effectiveness of the proposed method.The results show that the developed model using a small number of samples can quickly obtain the optimization structure without any iteration,which has not only high pixel-wise accuracy but also good physical performance.

基于CA-BIFPN的交通标志检测模型

正确、快速的交通标志检测可为自动驾驶领域的环境感知提供重要信息.针对目前交通标志检测识别率低及多种交通标志检测存在的误检漏检等问题,提出一种协调注意力-双向特征金字塔网络(coordinate attention-bidirectional feature pyramid network,CA-BIFPN)交通标志检测模型.该模型将YOLOv5(you only look once version 5)模型和协调注意力(coordinate attention,CA)机制相结合,引入双向特征金字塔网络(bidirectional feature pyramid network,BIFPN),通过跳连特征融合提高模型的多尺度语义特征利用效率,在提高小目标物体检测效率的同时,也使交通标志的检测精度得到提高.以交通标志数据集TT100K为测试对象进行实验验证,结果表明,与SSD(single shot multibox detector)模型和YOLOv5模型相比,CABIFPN交通标志检测模型的检测准确率分别提高4.5%和1.3%,验证模型有效.

基于CR-RFPR101的钢板表面缺陷检测

针对钢板表面缺陷种类多、背景复杂、检测精度低等问题,文章首先对钢板表面缺陷数据集进行数据增强,并对原始Cascade区域卷积神经网络(region-basedconvolutional neural netwroks,R-CNN)算法进行改进,将ResNeXt-101-64×4d作为Cascade R-CNN算法的骨干网络,优化特征提取模块,利用递归特征金字塔(recursive feature pyramid,RFP)网络以反馈连接的方式进行特征优化,提出一种CR-RFPR101(Cascade R-CNN RFP ResNeXt-101-64×4d)的检测算法,以更好地保留细节和语义信息;同时使用可切换的空洞卷积替换主干网络的卷积层,以改变感受野的方式提高检测性能;最后使用引入软化非极大值抑制算法,保留有效信息,提高识别率。经实验验证,CR-RFPR101算法的检测率为83.4%,比原Cascade R-CNN算法提高了7.3%,满足了钢板表面缺陷检测要求。

Gender-Specific Multi-Task Micro-Expression Recognition Using Pyramid CGBP-TOP Feature

Micro-expression recognition has attracted growing research interests in the field of compute vision.However,micro-expression usually lasts a few seconds,thus it is difficult to detect.This paper presents a new framework to recognize micro-expression using pyramid histogram of Centralized Gabor Binary Pattern from Three Orthogonal Panels(CGBP-TOP)which is an extension of Local Gabor Binary Pattern from Three Orthogonal Panels feature.CGBP-TOP performs spatial and temporal analysis to capture the local facial characteristics of micro-expression image sequences.In order to keep more local information of the face,CGBP-TOP is extracted based on pyramid subregions of the micro-expression video frame.The combination of CGBP-TOP and spatial pyramid can represent well and truly the facial movements of the micro-expression image sequences.However,the dimension of our pyramid CGBP-TOP tends to be very high,which may lead to high data redundancy problem.In addition,it is clear that people of different genders usually have different ways of micro-expression.Therefore,in this paper,in order to select the relevant features of micro-expression,the gender-specific sparse multi-task learning method with adaptive regularization term is adopted to learn a compact subset of pyramid CGBP-TOP feature for micro-expression classification of different sexes.Finally,extensive experiments on widely used CASME II and SMIC databases demonstrate that our method can efficiently extract micro-expression motion features in the micro-expression video clip.Moreover,our proposed approach achieves comparable results with the state-of-the-art methods.

基于ECA和BIFPN的低照度环境下的行人目标检测算法

针对在低照度环境下多尺度行人目标检测准确率低的问题,本文提出了一种基于改进YOLOv5s的行人目标检测模型BE-YOLOv5s。首先,在YOLOv5s的主干网络中融入ECA通道注意力机制,突出目标特征同时抑制低照度环境的干扰;其次,引入加权双向特征金字塔BIFPN,增强特征融合,提升行人检测精度;最后,采用可见光图像和红外图像这两组数据进行对比研究。实验结果表明,改进后的BE-YOLOv5s模型在两种数据集上的平均精度均值mAP均有所提升,同时保持了原算法的高实时性。