PAPS: Progressive Attention-Based Pan-sharpening

Pan-sharpening aims to seek high-resolution multispectral(HRMS) images from paired multispectral images of low resolution(LRMS) and panchromatic(PAN) images, the key to which is how to maximally integrate spatial and spectral information from PAN and LRMS images. Following the principle of gradual advance, this paper designs a novel network that contains two main logical functions, i.e., detail enhancement and progressive fusion, to solve the problem. More specifically, the detail enhancement module attempts to produce enhanced MS results with the same spatial sizes as corresponding PAN images, which are of higher quality than directly up-sampling LRMS images.Having a better MS base(enhanced MS) and its PAN, we progressively extract information from the PAN and enhanced MS images, expecting to capture pivotal and complementary information of the two modalities for the purpose of constructing the desired HRMS. Extensive experiments together with ablation studies on widely-used datasets are provided to verify the efficacy of our design, and demonstrate its superiority over other state-of-the-art methods both quantitatively and qualitatively. Our code has been released at https://github.com/JiaYN1/PAPS.

Enhanced progressive fusion method for the efficient detection of multiscale lightweight citrus fruits

Human labor efficiency has become unable to keep the pace with gradually annual citrus increasing production.Highly efficient and intelligent citrus picking and accurate yield estimation is the key to solve the problem.Success heavily depends on detection accuracy,prediction speed,and easy model deployment.Traditional target detection methods often fail to achieve balanced results in all those aspects.An improved YOLOv8 network model with four significant features is proposed.First,a lightweight FasterNet network structure was introduced to the backbone network,which reduced the number of parameters and computations while maintaining high-precision detection.Second,a progressive feature pyramid network AFPN structure was added to the neck network.Third,a parallel multi-branch attention mechanism PMBA was added before the detection head to improve the sensing ability after the feature fusion network.Fourth,a Wise-IoU was introduced to replace the original CIoU loss function to make the whole training process converge faster.Based on this,this study proposes an improved version of the YOLOv8 model:the FAP-YOLOv8.This improved model achieved an average accuracy(mAP@0.5)of 97.2%on the citrus datasets,with an accuracy that was 4.7%higher than the original YOLOv8,which was 19.2%,7.4%,5.1%,4.9%,and 5.2%higher than the other models:Faster R-CNN,CenterNet,YOLOv5s,YOLOx-s,and YOLOv7,respectively.The number of parameters was reduced by 55.45%,the computation was reduced by 20%compared to the YOLOv8 benchmark,and the frame rate reached 46.51 fps to meet the detection requirements of lightweight networks.The experiments showed that the FAP-YOLOv8 models all outperformed the comparison models.Consequently,the proposed FAPYOLOv8 model can help solve the citrus detection problem in orchards,which can be better applied to edge devices and provides strong support for intelligent orchard management.