Real-Time Detection and Instance Segmentation of Strawberry in Unstructured Environment

The real-time detection and instance segmentation of strawberries constitute fundamental components in the development of strawberry harvesting robots.Real-time identification of strawberries in an unstructured envi-ronment is a challenging task.Current instance segmentation algorithms for strawberries suffer from issues such as poor real-time performance and low accuracy.To this end,the present study proposes an Efficient YOLACT(E-YOLACT)algorithm for strawberry detection and segmentation based on the YOLACT framework.The key enhancements of the E-YOLACT encompass the development of a lightweight attention mechanism,pyramid squeeze shuffle attention(PSSA),for efficient feature extraction.Additionally,an attention-guided context-feature pyramid network(AC-FPN)is employed instead of FPN to optimize the architecture’s performance.Furthermore,a feature-enhanced model(FEM)is introduced to enhance the prediction head’s capabilities,while efficient fast non-maximum suppression(EF-NMS)is devised to improve non-maximum suppression.The experimental results demonstrate that the E-YOLACT achieves a Box-mAP and Mask-mAP of 77.9 and 76.6,respectively,on the custom dataset.Moreover,it exhibits an impressive category accuracy of 93.5%.Notably,the E-YOLACT also demonstrates a remarkable real-time detection capability with a speed of 34.8 FPS.The method proposed in this article presents an efficient approach for the vision system of a strawberry-picking robot.

Real-Time Object Detection and Face Recognition Application for the Visually Impaired

The advancement of navigation systems for the visually impaired has significantly enhanced their mobility by mitigating the risk of encountering obstacles and guiding them along safe,navigable routes.Traditional approaches primarily focus on broad applications such as wayfinding,obstacle detection,and fall prevention.However,there is a notable discrepancy in applying these technologies to more specific scenarios,like identifying distinct food crop types or recognizing faces.This study proposes a real-time application designed for visually impaired individuals,aiming to bridge this research-application gap.It introduces a system capable of detecting 20 different food crop types and recognizing faces with impressive accuracies of 83.27%and 95.64%,respectively.These results represent a significant contribution to the field of assistive technologies,providing visually impaired users with detailed and relevant information about their surroundings,thereby enhancing their mobility and ensuring their safety.Additionally,it addresses the vital aspects of social engagements,acknowledging the challenges faced by visually impaired individuals in recognizing acquaintances without auditory or tactile signals,and highlights recent developments in prototype systems aimed at assisting with face recognition tasks.This comprehensive approach not only promises enhanced navigational aids but also aims to enrich the social well-being and safety of visually impaired communities.

Analyzing the Impact of Scene Transitions on Indoor Camera Localization through Scene Change Detection in Real-Time

Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.

A YOLOv8-CE-based real-time traffic sign detection and identification method for autonomous vehicles

Traffic sign detection in real scenarios is challenging due to their complexity and small size,often preventing existing deep learning models from achieving both high accuracy and real-time performance.An improved YOLOv8 model for traffic sign detection is proposed.Firstly,by adding Coordinate Attention(CA)to the Backbone,the model gains location information,improving detection accuracy.Secondly,we also introduce EIoU to the localization function to address the ambiguity in aspect ratio descriptions by calculating the width-height difference based on CIoU.Additionally,Focal Loss is incorporated to balance sample difficulty,enhancing regression accuracy.Finally,the model,YOLOv8-CE(YOLOv8-Coordinate Attention-EIoU),is tested on the Jetson Nano,achieving real-time street scene detection and outperforming the Raspberry Pi 4B.Experimental results show that YOLOv8-CE excels in various complex scenarios,improving mAP by 2.8%over the original YOLOv8.The model size and computational effort remain similar,with the Jetson Nano achieving an inference time of 96 ms,significantly faster than the Raspberry Pi 4B.

A CNN-Based Single-Stage Occlusion Real-Time Target Detection Method

Aiming at the problem of low accuracy of traditional target detection methods for target detection in endoscopes in substation environments, a CNN-based real-time detection method for masked targets is proposed. The method adopts the overall design of backbone network, detection network and algorithmic parameter optimisation method, completes the model training on the self-constructed occlusion target dataset, and adopts the multi-scale perception method for target detection. The HNM algorithm is used to screen positive and negative samples during the training process, and the NMS algorithm is used to post-process the prediction results during the detection process to improve the detection efficiency. After experimental validation, the obtained model has the multi-class average predicted value (mAP) of the dataset. It has general advantages over traditional target detection methods. The detection time of a single target on FDDB dataset is 39 ms, which can meet the need of real-time target detection. In addition, the project team has successfully deployed the method into substations and put it into use in many places in Beijing, which is important for achieving the anomaly of occlusion target detection.

Real-time moving object detection for video monitoring systems

Moving object detection is one of the challenging problems in video monitoring systems, especially when the illumination changes and shadow exists. Amethod for real-time moving object detection is described. Anew background model is proposed to handle the illumination varition problem. With optical flow technology and background subtraction, a moving object is extracted quickly and accurately. An effective shadow elimination algorithm based on color features is used to refine the moving obj ects. Experimental results demonstrate that the proposed method can update the background exactly and quickly along with the varition of illumination, and the shadow can be eliminated effectively. The proposed algorithm is a real-time one which the foundation for further object recognition and understanding of video mum＇toting systems.

Real-time detection of moving objects in video sequences

An approach to detection of moving objects in video sequences, with application to video surveillance is presented. The algorithm combines two kinds of change points, which are detected from the region-based frame difference and adjusted background subtraction. An adaptive threshold technique is employed to automatically choose the threshold value to segment the moving objects from the still background. And experiment results show that the algorithm is effective and efficient in practical situations. Furthermore, the algorithm is robust to the effects of the changing of lighting condition and can be applied for video surveillance system.

Customized Convolutional Neural Network for Accurate Detection of Deep Fake Images in Video Collections

The motivation for this study is that the quality of deep fakes is constantly improving,which leads to the need to develop new methods for their detection.The proposed Customized Convolutional Neural Network method involves extracting structured data from video frames using facial landmark detection,which is then used as input to the CNN.The customized Convolutional Neural Network method is the date augmented-based CNN model to generate‘fake data’or‘fake images’.This study was carried out using Python and its libraries.We used 242 films from the dataset gathered by the Deep Fake Detection Challenge,of which 199 were made up and the remaining 53 were real.Ten seconds were allotted for each video.There were 318 videos used in all,199 of which were fake and 119 of which were real.Our proposedmethod achieved a testing accuracy of 91.47%,loss of 0.342,and AUC score of 0.92,outperforming two alternative approaches,CNN and MLP-CNN.Furthermore,our method succeeded in greater accuracy than contemporary models such as XceptionNet,Meso-4,EfficientNet-BO,MesoInception-4,VGG-16,and DST-Net.The novelty of this investigation is the development of a new Convolutional Neural Network(CNN)learning model that can accurately detect deep fake face photos.

A Unified Model Fusing Region of Interest Detection and Super Resolution for Video Compression

High-resolution video transmission requires a substantial amount of bandwidth.In this paper,we present a novel video processing methodology that innovatively integrates region of interest(ROI)identification and super-resolution enhancement.Our method commences with the accurate detection of ROIs within video sequences,followed by the application of advanced super-resolution techniques to these areas,thereby preserving visual quality while economizing on data transmission.To validate and benchmark our approach,we have curated a new gaming dataset tailored to evaluate the effectiveness of ROI-based super-resolution in practical applications.The proposed model architecture leverages the transformer network framework,guided by a carefully designed multi-task loss function,which facilitates concurrent learning and execution of both ROI identification and resolution enhancement tasks.This unified deep learning model exhibits remarkable performance in achieving super-resolution on our custom dataset.The implications of this research extend to optimizing low-bitrate video streaming scenarios.By selectively enhancing the resolution of critical regions in videos,our solution enables high-quality video delivery under constrained bandwidth conditions.Empirical results demonstrate a 15%reduction in transmission bandwidth compared to traditional super-resolution based compression methods,without any perceivable decline in visual quality.This work thus contributes to the advancement of video compression and enhancement technologies,offering an effective strategy for improving digital media delivery efficiency and user experience,especially in bandwidth-limited environments.The innovative integration of ROI identification and super-resolution presents promising avenues for future research and development in adaptive and intelligent video communication systems.

Multi-Stream Temporally Enhanced Network for Video Salient Object Detection

Video salient object detection(VSOD)aims at locating the most attractive objects in a video by exploring the spatial and temporal features.VSOD poses a challenging task in computer vision,as it involves processing complex spatial data that is also influenced by temporal dynamics.Despite the progress made in existing VSOD models,they still struggle in scenes of great background diversity within and between frames.Additionally,they encounter difficulties related to accumulated noise and high time consumption during the extraction of temporal features over a long-term duration.We propose a multi-stream temporal enhanced network(MSTENet)to address these problems.It investigates saliency cues collaboration in the spatial domain with a multi-stream structure to deal with the great background diversity challenge.A straightforward,yet efficient approach for temporal feature extraction is developed to avoid the accumulative noises and reduce time consumption.The distinction between MSTENet and other VSOD methods stems from its incorporation of both foreground supervision and background supervision,facilitating enhanced extraction of collaborative saliency cues.Another notable differentiation is the innovative integration of spatial and temporal features,wherein the temporal module is integrated into the multi-stream structure,enabling comprehensive spatial-temporal interactions within an end-to-end framework.Extensive experimental results demonstrate that the proposed method achieves state-of-the-art performance on five benchmark datasets while maintaining a real-time speed of 27 fps(Titan XP).Our code and models are available at https://github.com/RuJiaLe/MSTENet.

Real-time image processing and display in object size detection based on VC++

Real-time detection for object size has now become a hot topic in the testing field and image processing is the core algorithm. This paper focuses on the processing and display of the collected dynamic images to achieve a real-time image pro- cessing for the moving objects. Firstly, the median filtering, gain calibration, image segmentation, image binarization, cor- ner detection and edge fitting are employed to process the images of the moving objects to make the image close to the real object. Then, the processed images are simultaneously displayed on a real-time basis to make it easier to analyze, understand and identify them, and thus it reduces the computation complexity. Finally, human-computer interaction （HCI）-friendly in- terface based on VC ＋＋ is designed to accomplish the digital logic transform, image processing and real-time display of the objects. The experiment shows that the proposed algorithm and software design have better real-time performance and accu- racy which can meet the industrial needs.

SwinVid:Enhancing Video Object Detection Using Swin Transformer

What causes object detection in video to be less accurate than it is in still images?Because some video frames have degraded in appearance from fast movement,out-of-focus camera shots,and changes in posture.These reasons have made video object detection(VID)a growing area of research in recent years.Video object detection can be used for various healthcare applications,such as detecting and tracking tumors in medical imaging,monitoring the movement of patients in hospitals and long-term care facilities,and analyzing videos of surgeries to improve technique and training.Additionally,it can be used in telemedicine to help diagnose and monitor patients remotely.Existing VID techniques are based on recurrent neural networks or optical flow for feature aggregation to produce reliable features which can be used for detection.Some of those methods aggregate features on the full-sequence level or from nearby frames.To create feature maps,existing VID techniques frequently use Convolutional Neural Networks(CNNs)as the backbone network.On the other hand,Vision Transformers have outperformed CNNs in various vision tasks,including object detection in still images and image classification.We propose in this research to use Swin-Transformer,a state-of-the-art Vision Transformer,as an alternative to CNN-based backbone networks for object detection in videos.The proposed architecture enhances the accuracy of existing VID methods.The ImageNet VID and EPIC KITCHENS datasets are used to evaluate the suggested methodology.We have demonstrated that our proposed method is efficient by achieving 84.3%mean average precision(mAP)on ImageNet VID using less memory in comparison to other leading VID techniques.The source code is available on the website https://github.com/amaharek/SwinVid.

Real-Time Detection of Cracks on Concrete Bridge Decks Using Deep Learning in the Frequency Domain

This paper presents a vision-based crack detection approach for concrete bridge decks using an integrated one-dimensional convolutional neural network(1D-CNN)and long short-term memory(LSTM)method in the image frequency domain.The so-called 1D-CNN-LSTM algorithm is trained using thousands of images of cracked and non-cracked concrete bridge decks.In order to improve the training efficiency,images are first transformed into the frequency domain during a preprocessing phase.The algorithm is then calibrated using the flattened frequency data.LSTM is used to improve the performance of the developed network for long sequence data.The accuracy of the developed model is 99.05%,98.9%,and 99.25%,respectively,for training,validation,and testing data.An implementation framework is further developed for future application of the trained model for large-scale images.The proposed 1D-CNN-LSTM method exhibits superior performance in comparison with existing deep learning methods in terms of accuracy and computation time.The fast implementation of the 1D-CNN-LSTM algorithm makes it a promising tool for real-time crack detection.

A fast and adaptive method for automatic weld defect detection in various real-time X-ray imaging systems

A first and effective method is proposed to detect weld deject adaptively in various Dypes of real-time X-ray images obtained in different conditions. After weld extraction and noise reduction, a proper template of median filter is used to estimate the weld background. After the weld background is subtracted from the original image, an adaptite threshold segmentation algorithm is proposed to obtain the binary image, and then the morphological close and open operation, labeling algorithm and fids＇e alarm eliminating algorithm are applied to pracess the binary image to obtain the defect, ct detection result. At last, a fast realization procedure jbr proposed method is developed. The proposed method is tested in real-time X-ray image,s obtairted in different X-ray imaging sutems. Experiment results show that the proposed method is effective to detect low contrast weld dejects with few .false alarms and is adaptive to various types of real-time X-ray imaging systems.

Real-time Fluorescence PCR Method for Detection of Burkholderia glumae from Rice

Burkholderia glumae causing seedling rot and grain rot of rice was listed as a plant quarantine disease of China in 2007. It＇s quite necessary to set up effective detection methods for the pathogen to manage further dispersal of this disease. The present study combined the real-time PCR method with classical PCR to increase the detecting efficiency, and to develop an accurate, rapid and sensitive method to detect the pathogen in the seed quarantine for effective management of the disease. The results showed that all the tested strains of B. glumae produced about 139 bp specific fragments by the real-time PCR and the general PCR methods, while others showed negative PCR result. The bacteria could be detected at the concentrations of 1×10^4 CFU/mL by general PCR method and at the concentrations below 100 CFU/mL by real-time fluorescence PCR method. B. glumae could be detected when the inoculated and healthy seeds were mixed with a proportion of 1：100.

Comparison of ligase detection reaction and real-time PCR for detection of low abundant YMDD mutants in patients with chronic hepatitis B

AIM: To compare the ligase detection reaction (LDR) and real-time PCR for detection of low abundant YMDD mutants in patients with chronic hepatitis B infection.METHODS: Mixtures of plasmids and serum samples from 52 chronic hepatitis B patients with low abundant lamivudine-resistant mutations were tested with LDR and real-time PCR. Time required and reagent cost for both assays were evaluated.RESULTS: Real-time PCR detected 100, 50, 10, 1 and 0.1% of YIDD plasmid, whereas LDR detected 100, 50, 10, 1, 0.1, and 0.01% of YIDD plasmid, in mixtures with YMDD plasmid of 106 copies/mL. Among the 52 clinical serum samples, completely concordant results were obtained for all samples by both assays, and 39 YIDD, 9 YVDD, and 4 YIDD/YVDD were detected. Cost and time required for LDR and real-time PCR are 60/80 CNY (8/10.7 US dollars) and 4.5/2.5 h, respectively.CONCLUSION: LDR and real-time PCR are both sensitive and inexpensive methods for monitoring low abundant YMDD mutants during lamivudine therapy in patients with chronic hepatitis B. LDR is more sensitive and less expensive, while real-time PCR is more rapid.

A real-time PCR targeted to the upstream regions of HlyB for specific detection of Edwardsiella tarda

Edwardsiella tarda has become one of the most important emerging pathogens in aquaculture industry. Therefore, a rapid, reproducible, and sensitive method for detection and quantification of this pathogen is needed urgently. To achieve this purpose, we developed a TaqMan-based real-time PCR assay for detection and quantification orE. tarda. The assay targets the hemolysin activator HlyB domain protein of E. tarda. Our optimized TaqMan assay is capable of detecting as little as 40 fg of genomic DNA per reaction. A standard curve was generated from the threshold cycle values （y） against log10 （E. tarda genomic DNA concentration） as x. The intra- and inter-assay coefficient of variation （CV） values were less than 2.06% and 1.05% respectively, indicating that the assay had good reproducibility. This method is highly specific to E. tarda strains, as it shows no cross-reactivity to Edwardsiella ictaluri, a member of the same genus, or to nine other fish-pathogenic bacteria species belonging to three other genera. This sensitive and specific real-time PCR assay provides a valuable tool for diagnostic quantitation of E. tarda in clinical samples.

Development and validation of a TaqMan^(TM) fluorescent quantitative real-time PCR assay for the rapid detection of Edwardsiella tarda

Edwardsiella tarda is one of the most important emerging pathogens in tile global aquaculture industries. As such, an accurate diagnosis and quantitative analytical methods are urgently needed for this bacterium. In this study, primers and a TaqMan probe specific to the conservative sequences of the 16S rRNA gene of E. tarda were designed. The concentration of primers and TaqMan probe were optimized to 200 nmol/L and 120 nmol/L, respectively. The detection sensitivity of the FQ- PCR assay was determined to be as low as five copies of the target sequence per reaction using the pGEM-16S rDNA recombinant plasmid as a template, which was 100 times more sensitive than conventional PCR. A standard curve by plotting the threshold cycle values （y） against the common logarithmic copies （logl0n~ as x; n~ is copy number） of pGEM-16S rDNA was generated. The results of intra- and inter-assay variability tests demonstrate that the established FQ-PCR method was highly reproducible. The assay was specific for E. tarda as it showed that there was no cross-reactivity to eight additional bacterial pathogen strains in aquaculture. Thus, the FQ-PCR assay has the potential for diagnostic purposes and for other applications, especially for the rapid detection and quantification of low-grade E. tarda infections.

Real-time RT-PCR Assay for the detection of Tahyna Virus

A real-time RT-PCR （RT-qPCR） assay for the detection of Tahyna virus was developed to monitor Tahyna virus infection in field-collected vector mosquito samples. The targets selected for the assay were S segment sequences encoding the nucleocapsid protein from the Tahyna virus. Primers and probes were selected in conserved regions by aligning genetic sequences from various Tahyna virus strains available from GenBank. The sensitivity of the RT-qPCR approach was compared to that of a standard plaque assay in BHK cells. RT-qPCR assay can detect 4.8 PFU of titrated Tahyna virus. Assay specificities were determined by testing a battery of arboviruses, including representative strains of Tahyna virus and other arthropod-borne viruses from China. Seven strains of Tahyna virus were confirmed as positive; the other seven species of arboviruses could not be detected by RT-qPCR. Additionally, the assay was used to detect Tahyna viral RNA in pooled mosquito samples. The RT-qPCR assay detected Tahyna virus in a sensitive, specific, and rapid manner; these findings support the use of the assay in viral surveillance.

Real-time RT-PCR Assay for the Detection of Culex flavivirus

Based on the Culex flavivirus (CxFV) E gene sequences in GenBank, CxFV-specific primers and probes were designed for real-time reverse transcription-polymerase chain reaction (RT-qPCR). The specificity test revealed that CxFV could be detected using RT-qPCR with the specific CxFV primers and probes; other species of arboviruses were not detected. The stability test demonstrated a coefficient of variation of <1.5%. A quantitative standard curve for CxFV RT-qPCR was established. Quantitative standard curve analysis revealed that the lower detection limit of the RT-qPCR system is 100 copies/mu L. Moreover, RT-qPCR was used to detect CxFV viral RNA in mosquito pool samples. In conclusion, we established a real-time RT-PCR assay for CxFV detection, and this assay is more sensitive and efficient than general RT-PCR. This technology may be used to monitor changes in the environmental virus levels.