A Noise Reduction Method for Multiple Signals Combining Computed Order Tracking Based on Chirplet Path Pursuit and Distributed Compressed Sensing

With the development of multi-signal monitoring technology,the research on multiple signal analysis and processing has become a hot subject.Mechanical equipment often works under variable working conditions,and the acquired vibration signals are often non-stationary and nonlinear,which are difficult to be processed by traditional analysis methods.In order to solve the noise reduction problem of multiple signals under variable speed,a COT-DCS method combining the Computed Order Tracking(COT)based on Chirplet Path Pursuit(CPP)and Distributed Compressed Sensing(DCS)is proposed.Firstly,the instantaneous frequency(IF)is extracted by CPP,and the speed is obtained by fitting.Then,the speed is used for equal angle sampling of time-domain signals,and angle-domain signals are obtained by COT without a tachometer to eliminate the nonstationarity,and the angledomain signals are compressed and reconstructed by DCS to achieve noise reduction of multiple signals.The accuracy of the CPP method is verified by simulated,experimental signals and compared with some existing IF extraction methods.The COT method also shows good signal stabilization ability through simulation and experiment.Finally,combined with the comparative test of the other two algorithms and four noise reduction effect indicators,the COT-DCS based on the CPP method combines the advantages of the two algorithms and has better noise reduction effect and stability.It is shown that this method is an effective multi-signal noise reduction method.

Novel Real-Time Seam Tracking Algorithm Based on Vector Angle and Least Square Method

Real-time seam tracking can improve welding quality and enhance welding efficiency during the welding process in automobile manufacturing.However,the teaching-playing welding process,an off-line seam tracking method,is still dominant in automobile industry,which is less flexible when welding objects or situation change.A novel real-time algorithm consisting of seam detection and generation is proposed to track seam.Using captured 3D points,space vectors were created between two adjacent points along each laser line and then a vector angle based algorithm was developed to detect target points on the seam.Least square method was used to fit target points to a welding trajectory for seam tracking.Furthermore,the real-time seam tracking process was simulated in MATLAB/Simulink.The trend of joint angles vs.time was logged and a comparison between the off-line and the proposed seam tracking algorithm was conducted.Results show that the proposed real-time seam tracking algorithm can work in a real-time scenario and have high accuracy in welding point positioning.

Deep Learning Based Target Tracking and Classification for Infrared Videos Using Compressive Measurements

Although compressive measurements save data storage and bandwidth usage, they are difficult to be used directly for target tracking and classification without pixel reconstruction. This is because the Gaussian random matrix destroys the target location information in the original video frames. This paper summarizes our research effort on target tracking and classification directly in the compressive measurement domain. We focus on one particular type of compressive measurement using pixel subsampling. That is, original pixels in video frames are randomly subsampled. Even in such a special compressive sensing setting, conventional trackers do not work in a satisfactory manner. We propose a deep learning approach that integrates YOLO (You Only Look Once) and ResNet (residual network) for multiple target tracking and classification. YOLO is used for multiple target tracking and ResNet is for target classification. Extensive experiments using short wave infrared (SWIR), mid-wave infrared (MWIR), and long-wave infrared (LWIR) videos demonstrated the efficacy of the proposed approach even though the training data are very scarce.

A machine vision approach to seam tracking in real-time in PAW of large-diameter stainless steel tube

Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to realize the automation of computer-aided seam tracking. A PAW (plasma arc welding) seam tracking system was developed, which senses the molten pool and the seam in one frame by a vision sensor, and then detects the seam deviation to adjust the work piece motion adaptively to the seam position sensed by vision sensor. A novel molten pool area image-processing algorithm based on machine vision was proposed. The algorithm processes each image at the speed of 20 frames/second in real-time to extract three feature variables to get the seam deviation. It is proved experimentally that the algorithm is very fast and effective. Issues related to the algorithm are also discussed.

AN IMPROVED SPARSITY ADAPTIVE MATCHING PURSUIT ALGORITHM FOR COMPRESSIVE SENSING BASED ON REGULARIZED BACKTRACKING

Sparsity Adaptive Matching Pursuit (SAMP) algorithm is a widely used reconstruction algorithm for compressive sensing in the case that the sparsity is unknown. In order to match the sparsity more accurately, we presented an improved SAMP algorithm based on Regularized Backtracking (SAMP-RB). By adapting a regularized backtracking step to SAMP algorithm in each iteration stage, the proposed algorithm can flexibly remove the inappropriate atoms. The experimental results show that SAMP-RB reconstruction algorithm greatly improves SAMP algorithm both in reconstruction quality and computational time. It has better reconstruction efficiency than most of the available matching pursuit algorithms.

A Particle Filter Based Compressive Sensing Method for Tracking Moving Wideband Sound Sources

Tracking moving wideband sound sources is one of the most challenging issues in the acoustic array signal processing which is based on the direction of arrival(DOA) estimation. Compressive sensing(CS) is a recent theory exploring the signal sparsity representation, which has been proved to be superior for the DOA estimation. However, the spatial aliasing and the offset at endfire are the main obstacles for CS applied in the wideband DOA estimation. We propose a particle filter based compressive sensing method for tracking moving wideband sound sources. First, the initial DOA estimates are obtained by wideband CS algorithms. Then, the real sources are approximated by a set of particles with different weights assigned. The kernel density estimator is used as the likelihood function of particle filter. We present the results for both uniform and random linear array. Simulation results show that the spatial aliasing is disappeared and the offset at endfire is reduced. We show that the proposed method can achieve satisfactory tracking performance regardless of using uniform or random linear array.

Real-time accurate hand path tracking and joint trajectory planning for industrial robots(Ⅰ)

Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Car-tesian space mainly through increasing the number of knots on the path and the number of the path′s segments, which results in the heavier online computational burden for the robot controller. Aiming at overcoming this drawback, the authors propose a new kind of real-time accurate hand path tracking and joint trajectory planning method. Through selecting some extra knots on the specified hand path by a certain rule and introducing a sinusoidal function to the joint displacement equation of each segment, this method can greatly raise the path tracking accuracy of robot′s hand and does not change the number of the path′s segments. It also does not increase markedly the computational burden of robot controller. The result of simulation indicates that this method is very effective, and has important value in increasing the application of industrial robots.

A Real-time Face/Hand Tracking Method for Chinese Sign Language Recognition

This paper introduces a new Chinese Sign Language recognition (CSLR) system and a method of real time tracking face and hand applied in the system. In the method, an improved agent algorithm is used to extract the region of face and hand and track them. Kalman filter is introduced to forecast the position and rectangle of search, and self adapting of target color is designed to counteract the effect of illumination.

Target Tracking and Classification Using Compressive Measurements of MWIR and LWIR Coded Aperture Cameras

Pixel-wise Code Exposure (PCE) camera is one type of compressive sensing camera that has low power consumption and high compression ratio. Moreover, a PCE camera can control individual pixel exposure time that can enable high dynamic range. Conventional approaches of using PCE camera involve a time consuming and lossy process to reconstruct the original frames and then use those frames for target tracking and classification. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. Our approach has two parts: tracking and classification. The tracking has been done using YOLO (You Only Look Once) and the classification is achieved using Residual Network (ResNet). Extensive experiments using mid-wave infrared (MWIR) and long-wave infrared (LWIR) videos demonstrated the efficacy of our proposed approach.

Real-time accurate hand path tracking and joint trajectory planning for industrial robots(Ⅱ)

Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Cartesian space mainly through increasing the number of knots on the path and the segments of the path. But, this method resulted in the heavier on line computational burden for the robot controller. In this paper, aiming at this drawback, the authors propose a new kind of real time accurate hand path tracking and joint trajectory planning method for robots. Through selecting some extra knots on the specified hand path by a certain rule, which enables the number of knots on each segment to increase from two to four, and through introducing a sinusoidal function and a cosinoidal function to the joint displacement equation of each segment, this method can raise the path tracking accuracy of robot′s hand greatly but does not increase the computational burden of robot controller markedly.

Real-time tracking of deformable objects based on MOK algorithm

The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB（MORB） algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi（KLT）. By using Kalman, the object＇s state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.

Real-time localization for underwater equipment using an extremely low frequency electric field

A new real-time underwater equipment location method adopting an electric field induced by a standard current source is proposed.Our goals were real-time tracking and location of stationary or moving underwater equipment both in shallow and deep seas,under noisy conditions.The main features of this method are as follows:(1)a standard current source on the water surface,which can be towed by a vehicle,consisting of two electrodes,a signal generator,and a GPS unit;(2)measurement of the extremely low frequency(ELF)electric field emitted by the current source,made possible by electric field sensors on the underwater equipment;(3)position of the underwater equipment is estimated in real time based on a progressive update extended Kalman filter(PUEKF),which is carried out using the propagation model of an ELF electric field because the electric field at the position of the underwater equipment and the current source position are known.We verified the accuracy of our method and confirmed real-time location feasibility through numerical,physical scale,and real-time sea experiments.Through numerical experiments,we verified that our method works for underwater equipment location in real-world conditions,and the location error can be less than 0.2 m.Next,real-time location experiments for stationary underwater measuring equipment in water tank were conducted.The result shows that the location error can be less than 0.1 m.We also confirmed real-time location feasibility through the use of offshore experiment.We expect that our method will complement conventional underwater acoustic location methods for underwater equipment in acoustically noisy environments.

A GHOST FLUID BASED FRONT TRACKING METHOD FOR MULTIMEDIUM COMPRESSIBLE FLOWS

Recent years the modify ghost fluid method （MGFM） and the real ghost fluid method （RGFM） based on Riemann problem have been developed for multimedium compressible flows. According to authors, these methods have only been used with the level set technique to track the interface. In this paper, we combine the MCFM and the RGFM respectively with front tracking method, for which the fluid interfaces are explicitly tracked by connected points. The method is tested with some one-dimensional problems, and its applicability is also studied. Furthermore, in order to capture the interface more accurately, especially for strong shock impacting on interface, a shock monitor is proposed to determine the initial states of the Riemann problem. The present method is applied to various one- dimensional problems involving strong shock-interface interaction. An extension of the present method to two dimension is also introduced and preliminary results are given.

Multiple-Object Tracking Using Histogram Stamp Extraction in CCTV Environments

Object tracking,an important technology in the field of image processing and computer vision,is used to continuously track a specific object or person in an image.This technology may be effective in identifying the same person within one image,but it has limitations in handling multiple images owing to the difficulty in identifying whether the object appearing in other images is the same.When tracking the same object using two or more images,there must be a way to determine that objects existing in different images are the same object.Therefore,this paper attempts to determine the same object present in different images using color information among the unique information of the object.Thus,this study proposes a multiple-object-tracking method using histogram stamp extraction in closed-circuit television applications.The proposed method determines the presence or absence of a target object in an image by comparing the similarity between the image containing the target object and other images.To this end,a unique color value of the target object is extracted based on its color distribution in the image using three methods:mean,mode,and interquartile range.The Top-N accuracy method is used to analyze the accuracy of each method,and the results show that the mean method had an accuracy of 93.5%(Top-2).Furthermore,the positive prediction value experimental results show that the accuracy of the mean method was 65.7%.As a result of the analysis,it is possible to detect and track the same object present in different images using the unique color of the object.Through the results,it is possible to track the same object that can minimize manpower without using personal information when detecting objects in different images.In the last response speed experiment,it was shown that when the mean was used,the color extraction of the object was possible in real time with 0.016954 s.Through this,it is possible to detect and track the same object in real time when using the proposed method.

Heterogeneity induced strain localization in block-in-matrix-soils subjected to uniaxial loading using real-time CT scanning

Block-in-matrix-soils(bimsoils)are geological mixtures that have distinct structures consisting of relatively strong rock blocks and weak matrix soils.It is still a challenge to evaluate the mechanical behaviors of bimsoils because of the heterogeneity,chaotic structure,and lithological variability.As a result,only very limited laboratory studies have been reported on the evolution of their internal deformation.In this study,the deformation evolution of bimsoils under uniaxial loading is investigated using real-time X-ray computed tomography(CT)and image correlation algorithm(with a rock block percentage(RBP)of 40%).Three parameters,i.e.heterogeneity coefficient(K),correlation coefficient(CC),and standard deviation(STD)of displacement fields,are proposed to quantify the heterogeneity of the motion of the rock blocks and the progressive deformation of the bimsoils.Experimental results show that the rock blocks in bimsoils are prone to forming clusters with increasing loading,and the sliding surface goes around only one side of a cluster.Based on the movement of the rock blocks recorded by STD and CC,the progressive deformation of the bimsoils is quantitatively divided into three stages:initialization of the rotation of rock blocks,formation of rock block clusters,and formation of a shear band by rock blocks with significant rotation.Moreover,the experimental results demonstrate that the meso-motion of rock blocks controls the macroscopic mechanical properties of the samples.

Compressing Information of Target Tracking in Wireless Sensor Networks

Target tracking is a well studied topic in wireless sensor networks. It is a procedure that nodes in the network collaborate in detecting targets and transmitting their information to the base-station continuously, which leads to data implosion and redundancy. To reduce traffic load of the network, a data compressing based target tracking protocol is proposed in this work. It first incorporates a clustering based data gather method to group sensor nodes into clusters. Then a novel threshold technique with bounded error is proposed to exploit the spatial correlation of sensed data and compress the data in the same cluster. Finally, the compact data presentations are transmitted to the base-station for targets localization. We evaluate our approach with a comprehensive set of simulations. It can be concluded that the proposed method yields excellent performance in energy savings and tracking quality.

High-speed railway track components inspection framework based on YOLOv8 with high-performance model deployment

Railway inspection poses significant challenges due to the extensive use of various components in vast railway networks,especially in the case of high-speed railways.These networks demand high maintenance but offer only limited inspection windows.In response,this study focuses on developing a high-performance rail inspection system tailored for high-speed railways and railroads with constrained inspection timeframes.This system leverages the latest artificial intelligence advancements,incorporating YOLOv8 for detection.Our research introduces an efficient model inference pipeline based on a producer-consumer model,effectively utilizing parallel processing and concurrent computing to enhance performance.The deployment of this pipeline,implemented using C++,TensorRT,float16 quantization,and oneTBB,represents a significant departure from traditional sequential processing methods.The results are remarkable,showcasing a substantial increase in processing speed:from 38.93 Frames Per Second(FPS)to 281.06 FPS on a desktop system equipped with an Nvidia RTX A6000 GPU and from 19.50 FPS to 200.26 FPS on the Nvidia Jetson AGX Orin edge computing platform.This proposed framework has the potential to meet the real-time inspection requirements of high-speed railways.

Real-time object tracking via compressive feature selection

Recently, compressive tracking （CT） has been widely proposed for its efficiency, accuracy and robustness on many challenging sequences. Its appearance model employs non-adaptive random projections that preserve the structure of the image feature space. A very sparse measurement matrix is used to extract features by multiplying it with the feature vector of the image patch. An adaptive Bayes classifier is trained using both positive samples and negative samples to separate the target from background. On the CT frame- work, however, some features used for classification have weak discriminative abilities, which reduces the accuracy of the strong classifier. In this paper, we present an online compressive feature selection algorithm（CFS） based on the CT framework. It selects the features which have the largest margin when using them to classify positive samples and negative samples. For features that are not selected, we define a random learning rate to update them slowly, It makes those weak classifiers preserve more target information, which relieves the drift when the appearance of the target changes heavily. Therefore, the classifier trained with those discriminative features couples its score in many challenging sequences, which leads to a more robust tracker. Numerous experiments show that our tracker could achieve superior result beyond many state-of-the-art trackers.

RFID Based e-quality Tracking in Service-oriented Manufacturing Execution System

The method of acquiring the real-time data has influenced the implementation of the manufacturing execution system （MES）. Accompanied with turning the MES into service-oriented manufacturing execution system （so-MES）, real-time e-quality tracking （e-QT）, in which real-time data are computed, has played more and more important roles in manufacturing. This paper presents an e-QT model through the study of real-time status data tracking and quality data collecting. An implementing architecture of the e-QT model is constructed on the basis of radio frequency identification devices （RFID） data-tracking network. In order to develop the e-QT system, some key enabling technologies, such as configuration, data collection, and data processing, etc, are studied. The relation schema between hardware is built for the RFID data-tracking network based on the configuration technique. Real-time data are sampled by using data collecting technique. Furthermore, real-time status and quality data in a shop-floor can be acquired in terms of using the real-time data computing method. Finally, a prototype system is developed and a running example is given so as to verify the feasibility of methods proposed in this paper. The proposed research provides effective e-quality tracking theoretical foundation through the use of RFID technology for the discrete manufacturing.

Current trends in three-dimensional visualization and real-time navigation as well as robot-assisted technologies in hepatobiliary surgery

With the continuous development of digital medicine,minimally invasive precision and safety have become the primary development trends in hepatobiliary surgery.Due to the specificity and complexity of hepatobiliary surgery,traditional preoperative imaging techniques such as computed tomography and magnetic resonance imaging cannot meet the need for identification of fine anatomical regions.Imaging-based three-dimensional(3D)reconstruction,virtual simulation of surgery and 3D printing optimize the surgical plan through preoperative assessment,improving the controllability and safety of intraoperative operations,and in difficult-to-reach areas of the posterior and superior liver,assistive robots reproduce the surgeon’s natural movements with stable cameras,reducing natural vibrations.Electromagnetic navigation in abdominal surgery solves the problem of conventional surgery still relying on direct visual observation or preoperative image assessment.We summarize and compare these recent trends in digital medical solutions for the future development and refinement of digital medicine in hepatobiliary surgery.