REAL-TIME TRACKING FOR FAST MOVING OBJECT ON COMPLEX BACKGROUND

A real-time tracking system for the fast moving object on the complex background is proposed.The Markov random filed（MRF）model based background subtraction algorithm is used to detect the changing pixels and track the moving object.The prior probability of the segmentation mask is modeled by using MRF,and the object tracking task is translated into the maximum a-posterior（MAP）problem.Experimental results show that the method is efficient at both offline and online moving objects on simple and complex background.

Quality Assurance for Respiratory-Gated Radiotherapy Using the Real-Time Tumor-Tracking Radiotherapy System

Purpose: Respiratory-gated radiation therapy (RT) using the real-time tumor-tracking radiotherapy (RTRT) system is an effective technique for managing tumor motion. High dosimetric and geometric accuracy is needed;however, quality assurance (QA) for respiratory-gated RT using the RTRT system has not been reported. The purpose of this study was to perform QA for respiratorygated RT using the RTRT system. Materials and Methods: The RTRT system detected the position of the fiducial marker and radiation delivery gated to the motion of the marker was performed. The dynamic anthropomorphic thorax phantom was positioned at the isocenter using the fiducial marker in the phantom. The phantom was irradiated only when the fiducial marker was within a three-dimensional gating window of ±2 mm from the planned position. First, the absolute doses were measured using anionization chamber inserted in the phantom under the stationary, gating and non-gating state for sinusoidal (nadir-to-peak amplitude [A]: 20 - 40 mm, breathing period [T]: 2 - 4 s) and the basic respiratory patterns. Second, the dose profiles were measured using Gafchromic films in the phantom under the same conditions. Differences between dose profiles were calculated to evaluate the dosimetric and geometric accuracy. Finally, differences between the actual and measured position of the fiducial marker were calculated to evaluate the tracking accuracy for sinusoidal and basic respiratory patterns. Results: For the sinusoidal patterns, the relative doses were 0.93 for non-gating and 0.99 for gating (A = 20 mm, T = 2 s), 0.94 for non-gating and 1.00 for gating (A = 20 mm, T = 4 s), 0.55 for non-gating and 1.00 for gating (A = 40 mm, T = 4 s), respectively. For the basic respiratory pattern, the relative doses were 1.00 for non-gating and 1.00 for gating, respectively. Compared to the stationary conditions, the differences in lateral distance between the 90% dose of dose profiles were 6.23 mm for non-gating and 0.36 mm for gating (A = 20 mm, T = 2 s), 8.79 mm for non-gating and 1.73 mm for gating (A = 20 mm, T = 4 s), 18.37 mm for non-gating and 0.67 mm for gating (A = 40 mm, T = 4 s), respectively. For the basic respiratory pattern, those were 5.23 mm for non-gating and 0.35 mm for gating. The root mean square (RMS) values of the tracking error were 0.18 mm (A = 20 mm, T = 2 s), 0.14 mm (A = 20 mm, T = 4 s), and 0.21 mm (A = 40 mm, T = 4 s) for sinusoidal and 0.79 mm for the basic respiratory pattern, respectively. Conclusion: We conducted QA for respiratory-gated RT using the RTRT system. The respiratory-gated RT using the RTRT system reduced the blurring effects on dose distribution with high dosimetric and geometric accuracy.

Novel Real-Time Seam Tracking Algorithm Based on Vector Angle and Least Square Method

Real-time seam tracking can improve welding quality and enhance welding efficiency during the welding process in automobile manufacturing.However,the teaching-playing welding process,an off-line seam tracking method,is still dominant in automobile industry,which is less flexible when welding objects or situation change.A novel real-time algorithm consisting of seam detection and generation is proposed to track seam.Using captured 3D points,space vectors were created between two adjacent points along each laser line and then a vector angle based algorithm was developed to detect target points on the seam.Least square method was used to fit target points to a welding trajectory for seam tracking.Furthermore,the real-time seam tracking process was simulated in MATLAB/Simulink.The trend of joint angles vs.time was logged and a comparison between the off-line and the proposed seam tracking algorithm was conducted.Results show that the proposed real-time seam tracking algorithm can work in a real-time scenario and have high accuracy in welding point positioning.

A machine vision approach to seam tracking in real-time in PAW of large-diameter stainless steel tube

Manual monitoring and seam tracking through watching weld pool images in real-time, by naked eyes or by industrial TV, are experience-depended, subjective, labor intensive, and sometimes biased. So it is necessary to realize the automation of computer-aided seam tracking. A PAW (plasma arc welding) seam tracking system was developed, which senses the molten pool and the seam in one frame by a vision sensor, and then detects the seam deviation to adjust the work piece motion adaptively to the seam position sensed by vision sensor. A novel molten pool area image-processing algorithm based on machine vision was proposed. The algorithm processes each image at the speed of 20 frames/second in real-time to extract three feature variables to get the seam deviation. It is proved experimentally that the algorithm is very fast and effective. Issues related to the algorithm are also discussed.

Real-Time Front Vehicle Detection Algorithm Based on Local Feature Tracking Method

This paper proposes an algorithm that extracts features of back side of the vehicle and detects the front vehicle in real-time by local feature tracking of vehicle in the continuous images.The features in back side of the vehicle are vertical and horizontal edges,shadow and symmetry.By comparing local features using the fixed window size,the features in the continuous images are tracked.A robust and fast Haarlike mask is used for detecting vertical and horizontal edges,and shadow is extracted by histogram equalization,and the sliding window method is used to compare both side templates of the detected candidates for extracting symmetry.The features for tracking are vertical edges,and histogram is used to compare location of the peak and magnitude of the edges.The method using local feature tracking in the continuous images is more robust for detecting vehicle than the method using single image,and the proposed algorithm is evaluated by continuous images obtained on the expressway and downtown.And it can be performed on real-time through applying it to the embedded system.

Real-time accurate hand path tracking and joint trajectory planning for industrial robots(Ⅰ)

Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Car-tesian space mainly through increasing the number of knots on the path and the number of the path′s segments, which results in the heavier online computational burden for the robot controller. Aiming at overcoming this drawback, the authors propose a new kind of real-time accurate hand path tracking and joint trajectory planning method. Through selecting some extra knots on the specified hand path by a certain rule and introducing a sinusoidal function to the joint displacement equation of each segment, this method can greatly raise the path tracking accuracy of robot′s hand and does not change the number of the path′s segments. It also does not increase markedly the computational burden of robot controller. The result of simulation indicates that this method is very effective, and has important value in increasing the application of industrial robots.

A Real-time Face/Hand Tracking Method for Chinese Sign Language Recognition

This paper introduces a new Chinese Sign Language recognition (CSLR) system and a method of real time tracking face and hand applied in the system. In the method, an improved agent algorithm is used to extract the region of face and hand and track them. Kalman filter is introduced to forecast the position and rectangle of search, and self adapting of target color is designed to counteract the effect of illumination.

Real-time accurate hand path tracking and joint trajectory planning for industrial robots(Ⅱ)

Previously, researchers raised the accuracy for a robot′s hand to track a specified path in Cartesian space mainly through increasing the number of knots on the path and the segments of the path. But, this method resulted in the heavier on line computational burden for the robot controller. In this paper, aiming at this drawback, the authors propose a new kind of real time accurate hand path tracking and joint trajectory planning method for robots. Through selecting some extra knots on the specified hand path by a certain rule, which enables the number of knots on each segment to increase from two to four, and through introducing a sinusoidal function and a cosinoidal function to the joint displacement equation of each segment, this method can raise the path tracking accuracy of robot′s hand greatly but does not increase the computational burden of robot controller markedly.

Real-time tracking of deformable objects based on MOK algorithm

The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB（MORB） algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi（KLT）. By using Kalman, the object＇s state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.

Exploration of instantaneous frequency for local control assessment in real-time hybrid simulation

Local control parameters such as instantaneous delay and instantaneous amplitude play an essential role in evaluating the performance and maintaining the stability of real-time hybrid simulation(RTHS).However,existing methods have limitations in obtaining this local assessment in either the time domain or frequency domain.In this study,the instantaneous frequency is introduced to determine local control parameters for actuator tracking assessment in a real-time hybrid simulation.Instantaneous properties,including amplitude,delay,frequency and phase,are then calculated based on analytic signals translated from actuator tracking signals through the Hilbert transform.Potential issues are discussed and solutions are proposed for calculation of local control parameters.Numerical simulations are first conducted for sinusoidal and chirp signals with time varying amplitude error and delay to demonstrate the potential of the proposed method.Laboratory tests also are conducted for a predefined random signal as well as the RTHS of a single degree of freedom structure with a self-centering viscous damper to experimentally verify the effectiveness of the proposed use of the instantaneous frequency.Results from the ensuing analysis clearly demonstrate that the instantaneous frequency provides great potential for local control assessment,and the proposed method enables local tracking parameters with good accuracy.

Investigation of Well-Balanced kV X-Ray Imaging Conditions between Skin Dose and Image Noise for Dynamic Tumor Tracking Irradiation

Purpose: The purposes of this study were to estimate accumulated kV X-ray imaging dose throughout dynamic tumor tracking (DTT) irradiation by Vero 4DRT system and to address an analytical skin dose formula for well-balanced kV X-ray imaging conditions between skin dose and image noise. Method: First, skin dose was measured using kV X-ray tube, chamber, and water-equivalent phantoms. Next, imaging dose for six patients in DTT treatment was computed using log files. Subsequently, scattered dose ratio was calculated by amount of ionization in front of flat panel detector (FPD) for fields with size of maximum and the chamber for 0 - 200 mm-thickness phantoms and tube voltage of 60, 80, 100, 120 kV, respectively. Furthermore, image noise was computed from FPD images. Results: The skin dose was greater by a factor of 1.4 - 1.6 than those in Synergy XVI system. The image noise in FPD, ?was expressed as N = 0.045×(1/QFPDen)0.479, where QFPDen denotes amount of ionization in front of FPD. Then, skin dose, D (N, t, v) was formulated as (0.045/N)(1/0.479)/QFPDen/mAs (t, v) ×D/mAs (v), where QFPDen/mAs (t, v) and D/mAs (v) denote amount of ionization in front of FPD and skin dose per mAs, respectively. Using the formulae, it has been demonstrated that skin dose with 120 kV has become lower than any other tube voltage in this study. Conclusion: Using skin doses for the phantom, the skin dose throughout DTT irradiation was estimated as 0.50 Gy. Furthermore, skin dose by kV X-ray imaging was described as a function of image noise, phantom thickness, and tube voltage, suggesting image noise may be reduced with higher X-ray tube voltage in this phantom study.

Verification of Dosimetric and Positional Accuracy of Dynamic Tumor Tracking Intensity Modulated Radiation Therapy

Purpose: We performed both, dosimetric and positional accuracy verification of dynamic tumor tracking (DTT) intensity modulated radiation therapy (IMRT), with the Vero4DRT system using a moving phantom (QUASAR respiratory motion platform;QUASAR phantom) and system log files. Methods: The QUASAR phantom was placed on a treatment couch. Measurement of the point dose and dose distribution was performed for conventional IMRT, with the QUASAR phantom static and moving;for DTT IMRT, this was performed with the phantom moving for pyramid shaped, prostate, paranasal sinus, and pancreas targets. The QUASAR phantom was driven by a sinusoidal signal in the superior-inferior direction. Furthermore, predicted positional errors induced by the Vero4DRT system and mechanical positional errors of the gimbal head, were calculated using the system log files. Results and Conclusion: For DTT IMRT, the dose at the evaluation point was within 3% compared with the verification plan, and the dose distribution in the passing rates of γ was 97.9%, with the criteria of 3% dose and 3 mm distance to agreement. The position error calculated from the log files was within 2 mm, suggesting the feasibility of employing DTT IMRT with high accuracy using the Vero4DRT system.

Magnetic resonance diffusion tensor imaging and fibertracking diffusion tensor tractography in the management of spinal astrocytomas

Some specially imaging of magnetic resonance imaging,the diffusion-weighted imaging(DWI),the diffusion tensor imaging and fractional anisotropy(FA),are useful to described,detect,and map the extent of spinal cord lesions.FA measurements may are used to predicting the outcome of patients who have spinal cord lesions.Fiber tracking enable to visualizing the integrity of white matter tracts surrounding some lesions,and this information could be used to formulating a differential diagnosis and planning biopsies or resection.In this article,we will describe the current uses for DWI and fiber tracking and speculate on others in which we believe these techniques will be useful in the future.

RFID Based e-quality Tracking in Service-oriented Manufacturing Execution System

The method of acquiring the real-time data has influenced the implementation of the manufacturing execution system （MES）. Accompanied with turning the MES into service-oriented manufacturing execution system （so-MES）, real-time e-quality tracking （e-QT）, in which real-time data are computed, has played more and more important roles in manufacturing. This paper presents an e-QT model through the study of real-time status data tracking and quality data collecting. An implementing architecture of the e-QT model is constructed on the basis of radio frequency identification devices （RFID） data-tracking network. In order to develop the e-QT system, some key enabling technologies, such as configuration, data collection, and data processing, etc, are studied. The relation schema between hardware is built for the RFID data-tracking network based on the configuration technique. Real-time data are sampled by using data collecting technique. Furthermore, real-time status and quality data in a shop-floor can be acquired in terms of using the real-time data computing method. Finally, a prototype system is developed and a running example is given so as to verify the feasibility of methods proposed in this paper. The proposed research provides effective e-quality tracking theoretical foundation through the use of RFID technology for the discrete manufacturing.

Current trends in three-dimensional visualization and real-time navigation as well as robot-assisted technologies in hepatobiliary surgery

With the continuous development of digital medicine,minimally invasive precision and safety have become the primary development trends in hepatobiliary surgery.Due to the specificity and complexity of hepatobiliary surgery,traditional preoperative imaging techniques such as computed tomography and magnetic resonance imaging cannot meet the need for identification of fine anatomical regions.Imaging-based three-dimensional(3D)reconstruction,virtual simulation of surgery and 3D printing optimize the surgical plan through preoperative assessment,improving the controllability and safety of intraoperative operations,and in difficult-to-reach areas of the posterior and superior liver,assistive robots reproduce the surgeon’s natural movements with stable cameras,reducing natural vibrations.Electromagnetic navigation in abdominal surgery solves the problem of conventional surgery still relying on direct visual observation or preoperative image assessment.We summarize and compare these recent trends in digital medical solutions for the future development and refinement of digital medicine in hepatobiliary surgery.

A Real-Time System for Monitoring Distant Dynamic Displacement of Structures

Based on digital image processing technique, a real-time system is developed to monitor and detect the dynamic displacement of engineering structures. By processing pictures with a self-programmed software, the real-time coordinate of an object in a certain coordinate system can be obtained, and further dynamic displacement data and curve of the object can also be achieved. That is, automatic gathering and real-time processing of data can be carried out by this system simultaneously. For this system, first, an untouched monitoring technique is adopted, which can monitor or detect objects several to hundreds of meters apart; second, it has flexible installation condition and good monitoring precision of sub-millimeter degree; third, it is fit for dynamic, quasi-dynamic and static monitoring of large engineering structures. Through several tests and applications in large bridges, good reliability and dominance of the system is proved.

A STUDY ON THE ENSEMBLE FORECAST REAL-TIME CORRECTION METHOD

Using real-time correction technology for typhoons, this paper discusses real-time correction for forecasting the track of four typhoons during 2009 and 2010 in Japan, Beijing, Guangzhou, and Shanghai. It was determined that the short-time forecast effect was better than the original objective mode. By selecting four types of integration schemes after multiple mode path integration for those four objective modes, the forecast effect of the multi-mode path integration is better, on average, than any single model. Moreover, multi-mode ensemble forecasting has obvious advantages during the initial 36 h.

Implementation System of Human Eye Tracking Algorithm Based on FPGA

With the high-speed development of transportation industry,highway traffic safety has become a considerable problem.Meanwhile,with the development of embedded system and hardware chip,in recent years,human eye detection eye tracking and positioning technology have been more and more widely used in man-machine interaction,security access control and visual detection.In this paper,the high parallelism of FPGA was utilized to realize an elliptical approximate real-time human eye tracking system,which was achieved by the series register structure and random sample consensus(RANSAC),thus improving the speed of image processing without using external memory.Because eye images acquired by the camera often generate a lot of noises due to uneven light and dark background,the preprocessing technologies such as color conversion,image filtering,histogram modification and image sharpening were adopted.In terms of feature extraction of images,the eye tracking algorithm in this paper adopted seven-section rectangular eye tracking characteristic method,which increased a section between the mouth and the nose on the basis of the traditional six-section method,so its recognition accuracy is much higher.It is convenient for the realization of hardware parallel system in FPGA.Finally,aiming at the accuracy and real-time performance of the design system,a more comprehensive simulation test was carried out.The human eye tracking system was verified on DE2-115 multimedia development platform,and the performance of VGA(resolution:640×480)images of 8-bit grayscale was tested.The results showed that the detection speed of this system was about 47 frames per second under the condition that the detection rate of human face(front face,no inclination)was 93%,which reached the real-time detection level.Additionally,the accuracy of eye tracking based on FPGA system was more than 95%,and it has achieved ideal results in real-time performance and robustness.

Real-Time Iterative Compensation Framework for Precision Mechatronic Motion Control Systems

With regard to precision/ultra-precision motion systems,it is important to achieve excellent tracking performance for various trajectory tracking tasks even under uncertain external disturbances.In this paper,to overcome the limitation of robustness to trajectory variations and external disturbances in offline feedforward compensation strategies such as iterative learning control(ILC),a novel real-time iterative compensation(RIC)control framework is proposed for precision motion systems without changing the inner closed-loop controller.Specifically,the RIC method can be divided into two parts,i.e.,accurate model prediction and real-time iterative compensation.An accurate prediction model considering lumped disturbances is firstly established to predict tracking errors at future sampling times.In light of predicted errors,a feedforward compensation term is developed to modify the following reference trajectory by real-time iterative calculation.Both the prediction and compen-sation processes are finished in a real-time motion control sampling period.The stability and convergence of the entire control system after real-time iterative compensation is analyzed for different conditions.Various simulation results consistently demonstrate that the proposed RIC framework possesses satisfactory dynamic regulation capability,which contributes to high tracking accuracy comparable to ILC or even better and strong robustness.

Real-time lane departure warning system based on principal component analysis of grayscale distribution and risk evaluation model

A technology for unintended lane departure warning was proposed. As crucial information, lane boundaries were detected based on principal component analysis of grayscale distribution in search bars of given number and then each search bar was tracked using Kalman filter between frames. The lane detection performance was evaluated and demonstrated in ways of receiver operating characteristic, dice similarity coefficient and real-time performance. For lane departure detection, a lane departure risk evaluation model based on lasting time and frequency was effectively executed on the ARM-based platform. Experimental results indicate that the algorithm generates satisfactory lane detection results under different traffic and lighting conditions, and the proposed warning mechanism sends effective warning signals, avoiding most false warning.