This paper presents an urban expressway video surveillance and monitoring system for traffic flow measurement and abnormal performance detection. The proposed flow detection module collects traffic flow statistics in ...This paper presents an urban expressway video surveillance and monitoring system for traffic flow measurement and abnormal performance detection. The proposed flow detection module collects traffic flow statistics in real time by leveraging multi-vehicle tracking information. Based on these online statistics, road operating situations can be easily obtained. Using spatiotemporal trajectories, vehicle motion paths are encoded by hidden Markov models. With path division and parameter matching, abnormal performances containing extra low or high speed driving, illegal stopping and turning are detected in real scenes. The traffic surveillance approach is implemented and evaluated on a DM642 DSP-based embedded platform. Experimental results demonstrate that the proposed system is feasible for the detection of vehicle speed, vehicle counts and road efficiency, and it is effective for the monitoring of the aforementioned anomalies with low computational costs.展开更多
High resolution cameras and multi camera systems are being used in areas of video surveillance like security of public places, traffic monitoring, and military and satellite imaging. This leads to a demand for computa...High resolution cameras and multi camera systems are being used in areas of video surveillance like security of public places, traffic monitoring, and military and satellite imaging. This leads to a demand for computational algorithms for real time processing of high resolution videos. Motion detection and background separation play a vital role in capturing the object of interest in surveillance videos, but as we move towards high resolution cameras, the time-complexity of the algorithm increases and thus fails to be a part of real time systems. Parallel architecture provides a surpass platform to work efficiently with complex algorithmic solutions. In this work, a method was proposed for identifying the moving objects perfectly in the videos using adaptive background making, motion detection and object estimation. The pre-processing part includes an adaptive block background making model and a dynamically adaptive thresholding technique to estimate the moving objects. The post processing includes a competent parallel connected component labelling algorithm to estimate perfectly the objects of interest. New parallel processing strategies are developed on each stage of the algorithm to reduce the time-complexity of the system. This algorithm has achieved a average speedup of 12.26 times for lower resolution video frames(320×240, 720×480, 1024×768) and 7.30 times for higher resolution video frames(1360×768, 1920×1080, 2560×1440) on GPU, which is superior to CPU processing. Also, this algorithm was tested by changing the number of threads in a thread block and the minimum execution time has been achieved for 16×16 thread block. And this algorithm was tested on a night sequence where the amount of light in the scene is very less and still the algorithm has given a significant speedup and accuracy in determining the object.展开更多
The design and assembly of environmental monitoring and control system for large-scale pig house with fermentation bed helped to solve the problem of environmental automatic control in piggery.The sensors would monito...The design and assembly of environmental monitoring and control system for large-scale pig house with fermentation bed helped to solve the problem of environmental automatic control in piggery.The sensors would monitor the temperature,humidity,light,wind direction,wind speed,CO2,NH3and other parameters.On-line real-time data collection was achieved.The expert system was constructed to control the temperature in piggery below 30℃,to control the air and mattress humidities higher than 65%.Under the conditions of different season or different wind speed,even in day and night,the control actuators were different.The actuators included fanning wet curtain,lighting,micro spraying,spraying,propeller fan,electric aluminum alloy shutter and spraying systems on the roof.The actuators were integrated,and they control the piggery environment simultaneously.The system also designed the remote video monitor interface,parameter-monitoring curved interface and operation interface,which provided a good man-machine interface.展开更多
Foreground detection is a fundamental step in visual surveillance.However,accurate foreground detection is still a challenging task especially in dynamic backgrounds.In this paper,we present a nonparametric approach t...Foreground detection is a fundamental step in visual surveillance.However,accurate foreground detection is still a challenging task especially in dynamic backgrounds.In this paper,we present a nonparametric approach to foreground detection in dynamic backgrounds.It uses a history of recently pixel values to estimate background model.Besides,the adaptive threshold and spatial coherence are introduced to enhance robustness against false detections.Experimental results indicate that our approach achieves better performance in dynamic backgrounds compared with several approaches.展开更多
In order to improve the intelligence of video monitoring system of belt and make up the deficiency of higher failure rate and bad real-time performance in the traditional systems of measurement of belt speed, accordin...In order to improve the intelligence of video monitoring system of belt and make up the deficiency of higher failure rate and bad real-time performance in the traditional systems of measurement of belt speed, according to the fact that the light of coal mine is uneven, the strength of light changes greatly, the direction of belt movement is constant, and the position of camera was fixed, various algorithms of speed measurement by video were studied, and algorithm for template matching based on sum of absolute differences (SAD) and correlation coefficient was proposed and improved, besides, the tracking of feature regions was realized. Then, a camera calibration method using the invariance of the cross-ratio was adopted and the real-time measurement of belt speed by the hardware platform based on DM642 was realized. Finally, experiment results show that this method not only has advantages of high precision and strong anti-jamming capability but also can real-time reflect the changes of belt speed, so it has a comprehensive applicability.展开更多
Resource allocation is an important problem in ubiquitous network. Most of the existing resource allocation methods considering only wireless networks are not suitable for the ubiquitous network environment, and they ...Resource allocation is an important problem in ubiquitous network. Most of the existing resource allocation methods considering only wireless networks are not suitable for the ubiquitous network environment, and they will harm the interest of individual users with instable resource requirements. This paper considers the multi-point video surveillance scenarios in a complex network environment with both wired and wireless networks. We introduce the utility estimated by the total costs of an individual network user. The problem is studied through mathematical modeling and we propose an improved problem-specific branch-and-cut algorithm to solve it. The algorithm follows the divide-and-conquer principle and fully considers the duality feature of network selection. The experiment is conducted by simulation through C and Lingo. And it shows that compared with a centralized random allocation scheme and a cost greed allocation scheme, the proposed scheme has better per- formance of reducing the total costs by 13.0% and 30.6% respectively for the user.展开更多
Foreground detection methods can be applied to efficiently distinguish foreground objects including moving or static objects from back- ground which is very important in the application of video analysis, especially v...Foreground detection methods can be applied to efficiently distinguish foreground objects including moving or static objects from back- ground which is very important in the application of video analysis, especially video surveillance. An excellent background model can obtain a good foreground detection results. A lot of background modeling methods had been proposed, but few comprehensive evaluations of them are available. These methods suffer from various challenges such as illumination changes and dynamic background. This paper first analyzed advantages and disadvantages of various background modeling methods in video analysis applications and then compared their performance in terms of quality and the computational cost. The Change detection.Net (CDnet2014) dataset and another video dataset with different envi- ronmental conditions (indoor, outdoor, snow) were used to test each method. The experimental results sufficiently demonstrated the strengths and drawbacks of traditional and recently proposed state-of-the-art background modeling methods. This work is helpful for both researchers and engineering practitioners. Codes of background modeling methods evaluated in this paper are available atwww.yongxu.org/lunwen.html.展开更多
Detecting objects of interest from a video sequence is a fundamental and critical task in automated visual surveillance. Most current approaches only focus on discriminating moving objects by background subtraction wh...Detecting objects of interest from a video sequence is a fundamental and critical task in automated visual surveillance. Most current approaches only focus on discriminating moving objects by background subtraction whether or not the objects of interest can be moving or stationary. In this paper, we propose layers segmentation to detect both moving and stationary target objects from surveillance video. We extend the Maximum Entropy (ME) statistical model to segment layers with features, which are collected by constructing a codebook with a set of codewords for each pixel. We also indicate how the training models are used for the discrimination of target objects in surveillance video. Our experimental results are presented in terms of the success rate and the segmenting precision.展开更多
For intelligent transportation surveillance, a novel background model based on Mart wavelet kernel and a background subtraction technique based on binary discrete wavelet transforms were introduced. The background mod...For intelligent transportation surveillance, a novel background model based on Mart wavelet kernel and a background subtraction technique based on binary discrete wavelet transforms were introduced. The background model kept a sample of intensity values for each pixel in the image and used this sample to estimate the probability density function of the pixel intensity. The density function was estimated using a new Marr wavelet kernel density estimation technique. Since this approach was quite general, the model could approximate any distribution for the pixel intensity without any assumptions about the underlying distribution shape. The background and current frame were transformed in the binary discrete wavelet domain, and background subtraction was performed in each sub-band. After obtaining the foreground, shadow was eliminated by an edge detection method. Experimental results show that the proposed method produces good results with much lower computational complexity and effectively extracts the moving objects with accuracy ratio higher than 90%, indicating that the proposed method is an effective algorithm for intelligent transportation system.展开更多
This study proposes a motion cue based pedestrian detection method with two-trame-filtering (Tff) for video surveillance. The novel motion cue is exploited by the gray value variation between two frames. Then Tff pr...This study proposes a motion cue based pedestrian detection method with two-trame-filtering (Tff) for video surveillance. The novel motion cue is exploited by the gray value variation between two frames. Then Tff processing filters the gradient magnitude image by the variation map. Summa- tions of the Tff gradient magnitudes in cells are applied to train a pre-deteetor to exclude most of the background regions. Histogram of Tff oriented gradient (HTffOG) feature is proposed for pedestrian detection. Experimental results show that this method is effective and suitable for real-time surveil- lance applications.展开更多
Video synopsis is an effective and innovative way to produce short video abstraction for huge video archives,while keeping the dynamic characteristic of activities in the original video.Abnormal activity,as the critic...Video synopsis is an effective and innovative way to produce short video abstraction for huge video archives,while keeping the dynamic characteristic of activities in the original video.Abnormal activity,as the critical event,is always the main concern in video surveillance context.However,in traditional video synopsis,all the normal and abnormal activities are condensed together equally,which can make the synopsis video confused and worthless.In addition,the traditional video synopsis methods always neglect redundancy in the content domain.To solve the above-mentioned issues,a novel video synopsis method is proposed based on abnormal activity detection and key observation selection.In the proposed algorithm,activities are classified into normal and abnormal ones based on the sparse reconstruction cost from an atomically learned activity dictionary.And key observation selection using the minimum description length principle is conducted for eliminating content redundancy in normal activity.Experiments conducted in publicly available datasets demonstrate that the proposed approach can effectively generate satisfying synopsis videos.展开更多
In accordance with the application requirements of high definition(HD) video surveillance systems,a real-time 5/3 lifting wavelet HD-video de-noising system is proposed with frame rate conversion(FRC) based on a field...In accordance with the application requirements of high definition(HD) video surveillance systems,a real-time 5/3 lifting wavelet HD-video de-noising system is proposed with frame rate conversion(FRC) based on a field-programmable gate array(FPGA),which uses a 3-level pipeline paralleled 5/3 lifting wavelet transformation and reconstruction structure,as well as a fast BayesS hrink adaptive threshold filtering module.The proposed system demonstrates de-noising performance,while also balancing system resources and achieving real-time processing.The experiments show that the proposed system's maximum operating frequency(through logic synthesis and layout using Quartus 13.1 software) can reach 178 MHz,based on the Altera Company's Stratix III EP3SE80 series FPGA.The proposed system can also satisfy real-time de-noising requirements of 1920 × 1080 at60 fps HD-video sources,while also significantly improving the peak signal to noise rate of the denoising images.Compared with similar systems,the system has the advantages of high operating frequency,and the ability to support multiple source formats for real-time processing.展开更多
基金The National Key Technology R&D Program of China during the 11th Five-Year Plan Period(No.2009BAG13A04)Jiangsu Transportation Science Research Program(No.08X09)Program of Suzhou Science and Technology(No.SG201076)
文摘This paper presents an urban expressway video surveillance and monitoring system for traffic flow measurement and abnormal performance detection. The proposed flow detection module collects traffic flow statistics in real time by leveraging multi-vehicle tracking information. Based on these online statistics, road operating situations can be easily obtained. Using spatiotemporal trajectories, vehicle motion paths are encoded by hidden Markov models. With path division and parameter matching, abnormal performances containing extra low or high speed driving, illegal stopping and turning are detected in real scenes. The traffic surveillance approach is implemented and evaluated on a DM642 DSP-based embedded platform. Experimental results demonstrate that the proposed system is feasible for the detection of vehicle speed, vehicle counts and road efficiency, and it is effective for the monitoring of the aforementioned anomalies with low computational costs.
文摘High resolution cameras and multi camera systems are being used in areas of video surveillance like security of public places, traffic monitoring, and military and satellite imaging. This leads to a demand for computational algorithms for real time processing of high resolution videos. Motion detection and background separation play a vital role in capturing the object of interest in surveillance videos, but as we move towards high resolution cameras, the time-complexity of the algorithm increases and thus fails to be a part of real time systems. Parallel architecture provides a surpass platform to work efficiently with complex algorithmic solutions. In this work, a method was proposed for identifying the moving objects perfectly in the videos using adaptive background making, motion detection and object estimation. The pre-processing part includes an adaptive block background making model and a dynamically adaptive thresholding technique to estimate the moving objects. The post processing includes a competent parallel connected component labelling algorithm to estimate perfectly the objects of interest. New parallel processing strategies are developed on each stage of the algorithm to reduce the time-complexity of the system. This algorithm has achieved a average speedup of 12.26 times for lower resolution video frames(320×240, 720×480, 1024×768) and 7.30 times for higher resolution video frames(1360×768, 1920×1080, 2560×1440) on GPU, which is superior to CPU processing. Also, this algorithm was tested by changing the number of threads in a thread block and the minimum execution time has been achieved for 16×16 thread block. And this algorithm was tested on a night sequence where the amount of light in the scene is very less and still the algorithm has given a significant speedup and accuracy in determining the object.
基金Supported by Special Fund for Agro-scientific Research in the Public Interest(201303094)International Science and Technology Cooperation Project of China(2012DFA31120)National Key Technology Research and Development Program(2012BAD14B15)
文摘The design and assembly of environmental monitoring and control system for large-scale pig house with fermentation bed helped to solve the problem of environmental automatic control in piggery.The sensors would monitor the temperature,humidity,light,wind direction,wind speed,CO2,NH3and other parameters.On-line real-time data collection was achieved.The expert system was constructed to control the temperature in piggery below 30℃,to control the air and mattress humidities higher than 65%.Under the conditions of different season or different wind speed,even in day and night,the control actuators were different.The actuators included fanning wet curtain,lighting,micro spraying,spraying,propeller fan,electric aluminum alloy shutter and spraying systems on the roof.The actuators were integrated,and they control the piggery environment simultaneously.The system also designed the remote video monitor interface,parameter-monitoring curved interface and operation interface,which provided a good man-machine interface.
基金supported by Fund of National Science & Technology monumental projects under Grants No.61105015,NO.61401239,NO.2012-364-641-209
文摘Foreground detection is a fundamental step in visual surveillance.However,accurate foreground detection is still a challenging task especially in dynamic backgrounds.In this paper,we present a nonparametric approach to foreground detection in dynamic backgrounds.It uses a history of recently pixel values to estimate background model.Besides,the adaptive threshold and spatial coherence are introduced to enhance robustness against false detections.Experimental results indicate that our approach achieves better performance in dynamic backgrounds compared with several approaches.
文摘In order to improve the intelligence of video monitoring system of belt and make up the deficiency of higher failure rate and bad real-time performance in the traditional systems of measurement of belt speed, according to the fact that the light of coal mine is uneven, the strength of light changes greatly, the direction of belt movement is constant, and the position of camera was fixed, various algorithms of speed measurement by video were studied, and algorithm for template matching based on sum of absolute differences (SAD) and correlation coefficient was proposed and improved, besides, the tracking of feature regions was realized. Then, a camera calibration method using the invariance of the cross-ratio was adopted and the real-time measurement of belt speed by the hardware platform based on DM642 was realized. Finally, experiment results show that this method not only has advantages of high precision and strong anti-jamming capability but also can real-time reflect the changes of belt speed, so it has a comprehensive applicability.
基金Supported by the National Science and Technology Major Project (No.2011ZX03005-004-04)the National Grand Fundamental Research 973 Program of China (No.2011CB302-905)+2 种基金the National Natural Science Foundation of China (No.61170058,61272133,and 51274202)the Research Fund for the Doctoral Program of Higher Education of China (No.20103402110041)the Suzhou Fundamental Research Project (No.SYG201143)
文摘Resource allocation is an important problem in ubiquitous network. Most of the existing resource allocation methods considering only wireless networks are not suitable for the ubiquitous network environment, and they will harm the interest of individual users with instable resource requirements. This paper considers the multi-point video surveillance scenarios in a complex network environment with both wired and wireless networks. We introduce the utility estimated by the total costs of an individual network user. The problem is studied through mathematical modeling and we propose an improved problem-specific branch-and-cut algorithm to solve it. The algorithm follows the divide-and-conquer principle and fully considers the duality feature of network selection. The experiment is conducted by simulation through C and Lingo. And it shows that compared with a centralized random allocation scheme and a cost greed allocation scheme, the proposed scheme has better per- formance of reducing the total costs by 13.0% and 30.6% respectively for the user.
文摘Foreground detection methods can be applied to efficiently distinguish foreground objects including moving or static objects from back- ground which is very important in the application of video analysis, especially video surveillance. An excellent background model can obtain a good foreground detection results. A lot of background modeling methods had been proposed, but few comprehensive evaluations of them are available. These methods suffer from various challenges such as illumination changes and dynamic background. This paper first analyzed advantages and disadvantages of various background modeling methods in video analysis applications and then compared their performance in terms of quality and the computational cost. The Change detection.Net (CDnet2014) dataset and another video dataset with different envi- ronmental conditions (indoor, outdoor, snow) were used to test each method. The experimental results sufficiently demonstrated the strengths and drawbacks of traditional and recently proposed state-of-the-art background modeling methods. This work is helpful for both researchers and engineering practitioners. Codes of background modeling methods evaluated in this paper are available atwww.yongxu.org/lunwen.html.
基金Project supported by the National Natural Science Foundation of China (No. 60272031), and Technology Plan Program of ZhejiangProvince (No. 2003C21010), and Zhejiang Provincial Natural Sci-ence Foundation of China (No. M603202)
文摘Detecting objects of interest from a video sequence is a fundamental and critical task in automated visual surveillance. Most current approaches only focus on discriminating moving objects by background subtraction whether or not the objects of interest can be moving or stationary. In this paper, we propose layers segmentation to detect both moving and stationary target objects from surveillance video. We extend the Maximum Entropy (ME) statistical model to segment layers with features, which are collected by constructing a codebook with a set of codewords for each pixel. We also indicate how the training models are used for the discrimination of target objects in surveillance video. Our experimental results are presented in terms of the success rate and the segmenting precision.
基金Project(60772080) supported by the National Natural Science Foundation of ChinaProject(3240120) supported by Tianjin Subway Safety System, Honeywell Limited, China
文摘For intelligent transportation surveillance, a novel background model based on Mart wavelet kernel and a background subtraction technique based on binary discrete wavelet transforms were introduced. The background model kept a sample of intensity values for each pixel in the image and used this sample to estimate the probability density function of the pixel intensity. The density function was estimated using a new Marr wavelet kernel density estimation technique. Since this approach was quite general, the model could approximate any distribution for the pixel intensity without any assumptions about the underlying distribution shape. The background and current frame were transformed in the binary discrete wavelet domain, and background subtraction was performed in each sub-band. After obtaining the foreground, shadow was eliminated by an edge detection method. Experimental results show that the proposed method produces good results with much lower computational complexity and effectively extracts the moving objects with accuracy ratio higher than 90%, indicating that the proposed method is an effective algorithm for intelligent transportation system.
基金Supported by the National High Technology Research and Development Program of China(No.2007AA01Z164)the National Natural Science Foundation of China(No.61273258)
文摘This study proposes a motion cue based pedestrian detection method with two-trame-filtering (Tff) for video surveillance. The novel motion cue is exploited by the gray value variation between two frames. Then Tff processing filters the gradient magnitude image by the variation map. Summa- tions of the Tff gradient magnitudes in cells are applied to train a pre-deteetor to exclude most of the background regions. Histogram of Tff oriented gradient (HTffOG) feature is proposed for pedestrian detection. Experimental results show that this method is effective and suitable for real-time surveil- lance applications.
基金Supported by the National Natural Science Foundation of China(No.61402023)Beijing Technology and Business' University Youth Fund(No.QNJJ2014-23)Beijing Natural Science Foundation(No.4162019)
文摘Video synopsis is an effective and innovative way to produce short video abstraction for huge video archives,while keeping the dynamic characteristic of activities in the original video.Abnormal activity,as the critical event,is always the main concern in video surveillance context.However,in traditional video synopsis,all the normal and abnormal activities are condensed together equally,which can make the synopsis video confused and worthless.In addition,the traditional video synopsis methods always neglect redundancy in the content domain.To solve the above-mentioned issues,a novel video synopsis method is proposed based on abnormal activity detection and key observation selection.In the proposed algorithm,activities are classified into normal and abnormal ones based on the sparse reconstruction cost from an atomically learned activity dictionary.And key observation selection using the minimum description length principle is conducted for eliminating content redundancy in normal activity.Experiments conducted in publicly available datasets demonstrate that the proposed approach can effectively generate satisfying synopsis videos.
基金Supported by the Spark Program of China(No.2013GA780007)Key Scientific Research Project of Guandong Agriculture Industry Business Polytechnic(No.xyzd1604)
文摘In accordance with the application requirements of high definition(HD) video surveillance systems,a real-time 5/3 lifting wavelet HD-video de-noising system is proposed with frame rate conversion(FRC) based on a field-programmable gate array(FPGA),which uses a 3-level pipeline paralleled 5/3 lifting wavelet transformation and reconstruction structure,as well as a fast BayesS hrink adaptive threshold filtering module.The proposed system demonstrates de-noising performance,while also balancing system resources and achieving real-time processing.The experiments show that the proposed system's maximum operating frequency(through logic synthesis and layout using Quartus 13.1 software) can reach 178 MHz,based on the Altera Company's Stratix III EP3SE80 series FPGA.The proposed system can also satisfy real-time de-noising requirements of 1920 × 1080 at60 fps HD-video sources,while also significantly improving the peak signal to noise rate of the denoising images.Compared with similar systems,the system has the advantages of high operating frequency,and the ability to support multiple source formats for real-time processing.