This paper presents an urban expressway video surveillance and monitoring system for traffic flow measurement and abnormal performance detection. The proposed flow detection module collects traffic flow statistics in ...This paper presents an urban expressway video surveillance and monitoring system for traffic flow measurement and abnormal performance detection. The proposed flow detection module collects traffic flow statistics in real time by leveraging multi-vehicle tracking information. Based on these online statistics, road operating situations can be easily obtained. Using spatiotemporal trajectories, vehicle motion paths are encoded by hidden Markov models. With path division and parameter matching, abnormal performances containing extra low or high speed driving, illegal stopping and turning are detected in real scenes. The traffic surveillance approach is implemented and evaluated on a DM642 DSP-based embedded platform. Experimental results demonstrate that the proposed system is feasible for the detection of vehicle speed, vehicle counts and road efficiency, and it is effective for the monitoring of the aforementioned anomalies with low computational costs.展开更多
In this paper,based on the field-programmable gate array(FPGA)xc5vlx220 of Xilinx Company,the FPGA verification method for application specific integrated circuit(ASIC)design is introduced.Firstly,the basic principles...In this paper,based on the field-programmable gate array(FPGA)xc5vlx220 of Xilinx Company,the FPGA verification method for application specific integrated circuit(ASIC)design is introduced.Firstly,the basic principles of FPGA verification are introduced.Then,the structure of the FPGA board and the verification methods are illustrated.Finally,the workflow of FPGA verification for audio video coding standard(AVS)decoder and the method of restoring images are introduced in detail.The FPGA resources occupancy is shown and analyzed.The result shows that FPGA can verify the ASIC rapidly and effectively so as to shorten the development cycle.展开更多
The growing number of mobile users, as well as the diversification in types of services have resulted in increasing demands for wireless network bandwidth in recent years. Although evolving transmission techniques are...The growing number of mobile users, as well as the diversification in types of services have resulted in increasing demands for wireless network bandwidth in recent years. Although evolving transmission techniques are able to enlarge the network capacity to some degree, they still cannot satisfy the requirements of mobile users. Meanwhile, following Moore's Law, the data processing capabilities of mobile user terminals are continuously improving. In this paper, we explore possible methods of trading strong computational power at wireless terminals for transmission efficiency of communications. Taking the specific scenario of wireless video conversation, we propose a model-based video coding scheme by learning the structures in multimedia contents. Benefiting from both strong computing capability and pre-learned model priors, only low-dimensional parameters need to be transmitted; and the intact multimedia contents can also be reconstructed at the receivers in real-time. Experiment results indicate that, compared to conventional video codecs, the proposed scheme significantly reduces the data rate with the aid of computational capability at wireless terminals.展开更多
It is difficult to detect dissolve accurately in video segmentation. Two new parameters AEI and IDM are computed to describe dissolve. An improved method based on the change curves of AEI and IDM is proposed to detect...It is difficult to detect dissolve accurately in video segmentation. Two new parameters AEI and IDM are computed to describe dissolve. An improved method based on the change curves of AEI and IDM is proposed to detect dissolve accurately. The experiments show that this method can detect dissolve accurately.展开更多
Wyner-Ziv Video Coding (WZVC) is considered as a promising video coding scheme for Wireless Video Sensor Networks (WVSNs) due to its high compression efficiency and error resilience functionalities, as well as its...Wyner-Ziv Video Coding (WZVC) is considered as a promising video coding scheme for Wireless Video Sensor Networks (WVSNs) due to its high compression efficiency and error resilience functionalities, as well as its low encoding complex- ity. To achieve a good Rate-Distortion (R-D) per- formance, the current WZVC paradi^prls usually a- dopt an end-to-end rate control scheme in which the decoder repeatedly requests the additional deco- ding data from the encoder for decoding Wyner-Ziv frames. Therefore, the waiting time of the additional decoding data is especially long in multihop WVSNs. In this paper, we propose a novel pro- gressive in-network rate control scheme for WZVC. The proposed in-network puncturing-based rate control scheme transfers the partial channel codes puncturing task from the encoder to the relay nodes. Then, the decoder can request the addition- al decoding data from the relay nodes instead of the encoder, and the total waiting time for deco- ding Wyner-Ziv frames is reduced consequently. Simulation results validate the proposed rate con- trol scheme.展开更多
Side information (SI) is one of the key issues in distributed video coding (DVC) and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv (WZ...Side information (SI) is one of the key issues in distributed video coding (DVC) and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv (WZ) frame is split into two parts based on checkerboard pattern, and the two parts are encoded independently but decoded sequentially. In the decoding process, the part 1 is first decoded with the initial SI and partially decoded part (PDP) 1 is used to improve the motion vectors (MVs) and SI of both parts. At the next stage, the part 2 is decoded with the improved SI and PDP 2 is used to further refine MVs of the part 2. Then, SI of both parts are further refined. Simulation results show that the proposed algorithm can improve the peak signal to noise ratio (PSNR) by up to 1.43 dB when compared with traditional DVC codec.展开更多
A new depth resampling for multi-view coding is proposed in this paper.At first,the depth video is downsampled by median filtering before encoding.After decoding,the classified edges,including credible edge and probab...A new depth resampling for multi-view coding is proposed in this paper.At first,the depth video is downsampled by median filtering before encoding.After decoding,the classified edges,including credible edge and probable edge from the aligned texture image and the depth image,are interpolated by the selected diagonal pair,whose intensity difference is the minimum among four diagonal pairs around edge pixel.According to different category of edge,the intensity difference is measured by either real depth or percentage depth without any parameter setting.Finally,the resampled depth video and the decoded full-resolution texture video are synthesized into virtual views for the performance evaluation.Experiments on the platform of multi-view high efficiency video coding(HEVC) demonstrate that the proposed method is superior to the contrastive methods in terms of visual quality and rate distortion(RD) performance.展开更多
基金The National Key Technology R&D Program of China during the 11th Five-Year Plan Period(No.2009BAG13A04)Jiangsu Transportation Science Research Program(No.08X09)Program of Suzhou Science and Technology(No.SG201076)
文摘This paper presents an urban expressway video surveillance and monitoring system for traffic flow measurement and abnormal performance detection. The proposed flow detection module collects traffic flow statistics in real time by leveraging multi-vehicle tracking information. Based on these online statistics, road operating situations can be easily obtained. Using spatiotemporal trajectories, vehicle motion paths are encoded by hidden Markov models. With path division and parameter matching, abnormal performances containing extra low or high speed driving, illegal stopping and turning are detected in real scenes. The traffic surveillance approach is implemented and evaluated on a DM642 DSP-based embedded platform. Experimental results demonstrate that the proposed system is feasible for the detection of vehicle speed, vehicle counts and road efficiency, and it is effective for the monitoring of the aforementioned anomalies with low computational costs.
基金Science and Technology Key Project of Guangzhou(2007Z3-D3101)Production and Research Project of Zhuhai(PC20082002)Technology Innovation Project of Guangdong Province(2008778113)
文摘In this paper,based on the field-programmable gate array(FPGA)xc5vlx220 of Xilinx Company,the FPGA verification method for application specific integrated circuit(ASIC)design is introduced.Firstly,the basic principles of FPGA verification are introduced.Then,the structure of the FPGA board and the verification methods are illustrated.Finally,the workflow of FPGA verification for audio video coding standard(AVS)decoder and the method of restoring images are introduced in detail.The FPGA resources occupancy is shown and analyzed.The result shows that FPGA can verify the ASIC rapidly and effectively so as to shorten the development cycle.
基金supported by the National Basic Research Project of China (973) (2013CB329006)National Natural Science Foundation of China (NSFC, 61101071,61471220, 61021001)Tsinghua University Initiative Scientific Research Program
文摘The growing number of mobile users, as well as the diversification in types of services have resulted in increasing demands for wireless network bandwidth in recent years. Although evolving transmission techniques are able to enlarge the network capacity to some degree, they still cannot satisfy the requirements of mobile users. Meanwhile, following Moore's Law, the data processing capabilities of mobile user terminals are continuously improving. In this paper, we explore possible methods of trading strong computational power at wireless terminals for transmission efficiency of communications. Taking the specific scenario of wireless video conversation, we propose a model-based video coding scheme by learning the structures in multimedia contents. Benefiting from both strong computing capability and pre-learned model priors, only low-dimensional parameters need to be transmitted; and the intact multimedia contents can also be reconstructed at the receivers in real-time. Experiment results indicate that, compared to conventional video codecs, the proposed scheme significantly reduces the data rate with the aid of computational capability at wireless terminals.
文摘It is difficult to detect dissolve accurately in video segmentation. Two new parameters AEI and IDM are computed to describe dissolve. An improved method based on the change curves of AEI and IDM is proposed to detect dissolve accurately. The experiments show that this method can detect dissolve accurately.
基金This paper was supported by the National Key Basic Re- search Program of China under Grant No. 2011 CB302701 the National Natural Science Foundation of China under Grants No. 60833009, No. 61133015+2 种基金 the China National Funds for Distinguished Young Scientists under Grant No. 60925010 the Funds for Creative Research Groups of China under Grant No. 61121001 the Program for Changjiang Scholars and Innovative Research Team in University under Grant No. IRT1049.
文摘Wyner-Ziv Video Coding (WZVC) is considered as a promising video coding scheme for Wireless Video Sensor Networks (WVSNs) due to its high compression efficiency and error resilience functionalities, as well as its low encoding complex- ity. To achieve a good Rate-Distortion (R-D) per- formance, the current WZVC paradi^prls usually a- dopt an end-to-end rate control scheme in which the decoder repeatedly requests the additional deco- ding data from the encoder for decoding Wyner-Ziv frames. Therefore, the waiting time of the additional decoding data is especially long in multihop WVSNs. In this paper, we propose a novel pro- gressive in-network rate control scheme for WZVC. The proposed in-network puncturing-based rate control scheme transfers the partial channel codes puncturing task from the encoder to the relay nodes. Then, the decoder can request the addition- al decoding data from the relay nodes instead of the encoder, and the total waiting time for deco- ding Wyner-Ziv frames is reduced consequently. Simulation results validate the proposed rate con- trol scheme.
基金Supported by the National Natural Science Foundation of China ( No. 60736043, 60672088) and the National Basic Research Program of China (No. 2009CB32005).
文摘Side information (SI) is one of the key issues in distributed video coding (DVC) and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv (WZ) frame is split into two parts based on checkerboard pattern, and the two parts are encoded independently but decoded sequentially. In the decoding process, the part 1 is first decoded with the initial SI and partially decoded part (PDP) 1 is used to improve the motion vectors (MVs) and SI of both parts. At the next stage, the part 2 is decoded with the improved SI and PDP 2 is used to further refine MVs of the part 2. Then, SI of both parts are further refined. Simulation results show that the proposed algorithm can improve the peak signal to noise ratio (PSNR) by up to 1.43 dB when compared with traditional DVC codec.
基金supported by the National Natural Science Foundation of China(Nos.61401132 and 61372157)the Zhejiang Provincial Natural Science Foundation of China(No.LY12F01007)
文摘A new depth resampling for multi-view coding is proposed in this paper.At first,the depth video is downsampled by median filtering before encoding.After decoding,the classified edges,including credible edge and probable edge from the aligned texture image and the depth image,are interpolated by the selected diagonal pair,whose intensity difference is the minimum among four diagonal pairs around edge pixel.According to different category of edge,the intensity difference is measured by either real depth or percentage depth without any parameter setting.Finally,the resampled depth video and the decoded full-resolution texture video are synthesized into virtual views for the performance evaluation.Experiments on the platform of multi-view high efficiency video coding(HEVC) demonstrate that the proposed method is superior to the contrastive methods in terms of visual quality and rate distortion(RD) performance.