Super-Resolution (SR) technique means to reconstruct High-Resolution (HR) images from a sequence of Low-Resolution (LR) observations,which has been a great focus for compressed video. Based on the theory of Projection...Super-Resolution (SR) technique means to reconstruct High-Resolution (HR) images from a sequence of Low-Resolution (LR) observations,which has been a great focus for compressed video. Based on the theory of Projection Onto Convex Set (POCS),this paper constructs Quantization Constraint Set (QCS) using the quantization information extracted from the video bit stream. By combining the statistical properties of image and the Human Visual System (HVS),a novel Adaptive Quantization Constraint Set (AQCS) is proposed. Simulation results show that AQCS-based SR al-gorithm converges at a fast rate and obtains better performance in both objective and subjective quality,which is applicable for compressed video.展开更多
Rate control plays an important role in video coding. An algorithm is proposed by Tsai et al in which macroblock’s coding order is rearranged to improve the coding quality. However, the complexity is very high due to...Rate control plays an important role in video coding. An algorithm is proposed by Tsai et al in which macroblock’s coding order is rearranged to improve the coding quality. However, the complexity is very high due to the change of macroblock’s coding order. In this paper, a macroblocl-level rate control algorithm is proposed which recalculates the quantization parameter of each macroblock based on its significance. Simulation results show that the proposed algorithm not only achieves 0.1-0.6 dB in peak signal-to-noise ratio (PSNR) but also reduces 33%-55% total encoding time compared to Tsai’s algorithm.展开更多
This paper presents a quantization skipping method for H. 264/AVC video coding standard. In order to reduce the conputational-cost of quantization process coming from integer discrete cosine transform of H. 264/AVC, a...This paper presents a quantization skipping method for H. 264/AVC video coding standard. In order to reduce the conputational-cost of quantization process coming from integer discrete cosine transform of H. 264/AVC, a quantization skipping condition is derived by the analysis of integer transform and quantization procedures. The expeerimental results show that the proposed algorithm has the capability to reduce the computional cost about 10% -2.5%.展开更多
AIM:To investigate the performance of a new software-based colonoscopy quality assessment system.METHODS:The software-based system employs a novel image processing algorithm which detects the levels of image clarity,w...AIM:To investigate the performance of a new software-based colonoscopy quality assessment system.METHODS:The software-based system employs a novel image processing algorithm which detects the levels of image clarity,withdrawal velocity,and level of the bowel preparation in a real-time fashion from live video signal.Threshold levels of image blurriness and the withdrawal velocity below which the visualization could be considered adequate have initially been determined arbitrarily by review of sample colonoscopy videos by two experienced endoscopists.Subsequently,an overall colonoscopy quality rating was computed based on the percentage of the withdrawal time with adequate visualization(scored 1-5;1,when the percentage was 1%-20%;2,when the percentage was 21%-40%,etc.).In order to test the proposed velocity and blurriness thresholds,screening colonoscopy withdrawal videos from a specialized ambulatory colon cancer screening center were collected,automatically processed and rated.Quality ratings on the withdrawal were compared to the insertion in the same patients.Then,3 experienced endoscopists reviewed the collected videos in a blinded fashion and rated the overall quality of each withdrawal(scored 1-5;1,poor;3,average;5,excellent) based on 3 major aspects:image quality,colon preparation,and withdrawal velocity.The automated quality ratings were compared to the averaged endoscopist quality ratings using Spearman correlation coefficient.RESULTS:Fourteen screening colonoscopies were assessed.Adenomatous polyps were detected in 4/14(29%) of the collected colonoscopy video samples.As a proof of concept,the Colometer software rated colonoscope withdrawal as having better visualization than the insertion in the 10 videos which did not have any polyps(average percent time with adequate visualization:79% ± 5% for withdrawal and 50% ± 14% for insertion,P < 0.01).Withdrawal times during which no polyps were removed ranged from 4-12 min.The median quality rating from the automated system and the reviewers was 3.45 [interquartile range(IQR),3.1-3.68] and 3.00(IQR,2.33-3.67) respectively for all colonoscopy video samples.The automated rating revealed a strong correlation with the reviewer's rating(ρ coefficient= 0.65,P = 0.01).There was good correlation of the automated overall quality rating and the mean endoscopist withdrawal speed rating(Spearman r coefficient= 0.59,P = 0.03).There was no correlation of automated overall quality rating with mean endoscopists image quality rating(Spearman r coefficient= 0.41,P = 0.15).CONCLUSION:The results from a novel automated real-time colonoscopy quality feedback system strongly agreed with the endoscopists' quality assessments.Further study is required to validate this approach.展开更多
Background modeling and subtraction is a fundamental problem in video analysis. Many algorithms have been developed to date, but there are still some challenges in complex environments, especially dynamic scenes in wh...Background modeling and subtraction is a fundamental problem in video analysis. Many algorithms have been developed to date, but there are still some challenges in complex environments, especially dynamic scenes in which backgrounds are themselves moving, such as rippling water and swaying trees. In this paper, a novel background modeling method is proposed for dynamic scenes by combining both tensor representation and swarm intelligence. We maintain several video patches, which are naturally represented as higher order tensors,to represent the patterns of background, and utilize tensor low-rank approximation to capture the dynamic nature. Furthermore, we introduce an ant colony algorithm to improve the performance. Experimental results show that the proposed method is robust and adaptive in dynamic environments, and moving objects can be perfectly separated from the complex dynamic background.展开更多
In this paper, a rate-distortion based quantization level adjustment （RDQLA） algorithm is presented. Based on the rate-distortion criterion, the quantization level adjustment algorithm effectively improves coding ef...In this paper, a rate-distortion based quantization level adjustment （RDQLA） algorithm is presented. Based on the rate-distortion criterion, the quantization level adjustment algorithm effectively improves coding efficiency by adaptively optimizing quantization levels of the signals near the boundaries of quantization cells and adjusting quantization levels per block. In addition, it has no overhead and is fully compatible with the existing compression standards. The proposed algorithm can be applied in any block based image and video coding method. In particular, the algorithm has been verified on the platform of H.264. Experimental results show that the proposed algorithm improves objective and subjective performances substantially. It is shown that the proposed algorithm has a gain of several dB comparing with the newest H.264 standard for high bit rates.展开更多
基金the Natural Science Foundation of Jiangsu Province (No.BK2004151).
文摘Super-Resolution (SR) technique means to reconstruct High-Resolution (HR) images from a sequence of Low-Resolution (LR) observations,which has been a great focus for compressed video. Based on the theory of Projection Onto Convex Set (POCS),this paper constructs Quantization Constraint Set (QCS) using the quantization information extracted from the video bit stream. By combining the statistical properties of image and the Human Visual System (HVS),a novel Adaptive Quantization Constraint Set (AQCS) is proposed. Simulation results show that AQCS-based SR al-gorithm converges at a fast rate and obtains better performance in both objective and subjective quality,which is applicable for compressed video.
文摘Rate control plays an important role in video coding. An algorithm is proposed by Tsai et al in which macroblock’s coding order is rearranged to improve the coding quality. However, the complexity is very high due to the change of macroblock’s coding order. In this paper, a macroblocl-level rate control algorithm is proposed which recalculates the quantization parameter of each macroblock based on its significance. Simulation results show that the proposed algorithm not only achieves 0.1-0.6 dB in peak signal-to-noise ratio (PSNR) but also reduces 33%-55% total encoding time compared to Tsai’s algorithm.
基金supported by the Seoul Future Contents Convergence(SFCC)Cluster established by Seoul R&BD Program
文摘This paper presents a quantization skipping method for H. 264/AVC video coding standard. In order to reduce the conputational-cost of quantization process coming from integer discrete cosine transform of H. 264/AVC, a quantization skipping condition is derived by the analysis of integer transform and quantization procedures. The expeerimental results show that the proposed algorithm has the capability to reduce the computional cost about 10% -2.5%.
基金Supported by The Natural Sciences and Engineering Research Council of Canada (Partially)
文摘AIM:To investigate the performance of a new software-based colonoscopy quality assessment system.METHODS:The software-based system employs a novel image processing algorithm which detects the levels of image clarity,withdrawal velocity,and level of the bowel preparation in a real-time fashion from live video signal.Threshold levels of image blurriness and the withdrawal velocity below which the visualization could be considered adequate have initially been determined arbitrarily by review of sample colonoscopy videos by two experienced endoscopists.Subsequently,an overall colonoscopy quality rating was computed based on the percentage of the withdrawal time with adequate visualization(scored 1-5;1,when the percentage was 1%-20%;2,when the percentage was 21%-40%,etc.).In order to test the proposed velocity and blurriness thresholds,screening colonoscopy withdrawal videos from a specialized ambulatory colon cancer screening center were collected,automatically processed and rated.Quality ratings on the withdrawal were compared to the insertion in the same patients.Then,3 experienced endoscopists reviewed the collected videos in a blinded fashion and rated the overall quality of each withdrawal(scored 1-5;1,poor;3,average;5,excellent) based on 3 major aspects:image quality,colon preparation,and withdrawal velocity.The automated quality ratings were compared to the averaged endoscopist quality ratings using Spearman correlation coefficient.RESULTS:Fourteen screening colonoscopies were assessed.Adenomatous polyps were detected in 4/14(29%) of the collected colonoscopy video samples.As a proof of concept,the Colometer software rated colonoscope withdrawal as having better visualization than the insertion in the 10 videos which did not have any polyps(average percent time with adequate visualization:79% ± 5% for withdrawal and 50% ± 14% for insertion,P < 0.01).Withdrawal times during which no polyps were removed ranged from 4-12 min.The median quality rating from the automated system and the reviewers was 3.45 [interquartile range(IQR),3.1-3.68] and 3.00(IQR,2.33-3.67) respectively for all colonoscopy video samples.The automated rating revealed a strong correlation with the reviewer's rating(ρ coefficient= 0.65,P = 0.01).There was good correlation of the automated overall quality rating and the mean endoscopist withdrawal speed rating(Spearman r coefficient= 0.59,P = 0.03).There was no correlation of automated overall quality rating with mean endoscopists image quality rating(Spearman r coefficient= 0.41,P = 0.15).CONCLUSION:The results from a novel automated real-time colonoscopy quality feedback system strongly agreed with the endoscopists' quality assessments.Further study is required to validate this approach.
基金supported by National Natural Science Foundation of China (Grant Nos. 11301137 and 11371036)the National Science Foundation of Hebei Province of China (Grant No. A2014205100
文摘Background modeling and subtraction is a fundamental problem in video analysis. Many algorithms have been developed to date, but there are still some challenges in complex environments, especially dynamic scenes in which backgrounds are themselves moving, such as rippling water and swaying trees. In this paper, a novel background modeling method is proposed for dynamic scenes by combining both tensor representation and swarm intelligence. We maintain several video patches, which are naturally represented as higher order tensors,to represent the patterns of background, and utilize tensor low-rank approximation to capture the dynamic nature. Furthermore, we introduce an ant colony algorithm to improve the performance. Experimental results show that the proposed method is robust and adaptive in dynamic environments, and moving objects can be perfectly separated from the complex dynamic background.
基金the Special Foundation of Outstanding Young Teacher of Shanghai
文摘In this paper, a rate-distortion based quantization level adjustment （RDQLA） algorithm is presented. Based on the rate-distortion criterion, the quantization level adjustment algorithm effectively improves coding efficiency by adaptively optimizing quantization levels of the signals near the boundaries of quantization cells and adjusting quantization levels per block. In addition, it has no overhead and is fully compatible with the existing compression standards. The proposed algorithm can be applied in any block based image and video coding method. In particular, the algorithm has been verified on the platform of H.264. Experimental results show that the proposed algorithm improves objective and subjective performances substantially. It is shown that the proposed algorithm has a gain of several dB comparing with the newest H.264 standard for high bit rates.
