This paper proposed a back propagation neural network model for predictive block-matching. Predictive block-matching is a way to significantly decrease the computational complexity of motion estimation, but the tradit...This paper proposed a back propagation neural network model for predictive block-matching. Predictive block-matching is a way to significantly decrease the computational complexity of motion estimation, but the traditional prediction model was proposed 26 years ago. It is straight forward but not accurate enough. The proposed back propagation neural network has 5 inputs, 5 neutrons and 1 output. Because of its simplicity, it requires very little calculation power which is negligible compared with existing computation complexity. The test results show 10% - 30% higher prediction accuracy and PSNR improvement up to 0.3 dB. The above advantages make it a feasible replacement of the current model.展开更多
Block-matching and 3D-filtering(BM3D) is a state of the art denoising algorithm for image/video,which takes full advantages of the spatial correlation and the temporal correlation of the video. The algorithm performan...Block-matching and 3D-filtering(BM3D) is a state of the art denoising algorithm for image/video,which takes full advantages of the spatial correlation and the temporal correlation of the video. The algorithm performance comes at the price of more similar blocks finding and filtering which bring high computation and memory access. Area, memory bandwidth and computation are the major bottlenecks to design a feasible architecture because of large frame size and search range. In this paper, we introduce a novel structure to increase data reuse rate and reduce the internal static-random-access-memory(SRAM) memory. Our target is to design a phase alternating line(PAL) or real-time processing chip of BM3 D. We propose an application specific integrated circuit(ASIC) architecture of BM3 D for a 720 × 576 BT656 PAL format. The feature of the chip is with 100 MHz system frequency and a 166-MHz 32-bit double data rate(DDR). When noise is σ = 25, we successfully realize real-time denoising and achieve about 10 d B peak signal to noise ratio(PSNR) advance just by one iteration of the BM3 D algorithm.展开更多
Fusion methods based on multi-scale transforms have become the mainstream of the pixel-level image fusion. However,most of these methods cannot fully exploit spatial domain information of source images, which lead to ...Fusion methods based on multi-scale transforms have become the mainstream of the pixel-level image fusion. However,most of these methods cannot fully exploit spatial domain information of source images, which lead to the degradation of image.This paper presents a fusion framework based on block-matching and 3D(BM3D) multi-scale transform. The algorithm first divides the image into different blocks and groups these 2D image blocks into 3D arrays by their similarity. Then it uses a 3D transform which consists of a 2D multi-scale and a 1D transform to transfer the arrays into transform coefficients, and then the obtained low-and high-coefficients are fused by different fusion rules. The final fused image is obtained from a series of fused 3D image block groups after the inverse transform by using an aggregation process. In the experimental part, we comparatively analyze some existing algorithms and the using of different transforms, e.g. non-subsampled Contourlet transform(NSCT), non-subsampled Shearlet transform(NSST), in the 3D transform step. Experimental results show that the proposed fusion framework can not only improve subjective visual effect, but also obtain better objective evaluation criteria than state-of-the-art methods.展开更多
Surface solar irradiance(SSI)nowcasting(0-3 h)is an effective way to overcome the intermittency of solar energy and to ensure the safe operation of grid-connected solar power plants.In this study,an SSI estimate and n...Surface solar irradiance(SSI)nowcasting(0-3 h)is an effective way to overcome the intermittency of solar energy and to ensure the safe operation of grid-connected solar power plants.In this study,an SSI estimate and nowcasting system was established using the near-infrared channel of Fengyun-4A(FY-4A)geostationary satellite.The system is composed of two key components:The first is a hybrid SSI estimation method combining a physical clear-sky model and an empirical cloudy-sky model.The second component is the SSI nowcasting model,the core of which is the derivation of the cloud motion vector(CMV)using the block-matching method.The goal of simultaneous estimation and nowcasting of global horizontal irradiance(GHI)and direct normal irradiance(DNI)is fulfilled.The system was evaluated under different sky conditions using SSI measurements at Xianghe,a radiation station in the North China Plain.The results show that the accuracy of GHI estimation is higher than that of DNI estimation,with a normalized root-mean-square error(nRMSE)of 22.4%relative to 45.4%.The nRMSE of forecasting GHI and DNI at 30-180 min ahead varied within 25.1%-30.8%and 48.1%-53.4%,respectively.The discrepancy of SSI estimation depends on cloud occurrence frequency and shows a seasonal pattern,being lower in spring-summer and higher in autumn-winter.The FY-4A has great potential in supporting SSI nowcasting,which promotes the development of photovoltaic energy and the reduction of carbon emissions in China.The system can be improved further if calibration of the empirical method is improved.展开更多
Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes ...Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.展开更多
A novel algorithm of global motion estimation is proposed. First, through Gabor wavelet transform (GWT), a kind of energy distribution of image is obtained and checkpoints are selected according to a probability dec...A novel algorithm of global motion estimation is proposed. First, through Gabor wavelet transform (GWT), a kind of energy distribution of image is obtained and checkpoints are selected according to a probability decision approach proposed. Then, the initialized motion vectors are obtained via a hierarcbal block-matching based on these checkpoints. Finally, by employing a 3-parameter motion model, precise parameters of global motion are found. From the experiment, the algorithm is reliable and robust.展开更多
文摘This paper proposed a back propagation neural network model for predictive block-matching. Predictive block-matching is a way to significantly decrease the computational complexity of motion estimation, but the traditional prediction model was proposed 26 years ago. It is straight forward but not accurate enough. The proposed back propagation neural network has 5 inputs, 5 neutrons and 1 output. Because of its simplicity, it requires very little calculation power which is negligible compared with existing computation complexity. The test results show 10% - 30% higher prediction accuracy and PSNR improvement up to 0.3 dB. The above advantages make it a feasible replacement of the current model.
基金the National Natural Science Foundation of China(No.61234001)
文摘Block-matching and 3D-filtering(BM3D) is a state of the art denoising algorithm for image/video,which takes full advantages of the spatial correlation and the temporal correlation of the video. The algorithm performance comes at the price of more similar blocks finding and filtering which bring high computation and memory access. Area, memory bandwidth and computation are the major bottlenecks to design a feasible architecture because of large frame size and search range. In this paper, we introduce a novel structure to increase data reuse rate and reduce the internal static-random-access-memory(SRAM) memory. Our target is to design a phase alternating line(PAL) or real-time processing chip of BM3 D. We propose an application specific integrated circuit(ASIC) architecture of BM3 D for a 720 × 576 BT656 PAL format. The feature of the chip is with 100 MHz system frequency and a 166-MHz 32-bit double data rate(DDR). When noise is σ = 25, we successfully realize real-time denoising and achieve about 10 d B peak signal to noise ratio(PSNR) advance just by one iteration of the BM3 D algorithm.
基金supported by the National Natural Science Foundation of China(6157206361401308)+6 种基金the Fundamental Research Funds for the Central Universities(2016YJS039)the Natural Science Foundation of Hebei Province(F2016201142F2016201187)the Natural Social Foundation of Hebei Province(HB15TQ015)the Science Research Project of Hebei Province(QN2016085ZC2016040)the Natural Science Foundation of Hebei University(2014-303)
文摘Fusion methods based on multi-scale transforms have become the mainstream of the pixel-level image fusion. However,most of these methods cannot fully exploit spatial domain information of source images, which lead to the degradation of image.This paper presents a fusion framework based on block-matching and 3D(BM3D) multi-scale transform. The algorithm first divides the image into different blocks and groups these 2D image blocks into 3D arrays by their similarity. Then it uses a 3D transform which consists of a 2D multi-scale and a 1D transform to transfer the arrays into transform coefficients, and then the obtained low-and high-coefficients are fused by different fusion rules. The final fused image is obtained from a series of fused 3D image block groups after the inverse transform by using an aggregation process. In the experimental part, we comparatively analyze some existing algorithms and the using of different transforms, e.g. non-subsampled Contourlet transform(NSCT), non-subsampled Shearlet transform(NSST), in the 3D transform step. Experimental results show that the proposed fusion framework can not only improve subjective visual effect, but also obtain better objective evaluation criteria than state-of-the-art methods.
基金supported by the National Natural Science Foundation of China(Grant Nos.42030608,41805021,and 51776051)the Beijing Natural Science Foundation(Grant No.8204072)Beijing Nova Program(Grant No.Z211100002121077).
文摘Surface solar irradiance(SSI)nowcasting(0-3 h)is an effective way to overcome the intermittency of solar energy and to ensure the safe operation of grid-connected solar power plants.In this study,an SSI estimate and nowcasting system was established using the near-infrared channel of Fengyun-4A(FY-4A)geostationary satellite.The system is composed of two key components:The first is a hybrid SSI estimation method combining a physical clear-sky model and an empirical cloudy-sky model.The second component is the SSI nowcasting model,the core of which is the derivation of the cloud motion vector(CMV)using the block-matching method.The goal of simultaneous estimation and nowcasting of global horizontal irradiance(GHI)and direct normal irradiance(DNI)is fulfilled.The system was evaluated under different sky conditions using SSI measurements at Xianghe,a radiation station in the North China Plain.The results show that the accuracy of GHI estimation is higher than that of DNI estimation,with a normalized root-mean-square error(nRMSE)of 22.4%relative to 45.4%.The nRMSE of forecasting GHI and DNI at 30-180 min ahead varied within 25.1%-30.8%and 48.1%-53.4%,respectively.The discrepancy of SSI estimation depends on cloud occurrence frequency and shows a seasonal pattern,being lower in spring-summer and higher in autumn-winter.The FY-4A has great potential in supporting SSI nowcasting,which promotes the development of photovoltaic energy and the reduction of carbon emissions in China.The system can be improved further if calibration of the empirical method is improved.
文摘Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.
文摘A novel algorithm of global motion estimation is proposed. First, through Gabor wavelet transform (GWT), a kind of energy distribution of image is obtained and checkpoints are selected according to a probability decision approach proposed. Then, the initialized motion vectors are obtained via a hierarcbal block-matching based on these checkpoints. Finally, by employing a 3-parameter motion model, precise parameters of global motion are found. From the experiment, the algorithm is reliable and robust.