This paper proposed a back propagation neural network model for predictive block-matching. Predictive block-matching is a way to significantly decrease the computational complexity of motion estimation, but the tradit...This paper proposed a back propagation neural network model for predictive block-matching. Predictive block-matching is a way to significantly decrease the computational complexity of motion estimation, but the traditional prediction model was proposed 26 years ago. It is straight forward but not accurate enough. The proposed back propagation neural network has 5 inputs, 5 neutrons and 1 output. Because of its simplicity, it requires very little calculation power which is negligible compared with existing computation complexity. The test results show 10% - 30% higher prediction accuracy and PSNR improvement up to 0.3 dB. The above advantages make it a feasible replacement of the current model.展开更多
Block-matching and 3D-filtering(BM3D) is a state of the art denoising algorithm for image/video,which takes full advantages of the spatial correlation and the temporal correlation of the video. The algorithm performan...Block-matching and 3D-filtering(BM3D) is a state of the art denoising algorithm for image/video,which takes full advantages of the spatial correlation and the temporal correlation of the video. The algorithm performance comes at the price of more similar blocks finding and filtering which bring high computation and memory access. Area, memory bandwidth and computation are the major bottlenecks to design a feasible architecture because of large frame size and search range. In this paper, we introduce a novel structure to increase data reuse rate and reduce the internal static-random-access-memory(SRAM) memory. Our target is to design a phase alternating line(PAL) or real-time processing chip of BM3 D. We propose an application specific integrated circuit(ASIC) architecture of BM3 D for a 720 × 576 BT656 PAL format. The feature of the chip is with 100 MHz system frequency and a 166-MHz 32-bit double data rate(DDR). When noise is σ = 25, we successfully realize real-time denoising and achieve about 10 d B peak signal to noise ratio(PSNR) advance just by one iteration of the BM3 D algorithm.展开更多
Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes ...Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.展开更多
Surface solar irradiance(SSI)nowcasting(0-3 h)is an effective way to overcome the intermittency of solar energy and to ensure the safe operation of grid-connected solar power plants.In this study,an SSI estimate and n...Surface solar irradiance(SSI)nowcasting(0-3 h)is an effective way to overcome the intermittency of solar energy and to ensure the safe operation of grid-connected solar power plants.In this study,an SSI estimate and nowcasting system was established using the near-infrared channel of Fengyun-4A(FY-4A)geostationary satellite.The system is composed of two key components:The first is a hybrid SSI estimation method combining a physical clear-sky model and an empirical cloudy-sky model.The second component is the SSI nowcasting model,the core of which is the derivation of the cloud motion vector(CMV)using the block-matching method.The goal of simultaneous estimation and nowcasting of global horizontal irradiance(GHI)and direct normal irradiance(DNI)is fulfilled.The system was evaluated under different sky conditions using SSI measurements at Xianghe,a radiation station in the North China Plain.The results show that the accuracy of GHI estimation is higher than that of DNI estimation,with a normalized root-mean-square error(nRMSE)of 22.4%relative to 45.4%.The nRMSE of forecasting GHI and DNI at 30-180 min ahead varied within 25.1%-30.8%and 48.1%-53.4%,respectively.The discrepancy of SSI estimation depends on cloud occurrence frequency and shows a seasonal pattern,being lower in spring-summer and higher in autumn-winter.The FY-4A has great potential in supporting SSI nowcasting,which promotes the development of photovoltaic energy and the reduction of carbon emissions in China.The system can be improved further if calibration of the empirical method is improved.展开更多
文摘This paper proposed a back propagation neural network model for predictive block-matching. Predictive block-matching is a way to significantly decrease the computational complexity of motion estimation, but the traditional prediction model was proposed 26 years ago. It is straight forward but not accurate enough. The proposed back propagation neural network has 5 inputs, 5 neutrons and 1 output. Because of its simplicity, it requires very little calculation power which is negligible compared with existing computation complexity. The test results show 10% - 30% higher prediction accuracy and PSNR improvement up to 0.3 dB. The above advantages make it a feasible replacement of the current model.
基金the National Natural Science Foundation of China(No.61234001)
文摘Block-matching and 3D-filtering(BM3D) is a state of the art denoising algorithm for image/video,which takes full advantages of the spatial correlation and the temporal correlation of the video. The algorithm performance comes at the price of more similar blocks finding and filtering which bring high computation and memory access. Area, memory bandwidth and computation are the major bottlenecks to design a feasible architecture because of large frame size and search range. In this paper, we introduce a novel structure to increase data reuse rate and reduce the internal static-random-access-memory(SRAM) memory. Our target is to design a phase alternating line(PAL) or real-time processing chip of BM3 D. We propose an application specific integrated circuit(ASIC) architecture of BM3 D for a 720 × 576 BT656 PAL format. The feature of the chip is with 100 MHz system frequency and a 166-MHz 32-bit double data rate(DDR). When noise is σ = 25, we successfully realize real-time denoising and achieve about 10 d B peak signal to noise ratio(PSNR) advance just by one iteration of the BM3 D algorithm.
文摘Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.
基金supported by the National Natural Science Foundation of China(Grant Nos.42030608,41805021,and 51776051)the Beijing Natural Science Foundation(Grant No.8204072)Beijing Nova Program(Grant No.Z211100002121077).
文摘Surface solar irradiance(SSI)nowcasting(0-3 h)is an effective way to overcome the intermittency of solar energy and to ensure the safe operation of grid-connected solar power plants.In this study,an SSI estimate and nowcasting system was established using the near-infrared channel of Fengyun-4A(FY-4A)geostationary satellite.The system is composed of two key components:The first is a hybrid SSI estimation method combining a physical clear-sky model and an empirical cloudy-sky model.The second component is the SSI nowcasting model,the core of which is the derivation of the cloud motion vector(CMV)using the block-matching method.The goal of simultaneous estimation and nowcasting of global horizontal irradiance(GHI)and direct normal irradiance(DNI)is fulfilled.The system was evaluated under different sky conditions using SSI measurements at Xianghe,a radiation station in the North China Plain.The results show that the accuracy of GHI estimation is higher than that of DNI estimation,with a normalized root-mean-square error(nRMSE)of 22.4%relative to 45.4%.The nRMSE of forecasting GHI and DNI at 30-180 min ahead varied within 25.1%-30.8%and 48.1%-53.4%,respectively.The discrepancy of SSI estimation depends on cloud occurrence frequency and shows a seasonal pattern,being lower in spring-summer and higher in autumn-winter.The FY-4A has great potential in supporting SSI nowcasting,which promotes the development of photovoltaic energy and the reduction of carbon emissions in China.The system can be improved further if calibration of the empirical method is improved.
