Frame rate up-conversion using multiresolution critical point filters with occlusion refinement

In this paper, multiresolution critical-point filters （CPFs） are employed to image matching for frame rate up-conversion （FRUC）. By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation （ORCMI）. In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Ex- perimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCM1 can achieve 1-2 dB PSNR gain for standard video sequences.

Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Interactive holography offers unmatched levels of immersion and user engagement in the field of future display.Despite of the substantial progress has been made in dynamic meta-holography,the realization of real-time,highly smooth interactive holography remains a significant challenge due to the computational and display frame rate limitations.In this study,we introduced a dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates.To our knowledge,this is the first reported practical dynamic interactive metasurface holographic system.We spa-tially divided the metasurface device into multiple distinct channels,each projecting a reconstructed sub-pattern.The switching states of these channels were mapped to bitwise operations on a set of bit values,which avoids complex holo-gram computations,enabling an ultra-high computational frame rate.Our approach achieves a computational frame rate of 800 kHz and a display frame rate of 23 kHz on a low-power Raspberry Pi computational platform.According to this methodology,we demonstrated an interactive dynamic holographic Tetris game system that allows interactive gameplay,color display,and on-the-fly hologram creation.Our technology presents an inspiration for advanced dynamic meta-holography,which is promising for a broad range of applications including advanced human-computer interaction,real-time 3D visualization,and next-generation virtual and augmented reality systems.

A Joint Delay-and-Sum and Fourier Beamforming Method for High Frame Rate Ultrasound Imaging

Frame rate is an important metric for ultrasound imaging systems,and high frame rates(HFR)benefit moving-target imaging.One common way to obtain HFR imaging is to transmit a plane wave.Delay-and-sum(DAS)beamformer is a conventional beamforming algorithm,which is simple and has been widely implemented in clinical application.Fourier beamforming is an alternative method for HFR imaging and has high levels of imaging efficiency,imaging speed,and good temporal dynamic characteristics.Nevertheless,the resolution and contrast performance of HFR imaging based on DAS or Fourier beamforming are insufficient due to the single plane wave transmission.To address this problem,a joint DAS and Fourier beamforming method is introduced in this study.The proposed method considers the different distributions of sidelobes in DAS imaging and Fourier imaging and combines the angular spectrum and DAS to reconstruct ultrasound images.The proposed method is evaluated on simulation and experimental phantom datasets to compare its performance with DAS and Fourier beamforming methods.Results demonstrate that the proposed method improves image effective dynamic range and resolution while also retaining a high frame rate of the ultrasound imaging systems.The proposed method improves the effective dynamic range along axial and lateral directions by 10 dB,compared to standard DAS and Fourier beamforming.

High-frame-rate contrast-enhanced ultrasound findings of liver metastasis of duodenal gastrointestinal stromal tumor:A case report and literature review

BACKGROUND Liver metastasis of duodenal gastrointestinal stromal tumor(GIST)is rare.Most reports mainly focus on its treatment and approaches to surgical resection,while details on its contrast-enhanced ultrasound(CEUS)findings are lacking.The diagnosis and imaging modalities for this condition remain challenging.CASE SUMMARY A 53-year-old Chinese man presented with mild signs and symptoms of the digestive tract.He underwent routine examinations after GIST surgery.Magnetic resonance imaging showed a 2.3 cm hepatic space-occupying lesion.All the laboratory test results were within normal limits.For further diagnostic confirmation,we conducted high frame rate CEUS(H-CEUS)and found a malignant perfusion pattern.Heterogeneous concentric hyper-enhancement,earlier wash-in than the liver parenchyma,and two irregular vessel columns could be observed at the periphery of the lesion during the arterial phase.Ultrasound-guided puncture biopsy was used to confirm the diagnosis of the lesion as liver metastasis of duodenal GIST.Imatinib was prescribed after biopsy,and the patient’s clinical course was monitored.CONCLUSION H-CEUS is useful for detecting microcirculation differences,wash-in patterns,and vascular morphogenesis and diagnosing liver metastasis of duodenal GIST.

100 Hertz frame-rate switching threedimensional orbital angular momentum multiplexing holography via cross convolution

The orbital angular momentum(OAM)of light has been implemented as an information carrier in OAM holography.Holographic information can be multiplexed in theoretical unbounded OAM channels,promoting the applications of optically addressable dynamic display and high-security optical encryption.However,the frame-rate of the dynamic extraction of the information reconstruction process in OAM holography is physically determined by the switching speed of the incident OAM states,which is currently below 30 Hz limited by refreshing rate of the phase-modulation spatial light modulator(SLM).Here,based on a cross convolution with the spatial frequency of the OAM-multiplexing hologram,the spatial frequencies of an elaborately-designed amplitude distribution,namely amplitude decoding key,has been adopted for the extraction of three-dimensional holographic information encoded in a specific OAM information channel.We experimentally demonstrated a dynamic extraction frame rate of 100 Hz from an OAM multiplexing hologram with 10 information channels indicated by individual OAM values from-50 to 50.The new concept of cross convolution theorem can even provide the potential of parallel reproduction and distribution of information encoded in many OAM channels at various positions which boosts the capacity of information processing far beyond the traditional decoding methods.Thus,our results provide a holographic paradigm for high-speed 3D information processing,paving an unprecedented way to achieve the high-capacity short-range optical communication system.

An Efficient Algorithm Based on Spectrum Migration for High Frame Rate Ultrasound Imaging

The high frame rate(HFR)imaging technique requires only one emission event for imaging.Therefore,it can achieve ultrafast imaging with frame rates up to the kHz regime,which satisfies the frame rate requirements for imaging moving tissues in scientific research and clinics.Lu’s Fourier migration method is based on a non-diffraction beam to obtain HFR images and can improve computational speed and efficiency.However,in order to obtain high-quality images,Fourier migration needs to make full use of the spectrum of echo signals for imaging,which requires a large number of Fast Fourier Transform(FFT)points and increases the complexity of the hardware when the echo frequency is high.Here,an efficient algorithm using the spectrum migration technique based on the spectrum’s distribution characteristics is proposed to improve the imaging efficiency in HFR imaging.Since the actual echo signal spectrum is of limited bandwidth,low-frequency and high-frequency parts with low-energy have little contribution to the imaging spectrum.We transform the effective part that provides the main energy in the signal spectrum to the imaging spectrum while the ineffective spectrum components are not utilized for imaging.This can significantly reduce the number of Fourier transform points,improve Fourier imaging efficiency,and ensure the imaging quality.The proposed method is evaluated on simulated and experimental datasets.Results demonstrated that the proposed method could achieve equivalent image quality with a reduced point number for FFT compared to the complete spectrum migration.In this paper,it only requires a quarter of the FFT points used in the complete spectrum migration,which can improve the computational efficiency;thus,it is more suitable for real-time data processing.The proposed spectrum migration method has a specific significance for the study and clinical application of HFR imaging.

A STUDY OF HIGH FRAME RATE ULTRASONIC IMAGING WITH LIMITED DIFFRACTION BEAMS

Objective To investigate a new class of solutions to the isotropic/homogeneous scalar wave equation, which termed limited diffraction beams and realize ultrasonic 3D imaging. Methods Limited diffraction beams were derived. We performed the study of 3D pulse echo imaging with limited diffraction array beam. To obtain high frame rate images, a single plane wave pulse (broadband) was transmitted with the arrays. Echoes received with the same arrays were processed with Fourier method to construct 3D images. Results Compared with traditional pulse echo imaging, this method has a larger depth of field, high frame rate, and high signal to noise ratio. Conclusion The new method has prospect of high frame rate 3D imaging. In addition, the imaging system based this method is easily implemented and has high quality image.

A novel dynamic frame rate control algorithm for H.264 low-bit-rate video coding

The goal of this paper is to improve human visual perceptual quality as well as coding efficiency of H. 264 video at low bit rate conditions by adaptively adjusting the number of skipped frames. The encoding frames are selected according to the motion activity of each frame and the motion accumulation of successive frames. The motion activity analysis is based on the statistics of motion vectors and with consider- ation of the characteristics of H. 264 coding standard. A prediction model of motion accumulation is pro- posed to reduce complex computation of motion estimation. The dynamic encoding frame rate control algorithm is applied to both the frame level and the GOB （Group of Macroblocks ） level. Simulation is done to compare the performance of JM76 with the proposed frame level scheme and GOB level scheme.

Enhancement of Frame-rate Using Digital Camera

Frame rate is corresponding to the temporal resolution and the number of the pixels of the picture is corresponding to the spatial resolution. They are both very important for the researchers. The ideal image analysis and processing system should have high spatiotemporal characteristics, which is much expensive in practical use. A new method to enhance dynamic frame rate using multi-digital camera(DC) is proposed and the result shows that it could increase the frame rate effectively and decreases the cost in practical use.

Quantum Realities and Observer-Dependent Universes: An Advanced Observer Model

This paper presents a novel observer model that integrates quantum mechanics, relativity, idealism, and the simulation hypothesis to explain the quantum nature of the universe. The model posits a central server transmitting multi-media frames to create observer-dependent realities. Key aspects include deriving frame rates, defining quantum reality, and establishing hierarchical observer structures. The model’s impact on quantum information theory and philosophical interpretations of reality are examined, with detailed discussions on information loss and recursive frame transmission in the appendices.

Frame interpolation with pixel-level motion vector field and mesh based hole filling

Most of the traditional methods are based on block motion compensation tending to involve heavy blocking artifacts in the interpolated frames. In this paper, a new frame interpolation method with pixel-level motion vector field （MVF） is proposed. Our method consists of the following four steps： （i） applying the pixel-level motion vectors （MVs） estimated by optical flow algorithm to eliminate blocking artifacts （ii） motion post-processing and super-sampling anti-aliasing to solve the problems caused by pixel-level MVs （iii） robust warping method to address collisions and holes caused by occlusions （iv） a new holes filling method using triangular mesh （HFTM） to reduce the artifacts caused by holes. Experimental results show that the proposed method can effectively alleviate the holes and blocking artifacts in interpolated frames, and outperforms existing methods both in terms of objective and subjective performances, especially for sequences with complex motions.

Adaptive learning rate GMM for moving object detection in outdoor surveillance for sudden illumination changes

A dynamic learning rate Gaussian mixture model（GMM）algorithm is proposed to deal with the problem of slow adaption of GMM in the case of moving object detection in the outdoor surveillance,especially in the presence of sudden illumination changes.The GMM is mostly used for detecting objects in complex scenes for intelligent monitoring systems.To solve this problem,a mixture Gaussian model has been built for each pixel in the video frame,and according to the scene change from the frame difference,the learning rate of GMM can be dynamically adjusted.The experiments show that the proposed method gives good results with an adaptive GMM learning rate when we compare it with GMM method with a fixed learning rate.The method was tested on a certain dataset,and tests in the case of sudden natural light changes show that our method has a better accuracy and lower false alarm rate.

EFFICIENT DESIGN OF ANTI-JAMMING RATELESS CODING IN COGNITIVE OFDM

Efficient anti-jamming rateless coding based on cognitive Orthogonal Frequency Division Multiplexing (OFDM) modulation in Cognitive Radio Network (CRN) is mainly discussed. Rateless coding with small redundancy and low complexity is presented, and the optimal design methods of building rateless codes are also proposed. In CRN, anti-jamming rateless coding could recover the lost packets in parallel channels of cognitive OFDM, thus it protects Secondary Users (SUs) from the in-terference by Primary Users (PUs) efficiently. Frame Error Rate (FER) and throughput performance of SU employing anti-jamming rateless coding are analyzed in detail. Performance comparison between rateless coding and piecewise coding are also presented. It is shown that, anti-jamming rateless coding provides low FER and Word Error Rate (WER) performance with uniform sub-channel selection. Meanwhile, it is also verified that, in higher jamming rate and longer code redundancy scenario, rateless coding method could achieve better FER and throughput performance than another anti-jamming coding schemes.

Optimization of percutaneous coronary intervention through lower frame rates angiogram

Background Coronary artery disease(CAD)is a leading cause of mortality worldwide.Percutaneous coronary intervention(PCI)is a standard treatment for CAD,yet the radiation exposure associated with this procedure can pose significant risks to both patients and healthcare professionals.With the aim to optimize this procedure,we studied the effects of different exposure rates on radiation dose,fluoroscopy time,and procedural complications.Methods A total of 441 consecutive patients who underwent coronary angiography and subsequent PCI treatment from January 2020 to December 2021 were included in this study.Baseon the fluoroscopy frame rates used during the procedure,patients were divided into two groups,which included a standard dose protocol(SDP)group that used15 frames per second(FPS)and a low dose protocol(LDP)group that used 7.5 FPS.Then the impact of different fluoroscopy frame rates on total air kerma(AK),procedure time,fluoroscopy times(FT),and procedural complications in patients undergoing PCI were evaluated.Results Our data indicated that LDP group had a significantly lower AK,indicative of a reduced radiation dose,in comparison to SDP group.Although the procedure time and FT were slightly longer in the LDP group,this increase was not statistically significant.Moreover,the rate of intraoperative complications in the LDP group was not higher than that in the SDP group.In a subgroup of patients who underwent intravascular ultrasound(IVUS)within the LDP group,we observed further reductions in radiation exposure and FT.Conclusions The use of reduced fluoroscopy frame rates and adjunctive IVUS during PCI procedures can be a viable approach to minimizing radiation exposure without compromising procedure success or patient safety.

Study of frame-rate up conversion based on H.264

In this study, a low complexity frame-rate up conversion method using compressed domain information for H.264 decoder is proposed. In the proposed scheme, the motion vectors （MVs） are estimated using constant acceleration motion model, and the MVs regarded as no credibility are corrected, and the interpolation method is applied on the basis of the macroblock （MB） coded types. Applied to the H.264 decoder, the proposed method provides high quality interpolation frames and an obvious decrease of the block artifacts.

帧率提升中的三维递归搜索块匹配改进算法

将基于块匹配的运动估计用于帧率提升会产生内插重叠、空洞等问题。对三维递归搜索(3DRS)块匹配运动估计算法进行改进,结合双向运动估计给出更为精确的运动矢量,采用矢量中值滤波器平滑矢量场,并运用中值滤波运动补偿技术进行插帧。实验结果表明,该算法在主客观方面都具有较好的性能,计算复杂度较低,也便于硬件实现。

基于三维递归搜索的多级运动估计视频帧率上转换算法

运动补偿插帧是目前主要的帧率上转换方法。为减小内插帧中的"块效应",并降低运算量以满足实时高清视频应用,该文提出了一种基于3维递归搜索(3-D Recursive Search,3-D RS)的多级块匹配运动估计视频帧率上转换算法。该算法将3-D RS与双向运动估计相结合,首先对序列中相邻帧进行"由粗到精"的三级运动估计,再利用简化的中值滤波器平滑运动矢量场,最后通过线性插值补偿得到内插帧。实验结果表明,与现有的运动补偿插帧算法相比,该算法内插帧的主、客观质量都有所提高,且算法复杂度低,有很强的实用性。

针对视频运动补偿帧率提升篡改的主动混噪取证算法

运动补偿帧率提升(MC-FRUC)是常见的视频时域篡改手段。现有方法依靠被动分析视频统计特征发现MC-FRUC篡改,然而,视频统计特性的非平稳性影响了取证性能的稳定性。该文提出一种主动混噪取证算法,通过预先混入统计特性已知的高斯白噪声,提高MC-FRUC取证的准确度。首先,利用伪随机序列生成高斯白噪声,加入原始视频序列。接着,由小波系数的绝对中位差预测各视频帧中混入高斯噪声的标准差。最后,检测高斯噪声标准差的时域变化周期性,通过硬阈值判决,自动甄别MC-FRUC篡改。实验结果表明,针对不同的MC-FRUC伪造方法,提出算法均表现出良好的取证性能,尤其是当采用去噪、压缩等操作后处理视频后,提出算法仍能确保较高的检测准确度。

基于多帧运动估计的帧率提升算法

结合最大后验概率(MAP)估计的准确性和分层块匹配算法的快速性,研究了一种多参考帧运动估计算法,并提出了一种基于多帧运动估计的帧率提升(FRUC)系统方案。实验结果表明,基于该算法的内插帧无论从客观指标(时间复杂度、信噪比PSNR)还是主观质量(视觉效果)均优于现有常用方法,且算法复杂度较低,便于硬件实现。

扫描格式转换的自适应帧频提升算法及其FPGA实现

文章提出了一种新的自适应帧频提升算法 ,并深入研究了它的快速硬件实现方法。该算法通过引入内部参数和加权块匹配误差 ,来进行自适应运动补偿 ,因而它可以有效地消除噪声的影响 ,并便于硬件实现。最后 ,通过建立对应于可变参数的因子查找表和采用现场可编程逻辑器件 (FPGA)快速实现了扫描格式转换中的帧频提升算法 ,并应用在实际系统中 ,实验结果表明该算法十分有效。