Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Interactive holography offers unmatched levels of immersion and user engagement in the field of future display.Despite of the substantial progress has been made in dynamic meta-holography,the realization of real-time,highly smooth interactive holography remains a significant challenge due to the computational and display frame rate limitations.In this study,we introduced a dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates.To our knowledge,this is the first reported practical dynamic interactive metasurface holographic system.We spa-tially divided the metasurface device into multiple distinct channels,each projecting a reconstructed sub-pattern.The switching states of these channels were mapped to bitwise operations on a set of bit values,which avoids complex holo-gram computations,enabling an ultra-high computational frame rate.Our approach achieves a computational frame rate of 800 kHz and a display frame rate of 23 kHz on a low-power Raspberry Pi computational platform.According to this methodology,we demonstrated an interactive dynamic holographic Tetris game system that allows interactive gameplay,color display,and on-the-fly hologram creation.Our technology presents an inspiration for advanced dynamic meta-holography,which is promising for a broad range of applications including advanced human-computer interaction,real-time 3D visualization,and next-generation virtual and augmented reality systems.

A Joint Delay-and-Sum and Fourier Beamforming Method for High Frame Rate Ultrasound Imaging

Frame rate is an important metric for ultrasound imaging systems,and high frame rates(HFR)benefit moving-target imaging.One common way to obtain HFR imaging is to transmit a plane wave.Delay-and-sum(DAS)beamformer is a conventional beamforming algorithm,which is simple and has been widely implemented in clinical application.Fourier beamforming is an alternative method for HFR imaging and has high levels of imaging efficiency,imaging speed,and good temporal dynamic characteristics.Nevertheless,the resolution and contrast performance of HFR imaging based on DAS or Fourier beamforming are insufficient due to the single plane wave transmission.To address this problem,a joint DAS and Fourier beamforming method is introduced in this study.The proposed method considers the different distributions of sidelobes in DAS imaging and Fourier imaging and combines the angular spectrum and DAS to reconstruct ultrasound images.The proposed method is evaluated on simulation and experimental phantom datasets to compare its performance with DAS and Fourier beamforming methods.Results demonstrate that the proposed method improves image effective dynamic range and resolution while also retaining a high frame rate of the ultrasound imaging systems.The proposed method improves the effective dynamic range along axial and lateral directions by 10 dB,compared to standard DAS and Fourier beamforming.

An Efficient Algorithm Based on Spectrum Migration for High Frame Rate Ultrasound Imaging

The high frame rate(HFR)imaging technique requires only one emission event for imaging.Therefore,it can achieve ultrafast imaging with frame rates up to the kHz regime,which satisfies the frame rate requirements for imaging moving tissues in scientific research and clinics.Lu’s Fourier migration method is based on a non-diffraction beam to obtain HFR images and can improve computational speed and efficiency.However,in order to obtain high-quality images,Fourier migration needs to make full use of the spectrum of echo signals for imaging,which requires a large number of Fast Fourier Transform(FFT)points and increases the complexity of the hardware when the echo frequency is high.Here,an efficient algorithm using the spectrum migration technique based on the spectrum’s distribution characteristics is proposed to improve the imaging efficiency in HFR imaging.Since the actual echo signal spectrum is of limited bandwidth,low-frequency and high-frequency parts with low-energy have little contribution to the imaging spectrum.We transform the effective part that provides the main energy in the signal spectrum to the imaging spectrum while the ineffective spectrum components are not utilized for imaging.This can significantly reduce the number of Fourier transform points,improve Fourier imaging efficiency,and ensure the imaging quality.The proposed method is evaluated on simulated and experimental datasets.Results demonstrated that the proposed method could achieve equivalent image quality with a reduced point number for FFT compared to the complete spectrum migration.In this paper,it only requires a quarter of the FFT points used in the complete spectrum migration,which can improve the computational efficiency;thus,it is more suitable for real-time data processing.The proposed spectrum migration method has a specific significance for the study and clinical application of HFR imaging.

A STUDY OF HIGH FRAME RATE ULTRASONIC IMAGING WITH LIMITED DIFFRACTION BEAMS

Objective To investigate a new class of solutions to the isotropic/homogeneous scalar wave equation, which termed limited diffraction beams and realize ultrasonic 3D imaging. Methods Limited diffraction beams were derived. We performed the study of 3D pulse echo imaging with limited diffraction array beam. To obtain high frame rate images, a single plane wave pulse (broadband) was transmitted with the arrays. Echoes received with the same arrays were processed with Fourier method to construct 3D images. Results Compared with traditional pulse echo imaging, this method has a larger depth of field, high frame rate, and high signal to noise ratio. Conclusion The new method has prospect of high frame rate 3D imaging. In addition, the imaging system based this method is easily implemented and has high quality image.

Frame rate up-conversion using multiresolution critical point filters with occlusion refinement

In this paper, multiresolution critical-point filters （CPFs） are employed to image matching for frame rate up-conversion （FRUC）. By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation （ORCMI）. In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Ex- perimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCM1 can achieve 1-2 dB PSNR gain for standard video sequences.

A novel dynamic frame rate control algorithm for H.264 low-bit-rate video coding

The goal of this paper is to improve human visual perceptual quality as well as coding efficiency of H. 264 video at low bit rate conditions by adaptively adjusting the number of skipped frames. The encoding frames are selected according to the motion activity of each frame and the motion accumulation of successive frames. The motion activity analysis is based on the statistics of motion vectors and with consider- ation of the characteristics of H. 264 coding standard. A prediction model of motion accumulation is pro- posed to reduce complex computation of motion estimation. The dynamic encoding frame rate control algorithm is applied to both the frame level and the GOB （Group of Macroblocks ） level. Simulation is done to compare the performance of JM76 with the proposed frame level scheme and GOB level scheme.

Optimization of percutaneous coronary intervention through lower frame rates angiogram

Background Coronary artery disease(CAD)is a leading cause of mortality worldwide.Percutaneous coronary intervention(PCI)is a standard treatment for CAD,yet the radiation exposure associated with this procedure can pose significant risks to both patients and healthcare professionals.With the aim to optimize this procedure,we studied the effects of different exposure rates on radiation dose,fluoroscopy time,and procedural complications.Methods A total of 441 consecutive patients who underwent coronary angiography and subsequent PCI treatment from January 2020 to December 2021 were included in this study.Baseon the fluoroscopy frame rates used during the procedure,patients were divided into two groups,which included a standard dose protocol(SDP)group that used15 frames per second(FPS)and a low dose protocol(LDP)group that used 7.5 FPS.Then the impact of different fluoroscopy frame rates on total air kerma(AK),procedure time,fluoroscopy times(FT),and procedural complications in patients undergoing PCI were evaluated.Results Our data indicated that LDP group had a significantly lower AK,indicative of a reduced radiation dose,in comparison to SDP group.Although the procedure time and FT were slightly longer in the LDP group,this increase was not statistically significant.Moreover,the rate of intraoperative complications in the LDP group was not higher than that in the SDP group.In a subgroup of patients who underwent intravascular ultrasound(IVUS)within the LDP group,we observed further reductions in radiation exposure and FT.Conclusions The use of reduced fluoroscopy frame rates and adjunctive IVUS during PCI procedures can be a viable approach to minimizing radiation exposure without compromising procedure success or patient safety.

Real-Time Mosaic Method of Aerial Video Based on Two-Stage Key Frame Selection Method

A two-stage automatic key frame selection method is proposed to enhance stitching speed and quality for UAV aerial videos. In the first stage, to reduce redundancy, the overlapping rate of the UAV aerial video sequence within the sampling period is calculated. Lagrange interpolation is used to fit the overlapping rate curve of the sequence. An empirical threshold for the overlapping rate is then applied to filter candidate key frames from the sequence. In the second stage, the principle of minimizing remapping spots is used to dynamically adjust and determine the final key frame close to the candidate key frames. Comparative experiments show that the proposed method significantly improves stitching speed and accuracy by more than 40%.

High Frame Rate Contrast-enhanced Ultrasound Helps Differentiate Malignant and Benign Focal Liver Lesions

Background and Aims:This study aimed to evaluate the diagnostic performance of high frame rate contrast-en-hanced ultrasound(H-CEUS)of focal liver lesions(FLLs).Methods:From July 2017 to June 2019,conventional con-trast-enhanced ultrasound(C-CEUS)and H-CEUS were per-formed in 78 patients with 78 nodules.The characteristics of C-CEUS and H-CEUS in malignant and benign groups and the differences between different lesion sizes(1-3 cm,3-5 cm,or>5 cm)of C-CEUS and H-CEUS were examined.The diagnostic performance of C-CEUS and H-CEUS was ana-lyzed.The chi-square test or Fisher’s exact test was used to assess inter-group differences.The receiver operating characteristic curve was plotted to determine the diagnostic performance of C-CEUS and H-CEUS.Results:There were significant differences in the enhancement area,fill-in direc-tion and vascular architecture between C-CEUS and H-CEUS for both benign and malignant lesions(all p=0.000-0.008),but there were no significant differences in washout results(p=0.566 and p=0.684,respectively).For lesions 1-3 cm in size,the enhancement area,fill-in direction,and vascular architecture on C-CEUS and H-CEUS were significantly dif-ferent(all p=0.000),unlike for lesions 3-5 cm or>5 cm in size.For differentiation of malignant from benign FLLs in the 1-3 cm group,H-CEUS showed sensitivity,specific-ity,accuracy,and positive and negative predictive values of 92.86%,95.0%,96.3%,90.48%and 93.75%,respectively,which were higher than those for C-CEUS(75.0%,70.0%,77.78%,66.67%and 72.91%,respectively).Conclusions:H-CEUS provided more vascular information which could help differentiate malignant from benign FLLs,especially for lesions 1-3 cm in size.

Design of a very high frame rate camera based on an asynchronous CCD driving method

A very high frame rate camera is designed based on an innovative CCD driving method. The CCD driving method is mainly implemented on frame transfer CCDs. Asynchronous drive timing sequences are applied in the image and storage section of the CCDs. Several rows of the charge in the image section are binned onto the same row in the storage section, and there are the same number of images to be stored in the storage section before they are read out. Based on the new driving method, the frame transfer CCDs can work at a very high frame rate in acquiring burst images though the reading speed remains at a lower level. A very high frame rate camera is designed in this paper. The innovative CCD driving method is mainly of concern. An e2v’s CCD60 is adopted in the camera system, whose full size resolution is 128×128, and the up most frame rate is 1000 Hz in the conventional CCD driving method. By using the presented method, the CCD60 based imager is capable of operating at up to 40000 frames per second （fps） at a recognizable resolution of 128×32. Comparing cameras using traditional binning and region of interest technologies, the frame rate is normally less than 5000 fps while the resolution is only 32×32 left.

High-frame-rate contrast-enhanced ultrasound findings of liver metastasis of duodenal gastrointestinal stromal tumor:A case report and literature review

BACKGROUND Liver metastasis of duodenal gastrointestinal stromal tumor(GIST)is rare.Most reports mainly focus on its treatment and approaches to surgical resection,while details on its contrast-enhanced ultrasound(CEUS)findings are lacking.The diagnosis and imaging modalities for this condition remain challenging.CASE SUMMARY A 53-year-old Chinese man presented with mild signs and symptoms of the digestive tract.He underwent routine examinations after GIST surgery.Magnetic resonance imaging showed a 2.3 cm hepatic space-occupying lesion.All the laboratory test results were within normal limits.For further diagnostic confirmation,we conducted high frame rate CEUS(H-CEUS)and found a malignant perfusion pattern.Heterogeneous concentric hyper-enhancement,earlier wash-in than the liver parenchyma,and two irregular vessel columns could be observed at the periphery of the lesion during the arterial phase.Ultrasound-guided puncture biopsy was used to confirm the diagnosis of the lesion as liver metastasis of duodenal GIST.Imatinib was prescribed after biopsy,and the patient’s clinical course was monitored.CONCLUSION H-CEUS is useful for detecting microcirculation differences,wash-in patterns,and vascular morphogenesis and diagnosing liver metastasis of duodenal GIST.

100 Hertz frame-rate switching threedimensional orbital angular momentum multiplexing holography via cross convolution

The orbital angular momentum(OAM)of light has been implemented as an information carrier in OAM holography.Holographic information can be multiplexed in theoretical unbounded OAM channels,promoting the applications of optically addressable dynamic display and high-security optical encryption.However,the frame-rate of the dynamic extraction of the information reconstruction process in OAM holography is physically determined by the switching speed of the incident OAM states,which is currently below 30 Hz limited by refreshing rate of the phase-modulation spatial light modulator(SLM).Here,based on a cross convolution with the spatial frequency of the OAM-multiplexing hologram,the spatial frequencies of an elaborately-designed amplitude distribution,namely amplitude decoding key,has been adopted for the extraction of three-dimensional holographic information encoded in a specific OAM information channel.We experimentally demonstrated a dynamic extraction frame rate of 100 Hz from an OAM multiplexing hologram with 10 information channels indicated by individual OAM values from-50 to 50.The new concept of cross convolution theorem can even provide the potential of parallel reproduction and distribution of information encoded in many OAM channels at various positions which boosts the capacity of information processing far beyond the traditional decoding methods.Thus,our results provide a holographic paradigm for high-speed 3D information processing,paving an unprecedented way to achieve the high-capacity short-range optical communication system.

Enhancement of Frame-rate Using Digital Camera

Frame rate is corresponding to the temporal resolution and the number of the pixels of the picture is corresponding to the spatial resolution. They are both very important for the researchers. The ideal image analysis and processing system should have high spatiotemporal characteristics, which is much expensive in practical use. A new method to enhance dynamic frame rate using multi-digital camera(DC) is proposed and the result shows that it could increase the frame rate effectively and decreases the cost in practical use.

An Efficient Intra-Frame Rate Control Algorithm for H.264/AVC Video Coding

Intra-frame plays a significant role in improving video quality for rate control of H.264/AVC.In this paper,an efficient intra-frame rate control algorithm is proposed for H.264/AVC video coding.The proposed scheme adjusts the quantization parameter （QP） of intra-frame adaptively according to intra-frame buffer fullness ratio,current buffer fullness ratio,and skipped frame ratio.Experimental results demonstrate that for a set of typical testing sequences,the proposed scheme can obtain accurate target bit rate,better peak signal-to-noise ratio （PSNR） performance and reduce the number of skipped frames significantly,when compared with existing schemes.More importantly,the proposed scheme is very flexible for different initial QPs and target bits.

Rate-distortion optimized frame dropping and scheduling for multi-user conversational and streaming video

We propose a Rate-Distortion (RD) optimized strategy for frame-dropping and scheduling of multi-user conversa- tional and streaming videos. We consider a scenario where conversational and streaming videos share the forwarding resources at a network node. Two buffers are setup on the node to temporarily store the packets for these two types of video applications. For streaming video, a big buffer is used as the associated delay constraint of the application is moderate and a very small buffer is used for conversational video to ensure that the forwarding delay of every packet is limited. A scheduler is located behind these two buffers that dynamically assigns transmission slots on the outgoing link to the two buffers. Rate-distortion side information is used to perform RD-optimized frame dropping in case of node overload. Sharing the data rate on the outgoing link between the con- versational and the streaming videos is done either based on the fullness of the two associated buffers or on the mean incoming rates of the respective videos. Simulation results showed that our proposed RD-optimized frame dropping and scheduling ap- proach provides significant improvements in performance over the popular priority-based random dropping (PRD) technique.

Quantum Realities and Observer-Dependent Universes: An Advanced Observer Model

This paper presents a novel observer model that integrates quantum mechanics, relativity, idealism, and the simulation hypothesis to explain the quantum nature of the universe. The model posits a central server transmitting multi-media frames to create observer-dependent realities. Key aspects include deriving frame rates, defining quantum reality, and establishing hierarchical observer structures. The model’s impact on quantum information theory and philosophical interpretations of reality are examined, with detailed discussions on information loss and recursive frame transmission in the appendices.

基于DVB-S2X协议的低轨卫星通信性能仿真分析

介绍了DVB-S2X标准,重点分析了其中高阶调制技术的基本原理和星座映射,在进行星地链路分析的基础上,构建了DVB-S2X标准低轨卫星通信仿真模型,针对DVB-S2X标准中16APSK、32APSK、64APSK调制信号开展仿真试验,以误码率和丢帧率为指标进行通信性能分析。

考虑填充墙的RC框架结构性能指标限值确定方法

填充墙钢筋混凝土(RC)框架结构是我国应用最为广泛的结构形式之一,而我国规范中给出的此类结构性能指标限值并未充分考虑填充墙对整体结构破坏状态的影响。遵循我国规范中对结构破坏状态的定义原则,提出基于构件破坏率的填充墙RC框架结构性能指标限值确定方法,为此类结构破坏状态与工程需求参数对应关系的研究提供新的思路。以典型结构为例建立数值分析模型,采用该文方法计算考虑填充墙的RC框架结构性能指标限值,并与不考虑填充墙的“纯框架”限值进行了对比分析。相较于“纯框架指标”,该文指标完好、轻微破坏、中等破坏和严重破坏四个破坏状态的层间位移角上限值均更小,其中,完好状态的上限值为1/832,远小于规范中规定的弹性层间位移角限值1/550,说明判定填充墙RC框架结构的破坏状态时,直接应用规范限值会低估结构的破坏程度。

基于FPGA的高速大面阵成像系统设计

为了获取高帧频大面阵图像数据,设计了一套基于FPGA结合CMOS图像探测器的成像系统。首先,介绍了国产GSENSE6060图像探测器的特性和设计方法。然后提出了成像系统的供电等硬件设计。最后,重点研究了基于Xilinx公司Virtex-5型FPGA的CMOS图像数据训练算法,保证了数据采集的准确性。试验结果表明,所设计的成像系统在6 144 pixel×6 144 pixel分辨率时,帧频达20 frame/s,图像数据峰值速率16 Gbit/s,且读出噪声优于4e^(-)。目前,系统已经工程应用,其功能、性能满足了项目实际需要。

高帧率超声造影定性特征联合定量参数鉴别前列腺良恶性疾病的应用价值

目的:探讨高帧率超声造影(high frame rate contrast-enhanced ultrasound,H-CEUS)定性特征联合定量参数对前列腺良恶性疾病的鉴别诊断价值。方法:选取2022年02月至2023年01月在我院就诊疑似前列腺癌(prostate cancer,PCa)并进行前列腺穿刺活检的患者60例(共67个病灶),根据病理结果分为良性组和恶性组,穿刺前行经直肠常规超声及H-CEUS,记录前列腺基本情况、造影定性特征并绘制时间强度曲线获得定量分析参数,比较两组间差异;以病理结果为“金标准”绘制受试者工作特征(receiver operating characteristic,ROC)曲线,应用Z检验比较H-CEUS定性特征、定量参数单独及联合应用对于前列腺病变良恶性的诊断效能。结果:与良性组相比,恶性组H-CEUS定性特征为供血动脉形态不规则(1/33 vs 11/34)及走形异常(3/33 vs 20/34)、快进(9/33 vs 29/34)、高增强(4/33 vs 25/34)、造影剂分布不均匀(9/33 vs 13/34)的比例较大,差异具有统计学意义(χ2=30.41、18.37、22.96、25.72、8.06,P<0.001、<0.001、<0.001、<0.001、=0.005);定量参数PCa较良性组造影到达时间早[(16.93±3.69)s vs(21.54±3.86)s],峰值强度[(48.8±5.58)dB vs(45.77±4.42)dB]、强度差[4.87(0.87,8.03)vs-0.44(-2.22,2.35)]及强度比[(1.15±0.24)vs(1.01±0.97)]的值较良性大,差异具有统计学意义(t/U=4.24、-2.324、151、-2.535,P<0.001、=0.025、=0.004、=0.015)。ROC曲线示H-CEUS定性及定量联合应用的AUC=0.938,截断值为0.44时诊断效能最佳,约登指数、敏感度、特异度、准确度、阳性预测值及阴性预测值为0.750、89.29%、85.71%、87.75%、89.3%、85.7%。根据净重新分类指数NRI值,联合应用对定性特征及定量参数均为正改善(P<0.05)。结论:H-CEUS应用于前列腺有助于观察造影灌注细节、分析成像特征,对于前列腺良恶性疾病具有较好的鉴别诊断能力,将造影灌注定性特征与定量参数结合的诊断效能优于单独应用。