Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Interactive holography offers unmatched levels of immersion and user engagement in the field of future display.Despite of the substantial progress has been made in dynamic meta-holography,the realization of real-time,highly smooth interactive holography remains a significant challenge due to the computational and display frame rate limitations.In this study,we introduced a dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates.To our knowledge,this is the first reported practical dynamic interactive metasurface holographic system.We spa-tially divided the metasurface device into multiple distinct channels,each projecting a reconstructed sub-pattern.The switching states of these channels were mapped to bitwise operations on a set of bit values,which avoids complex holo-gram computations,enabling an ultra-high computational frame rate.Our approach achieves a computational frame rate of 800 kHz and a display frame rate of 23 kHz on a low-power Raspberry Pi computational platform.According to this methodology,we demonstrated an interactive dynamic holographic Tetris game system that allows interactive gameplay,color display,and on-the-fly hologram creation.Our technology presents an inspiration for advanced dynamic meta-holography,which is promising for a broad range of applications including advanced human-computer interaction,real-time 3D visualization,and next-generation virtual and augmented reality systems.

Real-Time Mosaic Method of Aerial Video Based on Two-Stage Key Frame Selection Method

A two-stage automatic key frame selection method is proposed to enhance stitching speed and quality for UAV aerial videos. In the first stage, to reduce redundancy, the overlapping rate of the UAV aerial video sequence within the sampling period is calculated. Lagrange interpolation is used to fit the overlapping rate curve of the sequence. An empirical threshold for the overlapping rate is then applied to filter candidate key frames from the sequence. In the second stage, the principle of minimizing remapping spots is used to dynamically adjust and determine the final key frame close to the candidate key frames. Comparative experiments show that the proposed method significantly improves stitching speed and accuracy by more than 40%.

High-frame-rate contrast-enhanced ultrasound findings of liver metastasis of duodenal gastrointestinal stromal tumor:A case report and literature review

BACKGROUND Liver metastasis of duodenal gastrointestinal stromal tumor(GIST)is rare.Most reports mainly focus on its treatment and approaches to surgical resection,while details on its contrast-enhanced ultrasound(CEUS)findings are lacking.The diagnosis and imaging modalities for this condition remain challenging.CASE SUMMARY A 53-year-old Chinese man presented with mild signs and symptoms of the digestive tract.He underwent routine examinations after GIST surgery.Magnetic resonance imaging showed a 2.3 cm hepatic space-occupying lesion.All the laboratory test results were within normal limits.For further diagnostic confirmation,we conducted high frame rate CEUS(H-CEUS)and found a malignant perfusion pattern.Heterogeneous concentric hyper-enhancement,earlier wash-in than the liver parenchyma,and two irregular vessel columns could be observed at the periphery of the lesion during the arterial phase.Ultrasound-guided puncture biopsy was used to confirm the diagnosis of the lesion as liver metastasis of duodenal GIST.Imatinib was prescribed after biopsy,and the patient’s clinical course was monitored.CONCLUSION H-CEUS is useful for detecting microcirculation differences,wash-in patterns,and vascular morphogenesis and diagnosing liver metastasis of duodenal GIST.

The microstructure evolution and deformation mechanism in a casting AM80 magnesium alloy under ultra-high strain rate loading

Ultra-high strain rate impact tests were conducted by Split-Hopkinson pressure bar to investigate the microstructure evolution and impact deformation mechanism of a solution treated casting AM80 Mg alloy at 25, 150 and 250 ℃ with a strain rate of 5000 s^(-1). The microcrack and dynamic recrystallization(DRX) preferentially nucleate at grain boundary(GB) and twin boundary(TB), especially at the intersections between GBs and TBs, and then propagate along twin direction. In contrast, the adiabatic shear bands preferentially occur at high-density twined regions. At 25 ℃, the dominated deformation mechanisms are basal slip and twinning. As deformation temperature increases to 150and 250℃, the deformation gradually shifts to be dominated by a coordinated mechanism among non-basal slip, twinning and DRX. The flow stress behavior and deformation mechanism indicate that the degree of decrease in flow stress with temperature is associated with the change of deformation mode.

A Joint Delay-and-Sum and Fourier Beamforming Method for High Frame Rate Ultrasound Imaging

Frame rate is an important metric for ultrasound imaging systems,and high frame rates(HFR)benefit moving-target imaging.One common way to obtain HFR imaging is to transmit a plane wave.Delay-and-sum(DAS)beamformer is a conventional beamforming algorithm,which is simple and has been widely implemented in clinical application.Fourier beamforming is an alternative method for HFR imaging and has high levels of imaging efficiency,imaging speed,and good temporal dynamic characteristics.Nevertheless,the resolution and contrast performance of HFR imaging based on DAS or Fourier beamforming are insufficient due to the single plane wave transmission.To address this problem,a joint DAS and Fourier beamforming method is introduced in this study.The proposed method considers the different distributions of sidelobes in DAS imaging and Fourier imaging and combines the angular spectrum and DAS to reconstruct ultrasound images.The proposed method is evaluated on simulation and experimental phantom datasets to compare its performance with DAS and Fourier beamforming methods.Results demonstrate that the proposed method improves image effective dynamic range and resolution while also retaining a high frame rate of the ultrasound imaging systems.The proposed method improves the effective dynamic range along axial and lateral directions by 10 dB,compared to standard DAS and Fourier beamforming.

100 Hertz frame-rate switching threedimensional orbital angular momentum multiplexing holography via cross convolution

The orbital angular momentum(OAM)of light has been implemented as an information carrier in OAM holography.Holographic information can be multiplexed in theoretical unbounded OAM channels,promoting the applications of optically addressable dynamic display and high-security optical encryption.However,the frame-rate of the dynamic extraction of the information reconstruction process in OAM holography is physically determined by the switching speed of the incident OAM states,which is currently below 30 Hz limited by refreshing rate of the phase-modulation spatial light modulator(SLM).Here,based on a cross convolution with the spatial frequency of the OAM-multiplexing hologram,the spatial frequencies of an elaborately-designed amplitude distribution,namely amplitude decoding key,has been adopted for the extraction of three-dimensional holographic information encoded in a specific OAM information channel.We experimentally demonstrated a dynamic extraction frame rate of 100 Hz from an OAM multiplexing hologram with 10 information channels indicated by individual OAM values from-50 to 50.The new concept of cross convolution theorem can even provide the potential of parallel reproduction and distribution of information encoded in many OAM channels at various positions which boosts the capacity of information processing far beyond the traditional decoding methods.Thus,our results provide a holographic paradigm for high-speed 3D information processing,paving an unprecedented way to achieve the high-capacity short-range optical communication system.

An Efficient Algorithm Based on Spectrum Migration for High Frame Rate Ultrasound Imaging

The high frame rate(HFR)imaging technique requires only one emission event for imaging.Therefore,it can achieve ultrafast imaging with frame rates up to the kHz regime,which satisfies the frame rate requirements for imaging moving tissues in scientific research and clinics.Lu’s Fourier migration method is based on a non-diffraction beam to obtain HFR images and can improve computational speed and efficiency.However,in order to obtain high-quality images,Fourier migration needs to make full use of the spectrum of echo signals for imaging,which requires a large number of Fast Fourier Transform(FFT)points and increases the complexity of the hardware when the echo frequency is high.Here,an efficient algorithm using the spectrum migration technique based on the spectrum’s distribution characteristics is proposed to improve the imaging efficiency in HFR imaging.Since the actual echo signal spectrum is of limited bandwidth,low-frequency and high-frequency parts with low-energy have little contribution to the imaging spectrum.We transform the effective part that provides the main energy in the signal spectrum to the imaging spectrum while the ineffective spectrum components are not utilized for imaging.This can significantly reduce the number of Fourier transform points,improve Fourier imaging efficiency,and ensure the imaging quality.The proposed method is evaluated on simulated and experimental datasets.Results demonstrated that the proposed method could achieve equivalent image quality with a reduced point number for FFT compared to the complete spectrum migration.In this paper,it only requires a quarter of the FFT points used in the complete spectrum migration,which can improve the computational efficiency;thus,it is more suitable for real-time data processing.The proposed spectrum migration method has a specific significance for the study and clinical application of HFR imaging.

A STUDY OF HIGH FRAME RATE ULTRASONIC IMAGING WITH LIMITED DIFFRACTION BEAMS

Objective To investigate a new class of solutions to the isotropic/homogeneous scalar wave equation, which termed limited diffraction beams and realize ultrasonic 3D imaging. Methods Limited diffraction beams were derived. We performed the study of 3D pulse echo imaging with limited diffraction array beam. To obtain high frame rate images, a single plane wave pulse (broadband) was transmitted with the arrays. Echoes received with the same arrays were processed with Fourier method to construct 3D images. Results Compared with traditional pulse echo imaging, this method has a larger depth of field, high frame rate, and high signal to noise ratio. Conclusion The new method has prospect of high frame rate 3D imaging. In addition, the imaging system based this method is easily implemented and has high quality image.

Rate-distortion optimized frame dropping and scheduling for multi-user conversational and streaming video

We propose a Rate-Distortion (RD) optimized strategy for frame-dropping and scheduling of multi-user conversa- tional and streaming videos. We consider a scenario where conversational and streaming videos share the forwarding resources at a network node. Two buffers are setup on the node to temporarily store the packets for these two types of video applications. For streaming video, a big buffer is used as the associated delay constraint of the application is moderate and a very small buffer is used for conversational video to ensure that the forwarding delay of every packet is limited. A scheduler is located behind these two buffers that dynamically assigns transmission slots on the outgoing link to the two buffers. Rate-distortion side information is used to perform RD-optimized frame dropping in case of node overload. Sharing the data rate on the outgoing link between the con- versational and the streaming videos is done either based on the fullness of the two associated buffers or on the mean incoming rates of the respective videos. Simulation results showed that our proposed RD-optimized frame dropping and scheduling ap- proach provides significant improvements in performance over the popular priority-based random dropping (PRD) technique.

Frame Detection Based on Cyclic Autocorrelation and Constant False Alarm Rate in Burst Communication Systems

Frame detection is important in burst communication systems for its contributions in frame synchronization.It locates the information bits in the received data stream at receivers.To realize frame detection in the presence of additive white Gaussian noise(AWGN) and frequency offset,a constant false alarm rate(CFAR) detector is proposed through exploitation of cyclic autocorrelation feature implied in the preamble.The frame detection can be achieved prior to bit timing recovery.The threshold setting is independent of the signal level and noise level by utilizing CFAR method.Mathematical expressions is derived in AWGN channel by considering the probability of false alarm and probability of detection,separately.Given the probability of false alarm,the mathematical relationship between the frame detection performance and E_b/N_0 of received signals is established.Experimental results are also presented in accordance with analysis.

Enhancement of Frame-rate Using Digital Camera

Frame rate is corresponding to the temporal resolution and the number of the pixels of the picture is corresponding to the spatial resolution. They are both very important for the researchers. The ideal image analysis and processing system should have high spatiotemporal characteristics, which is much expensive in practical use. A new method to enhance dynamic frame rate using multi-digital camera(DC) is proposed and the result shows that it could increase the frame rate effectively and decreases the cost in practical use.

Frame rate up-conversion using multiresolution critical point filters with occlusion refinement

In this paper, multiresolution critical-point filters (CPFs) are employed to image matching for frame rate up-conversion (FRUC). By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation (ORCMI). In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Experimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCMI can achieve 1～2 dB PSNR gain for standard video sequences.

基于DVB-S2X协议的低轨卫星通信性能仿真分析

介绍了DVB-S2X标准,重点分析了其中高阶调制技术的基本原理和星座映射,在进行星地链路分析的基础上,构建了DVB-S2X标准低轨卫星通信仿真模型,针对DVB-S2X标准中16APSK、32APSK、64APSK调制信号开展仿真试验,以误码率和丢帧率为指标进行通信性能分析。

基于FPGA的高速大面阵成像系统设计

为了获取高帧频大面阵图像数据,设计了一套基于FPGA结合CMOS图像探测器的成像系统。首先,介绍了国产GSENSE6060图像探测器的特性和设计方法。然后提出了成像系统的供电等硬件设计。最后,重点研究了基于Xilinx公司Virtex-5型FPGA的CMOS图像数据训练算法,保证了数据采集的准确性。试验结果表明,所设计的成像系统在6 144 pixel×6 144 pixel分辨率时,帧频达20 frame/s,图像数据峰值速率16 Gbit/s,且读出噪声优于4e^(-)。目前,系统已经工程应用,其功能、性能满足了项目实际需要。

面向高帧率CMOS图像传感器的12位列级全差分SAR/SS ADC设计

针对高帧率CMOS图像传感器的应用需求,提出一种结合逐次逼近型(Successive Approximation Register,SAR)和单斜坡(Single Slope,SS)结构的混合型模拟数字转换器(Analog to Digital Converter,ADC)。该ADC的分辨率为12位,其中SAR ADC实现高6位量化,SS ADC实现低6位量化。该ADC采用了全差分结构消除采样开关的固定失调并减少非线性误差,同时在SAR ADC中采用了异步逻辑电路进一步缩短转换周期。采用110 nm 1P4M CMOS工艺对该电路进行了设计和版图实现,后仿真结果表明,在20 MHz的时钟下,转换周期仅为3.3μs,无杂散动态范围为77.12 dB,信噪失真比为67.38 dB,有效位数为10.90位。

一种高帧频大动态范围像素级数字化读出电路设计

与短波和中波器件相比,长波红外探测器具有较大的光电流和暗电流,故需要强大的电荷存储能力。而使用传统的模拟像元读出电路技术会严重受限于电荷存储能力,使得长波探测器的动态范围和信噪比难以提升,从而制约着长波红外成像系统的发展和应用。提出一种像素级数字读出电路技术,通过数字积分克服了传统模拟积分方案电荷存储能力受限的缺陷,实现了探测器的数字信号输出,能够极大提高探测器的动态范围、抗干扰能力和帧频。该技术是提升长波探测器性能的有效途径。基于该技术设计了一款像元间距为30 m的320×256数字读出电路,其输出以低压差分信号(Low Voltage Differential Signal,LVDS)方式传输。仿真结果显示,该电路的最高帧频可达1000 Hz,动态范围大于95 dB。

多尺度特征融合下的高帧频图像关键目标识别

为优化高帧频图像目标识别效果,提出基于多尺度特征融合的高帧频图像关键目标识别方法。结合空域双边滤波算法和双树复小波变换算法去除高帧频图像噪声。通过多个卷积模块提取图像特征,并在分支空间注意力机制、改进通道注意力网络下融合多尺度特征。引入联合稀疏概念表征融合后的多尺度特征,并将其输入卷积神经网络结构中进一步学习,输出关键目标识别结果。实验结果表明,所提方法应用后AUC值为0.91,满足了高帧频图像处理要求。

汽车智能驾舱驾驶疲劳检测系统设计

疲劳驾驶是影响交通安全的主要因素,当前疲劳驾驶的检测方法普遍存在设备体积大、侵入性强、实时性差等弊端。文中设计的基于FPGA的疲劳驾驶检测系统,首先利用区域长宽比改进YCbCr人脸分割算法,提高算法在驾驶环境中对于人脸的辨识度;然后建立动态视频人眼跟踪模型,在人脸范围内定位人眼位置,采用三帧差算法检测眨眼动作,以眨眼率作为疲劳的评价指标,对司机状态进行实时监控;最后利用FPGA芯片完成实时图像数据的处理和疲劳驾驶检测。实验证明,该系统具备在光线昏暗和佩戴眼镜等场景下检测疲劳状态的能力,并且检测系统充分发挥FPGA芯片数据并行处理优势,具备体积小、速度快、集成度高,通电即可工作的特点,有利于在狭小的驾驶舱环境部署,具有一定的工程应用价值。

面向H.266/VVC的R-λ帧内码率控制算法

在R-λ帧内码控中,提出基于卷积神经网络(Convolutional Neural Networks,CNN)的最佳比特分配和最优拉格朗日因子λ选择。首先,探索编码树单元(Coding Tree Unit,CTU)的码率与失真(Rate-Distortion,R-D)及码率与拉格朗日因子λ(Rate-λ,R-λ)的关系特性,设计具有四输出的CNN预测R-D和R-λ曲线的关键参数;然后,建立帧级λ和目标码率的优化方程,反演得到最佳CTU码率分配;最后,根据CTU码率分配和先知的R-λ曲线,得到最优CTU级λ。实验表明,算法在保持4.76%控制精度下,比VTM13.0默认码控算法提高0.31 dB的编码质量。