Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Interactive holography offers unmatched levels of immersion and user engagement in the field of future display.Despite of the substantial progress has been made in dynamic meta-holography,the realization of real-time,highly smooth interactive holography remains a significant challenge due to the computational and display frame rate limitations.In this study,we introduced a dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates.To our knowledge,this is the first reported practical dynamic interactive metasurface holographic system.We spa-tially divided the metasurface device into multiple distinct channels,each projecting a reconstructed sub-pattern.The switching states of these channels were mapped to bitwise operations on a set of bit values,which avoids complex holo-gram computations,enabling an ultra-high computational frame rate.Our approach achieves a computational frame rate of 800 kHz and a display frame rate of 23 kHz on a low-power Raspberry Pi computational platform.According to this methodology,we demonstrated an interactive dynamic holographic Tetris game system that allows interactive gameplay,color display,and on-the-fly hologram creation.Our technology presents an inspiration for advanced dynamic meta-holography,which is promising for a broad range of applications including advanced human-computer interaction,real-time 3D visualization,and next-generation virtual and augmented reality systems.

A Joint Delay-and-Sum and Fourier Beamforming Method for High Frame Rate Ultrasound Imaging

Frame rate is an important metric for ultrasound imaging systems,and high frame rates(HFR)benefit moving-target imaging.One common way to obtain HFR imaging is to transmit a plane wave.Delay-and-sum(DAS)beamformer is a conventional beamforming algorithm,which is simple and has been widely implemented in clinical application.Fourier beamforming is an alternative method for HFR imaging and has high levels of imaging efficiency,imaging speed,and good temporal dynamic characteristics.Nevertheless,the resolution and contrast performance of HFR imaging based on DAS or Fourier beamforming are insufficient due to the single plane wave transmission.To address this problem,a joint DAS and Fourier beamforming method is introduced in this study.The proposed method considers the different distributions of sidelobes in DAS imaging and Fourier imaging and combines the angular spectrum and DAS to reconstruct ultrasound images.The proposed method is evaluated on simulation and experimental phantom datasets to compare its performance with DAS and Fourier beamforming methods.Results demonstrate that the proposed method improves image effective dynamic range and resolution while also retaining a high frame rate of the ultrasound imaging systems.The proposed method improves the effective dynamic range along axial and lateral directions by 10 dB,compared to standard DAS and Fourier beamforming.

100 Hertz frame-rate switching threedimensional orbital angular momentum multiplexing holography via cross convolution

The orbital angular momentum(OAM)of light has been implemented as an information carrier in OAM holography.Holographic information can be multiplexed in theoretical unbounded OAM channels,promoting the applications of optically addressable dynamic display and high-security optical encryption.However,the frame-rate of the dynamic extraction of the information reconstruction process in OAM holography is physically determined by the switching speed of the incident OAM states,which is currently below 30 Hz limited by refreshing rate of the phase-modulation spatial light modulator(SLM).Here,based on a cross convolution with the spatial frequency of the OAM-multiplexing hologram,the spatial frequencies of an elaborately-designed amplitude distribution,namely amplitude decoding key,has been adopted for the extraction of three-dimensional holographic information encoded in a specific OAM information channel.We experimentally demonstrated a dynamic extraction frame rate of 100 Hz from an OAM multiplexing hologram with 10 information channels indicated by individual OAM values from-50 to 50.The new concept of cross convolution theorem can even provide the potential of parallel reproduction and distribution of information encoded in many OAM channels at various positions which boosts the capacity of information processing far beyond the traditional decoding methods.Thus,our results provide a holographic paradigm for high-speed 3D information processing,paving an unprecedented way to achieve the high-capacity short-range optical communication system.

High-frame-rate contrast-enhanced ultrasound findings of liver metastasis of duodenal gastrointestinal stromal tumor:A case report and literature review

BACKGROUND Liver metastasis of duodenal gastrointestinal stromal tumor(GIST)is rare.Most reports mainly focus on its treatment and approaches to surgical resection,while details on its contrast-enhanced ultrasound(CEUS)findings are lacking.The diagnosis and imaging modalities for this condition remain challenging.CASE SUMMARY A 53-year-old Chinese man presented with mild signs and symptoms of the digestive tract.He underwent routine examinations after GIST surgery.Magnetic resonance imaging showed a 2.3 cm hepatic space-occupying lesion.All the laboratory test results were within normal limits.For further diagnostic confirmation,we conducted high frame rate CEUS(H-CEUS)and found a malignant perfusion pattern.Heterogeneous concentric hyper-enhancement,earlier wash-in than the liver parenchyma,and two irregular vessel columns could be observed at the periphery of the lesion during the arterial phase.Ultrasound-guided puncture biopsy was used to confirm the diagnosis of the lesion as liver metastasis of duodenal GIST.Imatinib was prescribed after biopsy,and the patient’s clinical course was monitored.CONCLUSION H-CEUS is useful for detecting microcirculation differences,wash-in patterns,and vascular morphogenesis and diagnosing liver metastasis of duodenal GIST.

An Efficient Algorithm Based on Spectrum Migration for High Frame Rate Ultrasound Imaging

The high frame rate(HFR)imaging technique requires only one emission event for imaging.Therefore,it can achieve ultrafast imaging with frame rates up to the kHz regime,which satisfies the frame rate requirements for imaging moving tissues in scientific research and clinics.Lu’s Fourier migration method is based on a non-diffraction beam to obtain HFR images and can improve computational speed and efficiency.However,in order to obtain high-quality images,Fourier migration needs to make full use of the spectrum of echo signals for imaging,which requires a large number of Fast Fourier Transform(FFT)points and increases the complexity of the hardware when the echo frequency is high.Here,an efficient algorithm using the spectrum migration technique based on the spectrum’s distribution characteristics is proposed to improve the imaging efficiency in HFR imaging.Since the actual echo signal spectrum is of limited bandwidth,low-frequency and high-frequency parts with low-energy have little contribution to the imaging spectrum.We transform the effective part that provides the main energy in the signal spectrum to the imaging spectrum while the ineffective spectrum components are not utilized for imaging.This can significantly reduce the number of Fourier transform points,improve Fourier imaging efficiency,and ensure the imaging quality.The proposed method is evaluated on simulated and experimental datasets.Results demonstrated that the proposed method could achieve equivalent image quality with a reduced point number for FFT compared to the complete spectrum migration.In this paper,it only requires a quarter of the FFT points used in the complete spectrum migration,which can improve the computational efficiency;thus,it is more suitable for real-time data processing.The proposed spectrum migration method has a specific significance for the study and clinical application of HFR imaging.

A STUDY OF HIGH FRAME RATE ULTRASONIC IMAGING WITH LIMITED DIFFRACTION BEAMS

Objective To investigate a new class of solutions to the isotropic/homogeneous scalar wave equation, which termed limited diffraction beams and realize ultrasonic 3D imaging. Methods Limited diffraction beams were derived. We performed the study of 3D pulse echo imaging with limited diffraction array beam. To obtain high frame rate images, a single plane wave pulse (broadband) was transmitted with the arrays. Echoes received with the same arrays were processed with Fourier method to construct 3D images. Results Compared with traditional pulse echo imaging, this method has a larger depth of field, high frame rate, and high signal to noise ratio. Conclusion The new method has prospect of high frame rate 3D imaging. In addition, the imaging system based this method is easily implemented and has high quality image.

Frame Detection Based on Cyclic Autocorrelation and Constant False Alarm Rate in Burst Communication Systems

Frame detection is important in burst communication systems for its contribu- tions in frame synchronization. It locates the information bits in the received data stream at receivers. To realize frame detection in the presence of additive white Gaussian noise （AWGN） and frequency offset, a constant false alarm rate （CFAR） detector is proposed through exploitation of cyclic autocorrelation feature implied in the preamble. The frame detection can be achieved prior to bit timing recovery. The threshold setting is independent of the signal level and noise level by utilizing CFAR method. Mathematical expressions is derived in AWGN channel by considering the probability of false alarm and probability of detection, separately. Given the probability of false alarm, the mathematical relationship between the frame detection performance and EJNo of received signals is established. Ex- perimental results are also presented in accor- dance with analysis.

Frame rate up-conversion using multiresolution critical point filters with occlusion refinement

In this paper, multiresolution critical-point filters （CPFs） are employed to image matching for frame rate up-conversion （FRUC）. By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation （ORCMI）. In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Ex- perimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCM1 can achieve 1-2 dB PSNR gain for standard video sequences.

Enhancement of Frame-rate Using Digital Camera

Frame rate is corresponding to the temporal resolution and the number of the pixels of the picture is corresponding to the spatial resolution. They are both very important for the researchers. The ideal image analysis and processing system should have high spatiotemporal characteristics, which is much expensive in practical use. A new method to enhance dynamic frame rate using multi-digital camera(DC) is proposed and the result shows that it could increase the frame rate effectively and decreases the cost in practical use.

A novel dynamic frame rate control algorithm for H.264 low-bit-rate video coding

The goal of this paper is to improve human visual perceptual quality as well as coding efficiency of H. 264 video at low bit rate conditions by adaptively adjusting the number of skipped frames. The encoding frames are selected according to the motion activity of each frame and the motion accumulation of successive frames. The motion activity analysis is based on the statistics of motion vectors and with consider- ation of the characteristics of H. 264 coding standard. A prediction model of motion accumulation is pro- posed to reduce complex computation of motion estimation. The dynamic encoding frame rate control algorithm is applied to both the frame level and the GOB （Group of Macroblocks ） level. Simulation is done to compare the performance of JM76 with the proposed frame level scheme and GOB level scheme.

Rate-distortion optimized frame dropping and scheduling for multi-user conversational and streaming video

We propose a Rate-Distortion (RD) optimized strategy for frame-dropping and scheduling of multi-user conversa- tional and streaming videos. We consider a scenario where conversational and streaming videos share the forwarding resources at a network node. Two buffers are setup on the node to temporarily store the packets for these two types of video applications. For streaming video, a big buffer is used as the associated delay constraint of the application is moderate and a very small buffer is used for conversational video to ensure that the forwarding delay of every packet is limited. A scheduler is located behind these two buffers that dynamically assigns transmission slots on the outgoing link to the two buffers. Rate-distortion side information is used to perform RD-optimized frame dropping in case of node overload. Sharing the data rate on the outgoing link between the con- versational and the streaming videos is done either based on the fullness of the two associated buffers or on the mean incoming rates of the respective videos. Simulation results showed that our proposed RD-optimized frame dropping and scheduling ap- proach provides significant improvements in performance over the popular priority-based random dropping (PRD) technique.

Monte Carlo method for evaluation of surface emission rate measurement uncertainty

The aim of this study is to evaluate the uncertainty of 2πα and 2πβ surface emission rates using the windowless multiwire proportional counter method.This study used the Monte Carlo method (MCM) to validate the conventional Guide to the Expression of Uncertainty in Measurement (GUM) method.A dead time measurement model for the two-source method was established based on the characteristics of a single-channel measurement system,and the voltage threshold correction factor measurement function was indirectly obtained by fitting the threshold correction curve.The uncertainty in the surface emission rate was calculated using the GUM method and the law of propagation of uncertainty.The MCM provided clear definitions for each input quantity and its uncertainty distribution,and the simulation training was realized with a complete and complex mathematical model.The results of the surface emission rate uncertainty evaluation for four radioactive plane sources using both methods showed the uncertainty’s consistency E_(n)<0.070 for the comparison of each source,and the uncertainty results of the GUM were all lower than those of the MCM.However,the MCM has a more objective evaluation process and can serve as a validation tool for GUM results.

Real-Time Mosaic Method of Aerial Video Based on Two-Stage Key Frame Selection Method

A two-stage automatic key frame selection method is proposed to enhance stitching speed and quality for UAV aerial videos. In the first stage, to reduce redundancy, the overlapping rate of the UAV aerial video sequence within the sampling period is calculated. Lagrange interpolation is used to fit the overlapping rate curve of the sequence. An empirical threshold for the overlapping rate is then applied to filter candidate key frames from the sequence. In the second stage, the principle of minimizing remapping spots is used to dynamically adjust and determine the final key frame close to the candidate key frames. Comparative experiments show that the proposed method significantly improves stitching speed and accuracy by more than 40%.

Frame-layer bit allocation for multi-view video coding based on frame complexity estimation

Current multi-view video coding （MVC） reference model in joint video team （JVT） does not provide efficient rate control schemes. This paper presents a rate control algorithm for MVC by improving the quadratic rate-distortion （R-D） model. We reasonably allocate bit-rate among views based on the correlation analysisl The proposed algorithm consists of three levels to control the rate bits more accurately, of which the frame layer allocates bits according to the frame complexity and the temporal activity. Extensive experiments show that the proposed algorithm can control the bit rate efficiently.

Adaptive learning rate GMM for moving object detection in outdoor surveillance for sudden illumination changes

A dynamic learning rate Gaussian mixture model（GMM）algorithm is proposed to deal with the problem of slow adaption of GMM in the case of moving object detection in the outdoor surveillance,especially in the presence of sudden illumination changes.The GMM is mostly used for detecting objects in complex scenes for intelligent monitoring systems.To solve this problem,a mixture Gaussian model has been built for each pixel in the video frame,and according to the scene change from the frame difference,the learning rate of GMM can be dynamically adjusted.The experiments show that the proposed method gives good results with an adaptive GMM learning rate when we compare it with GMM method with a fixed learning rate.The method was tested on a certain dataset,and tests in the case of sudden natural light changes show that our method has a better accuracy and lower false alarm rate.

Target rotation parameter estimation for ISAR imaging via frame processing

Frame processing method offers a model-based approach to Inverse Synthetic Aperture Radar(ISAR) imaging. It also provides a way to estimate the rotation rate of a non-cooperative target from radar returns via the frame operator properties. In this paper, the relationship between the best achievable ISAR image and the reconstructed image from radar returns was derived in the framework of Finite Frame Processing theory. We show that image defocusing caused by the use of an incorrect target rotation rate is interpreted under the FP method as a frame operator mismatch problem which causes energy dispersion. The unknown target rotation rate may be computed by optimizing the frame operator via a prominent point. Consequently, a prominent intensity maximization method in FP framework was proposed to estimate the underlying target rotation rate from radar returns. In addition, an image filtering technique was implemented to assist searching for a prominent point in practice. The proposed method is justified via a simulation analysis on the performance of FP imaging versus target rotation rate error.Effectiveness of the proposed method is also confirmed from real ISAR data experiments.

Theoretical analysis of pilotless frame synchronization for LDPC code using Gaussian approximation

The pilotless frame synchronization approach and implementations of LDPC code are the crucial issue of LDPC decoder. The Maximum-A-Posteriori probability( MAP) decoder has a perfect frame synchronization error rate( FSER) performance. In this paper,a theoretical derivation of the FSER performance of pilotless frame synchronization for LDPC code is presented. The FSER performance by theoretical analysis coincides well with that by simulation in additive white Gaussian channel and Rician fading channel. So it is estimated the FSER performance of an LDPC code by theoretical analysis can be used instead of the simulations which are much more time-consuming.

EFFICIENT DESIGN OF ANTI-JAMMING RATELESS CODING IN COGNITIVE OFDM

Efficient anti-jamming rateless coding based on cognitive Orthogonal Frequency Division Multiplexing (OFDM) modulation in Cognitive Radio Network (CRN) is mainly discussed. Rateless coding with small redundancy and low complexity is presented, and the optimal design methods of building rateless codes are also proposed. In CRN, anti-jamming rateless coding could recover the lost packets in parallel channels of cognitive OFDM, thus it protects Secondary Users (SUs) from the in-terference by Primary Users (PUs) efficiently. Frame Error Rate (FER) and throughput performance of SU employing anti-jamming rateless coding are analyzed in detail. Performance comparison between rateless coding and piecewise coding are also presented. It is shown that, anti-jamming rateless coding provides low FER and Word Error Rate (WER) performance with uniform sub-channel selection. Meanwhile, it is also verified that, in higher jamming rate and longer code redundancy scenario, rateless coding method could achieve better FER and throughput performance than another anti-jamming coding schemes.

An Improvement of MPEG-4 Rate Control Algorithm

Frame skipping in low bit video coding could significantly reduce the visual quality of reconstructed video. At the same time, if the complexity of the video sequence remains high for a long period, then driving up the long term average bit rate, the only resort of MPEG-4 Q2 rate control algorithm results in using a high quantization scale, which shows a poor visual quality of the reconstructed video. This paper analyzes the main causes of frame skipping in current MPEG-4 frame rate control scheme, and presents a new rate control algorithm based on the quadratic R-D model over a CBR channel. Key features of the present work are: 1) the bits allocated to each P-frame or B-frame are in proportion to its distance from the end of this GOP, i.e. more bits are allocated to the frames that are nearer to their reference Ⅰ-frame; 2) the target buffer level is changeable in the GOP, at the end of each GOP(five P-frames or B-frames), the target buffer level is linearly reduced from 1/2 to 1/4 of buffer size, to other frames, the target buffer level is set to 1/2 of buffer size; 3) a selective and judicious use of the reduced resolution mode, in addition to a modulation of the quantization scale parameter, is to control the average long term bit rate. Experimental results with different video sequences of varied complexity, encoded at low bit rates show better efficacy of the proposed algorithm than MPEG-4 Q2 rate control scheme, and the experimental results also show that the improved algorithm has significantly reduced the number of frame skipping, increased the overall PSNR, and improved the perceptual quality.

A rate-distortion optimized rate shaping scheme for H.264 data partitioned video bitstream

To enable quality sealability and further improve the reconstructed video quallty m rate shaping, a rate-distortion optimized packet dropping scheme for H. 264 data partitioned video bitstream is proposed in this paper. Some side information is generated for each video bitstream in advance, while streaming such side information is exploited by a greedy algorithm to optimally drop partitions in a rate-distortion optimized way. Quality sealability is supported by adopting data partition instead of whole frame as the dropping unit. Simulation resuhs show that the proposed scheme achieves a great gain in the reconstructed video quality over two typical frame dropping schemes, with the help of the fine granularity in dropping unit as well as rate-distortion optimization.