Integral imaging-based tabletop light field 3D display with large viewing angle

Light field 3D display technology is considered a revolutionary technology to address the critical visual fatigue issues in the existing 3D displays.Tabletop light field 3D display provides a brand-new display form that satisfies multi-user shared viewing and collaborative works,and it is poised to become a potential alternative to the traditional wall and portable display forms.However,a large radial viewing angle and correct radial perspective and parallax are still out of reach for most current tabletop light field 3D displays due to the limited amount of spatial information.To address the viewing angle and perspective issues,a novel integral imaging-based tabletop light field 3D display with a simple flat-panel structure is proposed and developed by applying a compound lens array,two spliced 8K liquid crystal display panels,and a light shaping diffuser screen.The compound lens array is designed to be composed of multiple three-piece compound lens units by employing a reverse design scheme,which greatly extends the radial viewing angle in the case of a limited amount of spatial information and balances other important 3D display parameters.The proposed display has a radial viewing angle of 68.7°in a large display size of 43.5 inches,which is larger than the conventional tabletop light field 3D displays.The radial perspective and parallax are correct,and high-resolution 3D images can be reproduced in large radial viewing positions.We envision that this proposed display opens up possibility for redefining the display forms of consumer electronics.

The Flipping-Free Full-Parallax Tabletop Integral Imaging with Enhanced Viewing Angle Based on Space-Multiplexed Voxel Screen and Compound Lens Array

Tabletop integral imaging display with a more realistic and immersive experience has always been a hot spot in three-dimensional imaging technology,widely used in biomedical imaging and visualization to enhance medical diagnosis.However,the traditional structural characteristics of integral imaging display inevitably introduce the flipping effect outside the effective viewing angle.Here,a full-parallax tabletop integral imaging display without the flipping effect based on space-multiplexed voxel screen and compound lens array is demonstrated,and two holographic functional screens with different parameters are optically designed and fabricated.To eliminate the flipping effect in the reconstruction process,the space-multiplexed voxel screen consisting of a projector array and the holographic functional screen is presented to constrain light beams passing through the corresponding lens.To greatly promote imaging quality within the viewing area,the aspherical structure of the compound lens is optimized to balance the aberrations.It cooperates with the holographic functional screen to modulate the light field spatial distribution.Compared with the simulation results,the distortion rate of the imaging display is reduced to less than 9%from more than 30%.In the experiment,the floating high-quality reconstructed three-dimensional image without the flipping effect can be observed with the correct 3D perception at 96°×96°viewing angle,where 44,100 viewpoints are employed.

Position detection of component aperture based on integral imaging technology

Aiming at the problem that it is difficult to locate all the aperture positions of the large size component using Houghcircle detection method,this article presents a non-contact measurement method combining the integral imaging technology withHough circle detection algorithm.Firstly,a set of integral imaging information acquisition algorithms were proposed accordingto the classical imaging theory.Secondly,the camera array experiment device was built by using two-dimensional translationstage and charge coupled device(CCD)camera.When the system is operating,element image array captured with the camera isused to achieve the positioning of the component aperture using Hough circle detection and coordinate acquisition algorithm.Based on the above theory,a verification experiment was carried out.The results show that the detection error of the componentaperture position is within0.3mm,which provides effective theoretical support for the application of integral imagingtechnology in high precision detection

Continuous imaging space in three-dimensional integral imaging

We report an integral imaging method with continuous imaging space. This method simultaneously reconstructs real and virtual images in the virtual mode, with a minimum gap that separates the entire imaging space into real and virtual space. Experimental results show that the gap is reduced to 45% of that in a conventional integral imaging system with the same parameters.

High Optical Magnification Three-Dimensional Integral Imaging of Biological Micro-organism

A high optical magnification three-dimensional imaging system is proposed using an optic microscope whose ocular （eyepiece） is retained and the structure of the transmission mode is not destroyed. The elemental image array is captured through the micro lens array. Due to the front diffuse transmission element, each micro lens sees a slightly different spatial perspective of the scene, and a different independent image is formed in each micro lens channel. Each micro lens channel is imaged by a Fourier lens and captured by a CCD. The design translating the stage in x or y provides no parallax. Compared with the conventional integral imaging of micro-objects, the optical magnification of micro-objects in the proposed system can enhanced remarkably. The principle of the enhancement of the image depth is explained in detail and the experimental results are presented.

Fast acquisition of 3D images in a modified optical microscope based on integral imaging

This paper introduces a new technique of fast acquiring 3D information in microscope based on integral imaging. Experimental results prove that the proposed method has advantageous properties including simple configuration, no requirement of coherent light source and real-time 3D imaging information acquisition. This technique has an important prospect on optical microscopy and 3D display.

Cross-talk-free integral imaging three-dimensional display based on a pyramid pinhole array

We propose a cross-talk-free integral imaging 3D display based on a pyramid pinhole array. The pyramid pinhole array is used to provide a point light source array. Since the generated point light source array is behind a transmission-type display panel that displays an elemental image array, the pseudoscopic problem can be resolved. By setting the appropriate parameters for the pyramid pinhole array, the cross talk can be eliminated.We experimentally verify the reconstruction of the orthoscopic and cross-talk-free 3D images using the proposed 3D display.

Crosstalk-free integral imaging display based on double plano-convex micro-lens array

A crosstalk-free integral imaging display consisting of a display panel and double piano-convex micro-lens array is proposed. The double piano-convex micro-lens array includes two micro-lens arrays, A and B. Micro-lens array A is used to eliminate crosstalk by completely reflecting crosstalk lights. Micro-lens array B, located near microqens array A, is used to display three-dimensional images. Computer simulations based on ray-tracing are conducted. Crosstalk-free reconstruction images may be clearly observed from the simulation results.

End-to-end optimization of a diffractive optical element and aberration correction for integral imaging

In the integral imaging light field display, the introduction of a diffractive optical element (DOE) can solve the problem of limited depth of field of the traditional lens. However, the strong aberration of the DOE significantly reduces the final display quality. Thus, herein, an end-to-end joint optimization method for optimizing DOE and aberration correction is proposed. The DOE model is established using thickness as the variable, and a deep learning network is built to preprocess the composite image loaded on the display panel. The simulation results show that the peak signal to noise ratio value of the optimized image increases by 8 dB, which confirms that the end-to-end joint optimization method can effectively reduce the aberration problem.

1D integral imaging based on parallax images' virtual reconstruction

One-dimensional （ID） integral imaging based on parallax images＇ virtual reconstruction is proposed. The 1D integral imaging contains parallax images＇ capture process, parallax images＇ virtual reconstruction process, and ID elemental image array＇s generation process. A pixel mapping algorithm is deduced to implement the last two processes; a ID elemental image array is generated by the mapping of pixels on the parallax images obtained using a ID camera array. The proposed ID integral imaging can capture the ID elemental image array of a real three-dimensional （3D） scene.

Advances in the light field displays based on integral imaging and holographic techniques(Invited Paper)

Light field displays comprise three-dimensional （3D） visual information presentation devices capable of providing realistic and full parallax autostereoscopic images. In this letter, the recent advances in the light field displays based on integral imaging （II） and holographic techniques are presented. Several advanced approaches to demonstrate the light field displays including viewing angle enhancement techniques of the II display, a fast hologram generation method using graphics processing unit （GPU） and multiple WRPs, and a holographic microscopy to display the living cells are reported. These methods improve some important constraints of the light field displays and add new features.

A lattice measuring method based on integral imaging technology

Aiming at the problem that the lattice feature exceeds the view field of the scanning electron microscope(SEM)measuring system,a new lattice measuring method is proposed based on integral imaging technology.When the system works,the SEM measuring system is equivalent to an integral image acquisition system.Firstly,a lattice measuring method is researched based on integral imaging theory.Secondly,the system parameters are calibrated by the VLSI lattice standard.Finally,the value of the lattice standard to be tested is determined based on the calibration parameters and the lattice measuring algorithm.The experimental results show that,compared with the traditional electron microscope measurement method,the relative error of the measured value of the algorithm is maintained within 0.2%,with the same level of measurement accuracy,but it expands the field of view of the electron microscope measurement system,which is suitable for the measurement of samples under high magnification.

3D image reconstruction with a controllable overlapping number of elemental images in computational integral imaging

In this Letter, we propose a three-dimensional （3D） image reconstruction method with a controllable overlapping number of elemental images in computational integral imaging. The proposed method can control the overlap- ping number of pixels coming from the elemental images by using the subpixel distance based on ray optics between a 3D object and an image sensor. The use of a controllable overlapping number enables us to provide an improved 3D image visualization by controlling the inter-pixel interference within the reconstructed pixels. To find the optimal overlapping number, we simulate the pickup and reconstruction processes and utilize the numerical reconstruction results using a peak signal-to-noise ratio （PSNR） metric. To demonstrate the feasibility of our work in optical experiments, we carry out the preliminary experiments and present the results.

Phase-only hologram generation based on integral imaging and its enhancement in depth resolution

We introduce a phase-only hologram generation method based on an integral imaging, and propose an enhancement method in representable depth interval. The computational integral imaging reconstruction method is modified based on optical flow to obtain depth-slice images for the focused objects only. A phaseonly hologram for＇ multiple plane images is generated using the iterative Fresnel transform algorithm. In addition, a division method in hologram plane is proposed for enhancement in the representable minimum depth interval.

3D image reconstruction with controllable spatial filtering based on correlation of multiple periodic functions in computational integral imaging

We propose a novel method of slice image reconstruction with controllable spatial filtering by using the correlation of periodic delta-function arrays （PDFAs） with elemental images in computational integral imaging. The multiple PDFAs, whose spatial periods correspond to object＇s depths with the elemental image array （EIA）, can generate a set of spatially filtered EIAs for multiple object depths compared with the conventional method for the depth of a single object. We analyze a controllable spatial filtering effect by the proposed method. To show the feasibility of the proposed method, we carry out preliminary experiments for multiple objects and present the results.

Distortion correction for the elemental images of integral imaging by introducing the directional diffuser

A distortion correction method for the elemental images of integral imaging（Ⅱ） by utilizing the directional diffuser is demonstrated. In the traditional Ⅱ, the distortion originating from lens aberration wraps elemental images and degrades the image quality severely. According to the theoretical analysis and experiments, it can be proved that the farther the three-dimensional image is displayed from the lens array, the more serious the distortion is. To analyze the process of eliminating lens distortion, one lens and its corresponding elemental image are separated from the traditional Ⅱ. By introducing the directional diffuser, the aperture stop of the separated optical system changes from the eye＇s pupil to the lens. In terms of contrast experiments, the distortion of the improved display system is corrected effectively. In the experiment, when the distance between the reconstructed image and lens array is equal to 120 mm, the largest lens distortion is decreased from 46.6% to 3.3%.

Depth extraction method with high accuracy in integral imaging based on moving array lenslet technique

In order to improve depth extraction accuracy, a method using moving array lenslet technique(MALT) in pickup stage is proposed, which can decrease the depth interval caused by pixelation. In this method, the lenslet array is moved along the horizontal and vertical directions simultaneously for N times in a pitch to get N sets of elemental images. Computational integral imaging reconstruction method for MALT is taken to obtain the slice images of the 3 D scene, and the sum modulus(SMD) blur metric is taken on these slice images to achieve the depth information of the 3 D scene. Simulation and optical experiments are carried out to verify the feasibility of this method.

3D Depth Measurement for Holoscopic 3D Imaging System

Holoscopic 3D imaging is a true 3D imaging system mimics fly’s eye technique to acquire a true 3D optical model of a real scene. To reconstruct the 3D image computationally, an efficient implementation of an Auto-Feature-Edge (AFE) descriptor algorithm is required that provides an individual feature detector for integration of 3D information to locate objects in the scene. The AFE descriptor plays a key role in simplifying the detection of both edge-based and region-based objects. The detector is based on a Multi-Quantize Adaptive Local Histogram Analysis (MQALHA) algorithm. This is distinctive for each Feature-Edge (FE) block i.e. the large contrast changes (gradients) in FE are easier to localise. The novelty of this work lies in generating a free-noise 3D-Map (3DM) according to a correlation analysis of region contours. This automatically combines the exploitation of the available depth estimation technique with edge-based feature shape recognition technique. The application area consists of two varied domains, which prove the efficiency and robustness of the approach: a) extracting a set of setting feature-edges, for both tracking and mapping process for 3D depthmap estimation, and b) separation and recognition of focus objects in the scene. Experimental results show that the proposed 3DM technique is performed efficiently compared to the state-of-the-art algorithms.

Enhanced 3D Point Cloud Reconstruction for Light Field Microscopy Using U-Net-Based Convolutional Neural Networks

This article describes a novel approach for enhancing the three-dimensional(3D)point cloud reconstruction for light field microscopy(LFM)using U-net architecture-based fully convolutional neural network(CNN).Since the directional view of the LFM is limited,noise and artifacts make it difficult to reconstruct the exact shape of 3D point clouds.The existing methods suffer from these problems due to the self-occlusion of the model.This manuscript proposes a deep fusion learning(DL)method that combines a 3D CNN with a U-Net-based model as a feature extractor.The sub-aperture images obtained from the light field microscopy are aligned to form a light field data cube for preprocessing.A multi-stream 3D CNNs and U-net architecture are applied to obtain the depth feature fromthe directional sub-aperture LF data cube.For the enhancement of the depthmap,dual iteration-based weighted median filtering(WMF)is used to reduce surface noise and enhance the accuracy of the reconstruction.Generating a 3D point cloud involves combining two key elements:the enhanced depth map and the central view of the light field image.The proposed method is validated using synthesized Heidelberg Collaboratory for Image Processing(HCI)and real-world LFM datasets.The results are compared with different state-of-the-art methods.The structural similarity index(SSIM)gain for boxes,cotton,pillow,and pens are 0.9760,0.9806,0.9940,and 0.9907,respectively.Moreover,the discrete entropy(DE)value for LFM depth maps exhibited better performance than other existing methods.

Wavelets and Continuous Wavelet Transform for Autostereoscopic Multiview Images

Recently, the reference functions for the synthesis and analysis of the autostereoscopic multiview and integral images in three-dimensional displays were introduced. In the current paper, we propose the wavelets to analyze such images. The wavelets are built on these reference functions as on the scaling functions of the wavelet analysis. The continuous wavelet transform was successfully applied to the testing wireframe binary objects. The restored locations correspond to the structure of the testing wireframe binary objects.