Integral imaging-based tabletop light field 3D display with large viewing angle

Light field 3D display technology is considered a revolutionary technology to address the critical visual fatigue issues in the existing 3D displays.Tabletop light field 3D display provides a brand-new display form that satisfies multi-user shared viewing and collaborative works,and it is poised to become a potential alternative to the traditional wall and portable display forms.However,a large radial viewing angle and correct radial perspective and parallax are still out of reach for most current tabletop light field 3D displays due to the limited amount of spatial information.To address the viewing angle and perspective issues,a novel integral imaging-based tabletop light field 3D display with a simple flat-panel structure is proposed and developed by applying a compound lens array,two spliced 8K liquid crystal display panels,and a light shaping diffuser screen.The compound lens array is designed to be composed of multiple three-piece compound lens units by employing a reverse design scheme,which greatly extends the radial viewing angle in the case of a limited amount of spatial information and balances other important 3D display parameters.The proposed display has a radial viewing angle of 68.7°in a large display size of 43.5 inches,which is larger than the conventional tabletop light field 3D displays.The radial perspective and parallax are correct,and high-resolution 3D images can be reproduced in large radial viewing positions.We envision that this proposed display opens up possibility for redefining the display forms of consumer electronics.

The Flipping-Free Full-Parallax Tabletop Integral Imaging with Enhanced Viewing Angle Based on Space-Multiplexed Voxel Screen and Compound Lens Array

Tabletop integral imaging display with a more realistic and immersive experience has always been a hot spot in three-dimensional imaging technology,widely used in biomedical imaging and visualization to enhance medical diagnosis.However,the traditional structural characteristics of integral imaging display inevitably introduce the flipping effect outside the effective viewing angle.Here,a full-parallax tabletop integral imaging display without the flipping effect based on space-multiplexed voxel screen and compound lens array is demonstrated,and two holographic functional screens with different parameters are optically designed and fabricated.To eliminate the flipping effect in the reconstruction process,the space-multiplexed voxel screen consisting of a projector array and the holographic functional screen is presented to constrain light beams passing through the corresponding lens.To greatly promote imaging quality within the viewing area,the aspherical structure of the compound lens is optimized to balance the aberrations.It cooperates with the holographic functional screen to modulate the light field spatial distribution.Compared with the simulation results,the distortion rate of the imaging display is reduced to less than 9%from more than 30%.In the experiment,the floating high-quality reconstructed three-dimensional image without the flipping effect can be observed with the correct 3D perception at 96°×96°viewing angle,where 44,100 viewpoints are employed.

Changes of Street Quality Based on Street View Images in Different Periods:A Case Study of Jingshan East Street,Dongcheng District,Beijing City

With the continuous calls for energy conservation and emission reduction in recent years,more and more people choose walking as their travel mode.The improvement of the quality of street space will directly affect people's willingness to walk.By sorting out relevant research on street quality measurement,extracting quality keywords with high frequency of reference as impact factors,and using street view image data from different eras,semantic segmentation technology,factor analysis,and questionnaire survey methods,this paper evaluates the street quality of Jingshan East Street,Dongcheng District,Beijing,further explores the impact of different factors on street quality,and analyzes possible ways to improve it.

Flexible reduced field of view magnetic resonance imaging based on single-shot spatiotemporally encoded technique

In many ultrafast imaging applications, the reduced field-of-view（r FOV） technique is often used to enhance the spatial resolution and field inhomogeneity immunity of the images. The stationary-phase characteristic of the spatiotemporallyencoded（SPEN） method offers an inherent applicability to r FOV imaging. In this study, a flexible r FOV imaging method is presented and the superiority of the SPEN approach in r FOV imaging is demonstrated. The proposed method is validated with phantom and in vivo rat experiments, including cardiac imaging and contrast-enhanced perfusion imaging. For comparison, the echo planar imaging（EPI） experiments with orthogonal RF excitation are also performed. The results show that the signal-to-noise ratios of the images acquired by the proposed method can be higher than those obtained with the r FOV EPI. Moreover, the proposed method shows better performance in the cardiac imaging and perfusion imaging of rat kidney, and it can scan one or more regions of interest（ROIs） with high spatial resolution in a single shot. It might be a favorable solution to ultrafast imaging applications in cases with severe susceptibility heterogeneities, such as cardiac imaging and perfusion imaging. Furthermore, it might be promising in applications with separate ROIs, such as mammary and limb imaging.

Influence of limited-view scanning on depth imaging of photoacoustic tomography

We study the influence of limited-view scanning on the depth imaging of photoacoustic tomography. The situation, in which absorbers are located at different depths with respect to the limited-view scanning trajectory, is called depth imaging and is investigated in this paper. The results show that limited-view scanning causes the reconstructed intensity of deep absorbers to be weaker than that of shallow ones and that deep absorbers will be invisible if the scanning range is too small. The concept of effective scanning angle is proposed to analyse that phenomenon. We find that an effective scanning angle can well predict the relationship between scanning angle and the intensity ratio of absorbers. In addition, limited-view scanning is employed to improve image quality.

Study of a millimeter-wave squint indirect holographic algorithm suitable for imaging with large field-of-view

In this paper a millimeter-wave （MMW） squint indirect holographic method is presented, which is suitable for imaging with a large field-of-view. The proposed system employs the squint operation mode to remove the background and twin- image interferences, which achieves a similar effect to off-axis holography but leaves out the large-aperture quasi-optical component. The translational scanning manner enables a large field of view and ensures the image uniformity, which is difficult to realize in off-axis holography. In addition, a corresponding imaging algorithm for the presented scheme is developed to reconstruct the image from the recorded hologram. Some imaging results on typical objects, obtained with electromagnetic simulation, demonstrate good performance of the imaging scheme and validate the effectiveness of the image reconstruction algorithm.

Rapid visual screening of soft-story buildings from street view images using deep learning classification

Rapid and accurate identification of potential structural deficiencies is a crucial task in evaluating seismic vulnerability of large building inventories in a region. In the case of multi-story structures, abrupt vertical variations of story stiffness are known to significantly increase the likelihood of collapse during moderate or severe earthquakes. Identifying and retrofitting buildings with such irregularities—generally termed as soft-story buildings—is, therefore, vital in earthquake preparedness and loss mitigation efforts. Soft-story building identification through conventional means is a labor-intensive and time-consuming process. In this study, an automated procedure was devised based on deep learning techniques for identifying soft-story buildings from street-view images at a regional scale. A database containing a large number of building images and a semi-automated image labeling approach that effectively annotates new database entries was developed for developing the deep learning model. Extensive computational experiments were carried out to examine the effectiveness of the proposed procedure, and to gain insights into automated soft-story building identification.

Two-Edge-Corner Image Features for Registration of Geospatial Images with Large View Variations

This paper presents a robust image feature that can be used to automatically establish match correspondences between aerial images of suburban areas with large view variations. Unlike most commonly used invariant image features, this feature is view variant. The geometrical structure of the feature allows predicting its visual appearance according to the observer’s view. This feature is named 2EC (2 Edges and a Corner) as it utilizes two line segments or edges and their intersection or corner. These lines are constrained to correspond to the boundaries of rooftops. The description of each feature includes the two edges’ length, their intersection, orientation, and the image patch surrounded by a parallelogram that is constructed with the two edges. Potential match candidates are obtained by comparing features, while accounting for the geometrical changes that are expected due to large view variation. Once the putative matches are obtained, the outliers are filtered out using a projective matrix optimization method. Based on the results of the optimization process, a second round of matching is conducted within a more confined search space that leads to a more accurate match establishment. We demonstrate how establishing match correspondences using these features lead to computing more accurate camera parameters and fundamental matrix and therefore more accurate image registration and 3D reconstruction.

DELAUNAY TRIANGULATION AND IMAGE DENSE MATCHING IN VIEW SYNTHESIS

A new method of view synthesis is proposed based on Delaunay triangulation. The first step of this method is making the Delaunay triangulation of 2 reference images. Secondly, matching the image points using the epipolar geometry constraint. Finally, constructing the third view according to pixel transferring under the trilinear constraint. The method gets rid of the classic time consuming dense matching technique and takes advantage of Delaunay triangulation. So it can not only save the computation time but also enhance the quality of the synthesized view. The significance of this method is that it can be used directly in the fields of video coding, image compressing and virtual reality.

Fast view prediction for stereo images based on Delaunay triangular mesh model

The view prediction is an important step in stereo/multiview video coding, wherein, disparity estil mation （DE） is a key and difficult operation. DE algorithms usually require enormous computing power. A fast DE algorithm based on Delaunay triangulation （DT） is proposed. First, a flexible and content adaptive DT mesh is established on a target frame by an iterative split-merge algorithm. Second, DE on DT nodes are performed in a three-stage algorithm, which gives the majority of nodes a good estimate of the disparity vectors （DV）, by removing unreliable nodes due to occlusion, and forcing the minority of ＇problematic nodes＇ to be searched again, within their umbrella-shaped polygon, to the best. Finally, the target view is predicted by using affine transformation. Experimental results show that the proposed algorithm can give a satisfactory DE with less computational cost.

China Receives Images From SuperView-1

Launched on December 28,2016,the Super View-1 satellite has operated for over 70 days at an altitude of 530km.The initial results of in-orbit commissioning show that the images from the Super View-1 satellite are clear with radiation resolution reaching 11 bits pixel.The geospatial positioning accuracy without ground control pointing is5-8 m,the elevation relative accuracy is1 m.The maximum single scene can be60 km×70 km,enabling some 900。

An algorithm for computed tomography image reconstruction from limited-view projections

With the development of the compressive sensing theory, the image reconstruction from the projections viewed in limited angles is one of the hot problems in the research of computed tomography technology. This paper develops an iterative algorithm for image reconstruction, which can fit the most cases. This method gives an image reconstruction flow with the difference image vector, which is based on the concept that the difference image vector between the reconstructed and the reference image is sparse enough. Then the l1-norm minimization method is used to reconstruct the difference vector to recover the image for flat subjects in limited angles. The algorithm has been tested with a thin planar phantom and a real object in limited-view projection data. Moreover, all the studies showed the satisfactory results in accuracy at a rather high reconstruction speed.

Semi-reference image quality metric for virtual view images in free-viewpoint television

A semi-reference image quality assessment metric based on similarity measurement for synthesized virtual viewpoint image （VVI） in free-viewpoint television system （FFV） is proposed in this paper. The key point of the proposed metric is taking resemblant information between VVI and its neighbor view images for quality assessment to make our metric to be extended to multi-semi-reference image quality assessment easily. The proposed metric first extracts impact factors from image features, then combines an image synthesis technique and similarity functions, in which, disparity information are taken into account for registering the resemblant regions. Experiments are divided into three phases. Phase I is to verify the validation of the proposed metric by taking impaired images and original reference into account. The experimental results show the agreement between evaluation scores and bio-characteristic of human visual system. Phase II shows the accordance with Phase I by taking neighbor view as reference. The proposed metric can be taken as a full reference one to evaluate the image quality even though the original reference is absent. Phase III is then performed to evaluate the quality of WI. Evaluation scores in the experimental results are able to evaluate the quality of VVI.

View synthesis based on the serial images from camera lengthways motion

For the pre-acquired serial images from camera lengthways motion, a view synthesis algorithm based on epipolar geometry constraint is proposed in this paper. It uses the whole matching and maintaining order characters of the epipolar line, Fourier transform and dynamic programming matching theories, thus truly synthesizing the destination image of current viewpoint. Through the combination of Fourier transform, epipolar geometry constraint and dynamic programming matching, the circumference distortion problem resulting from conventional view synthesis approaches is effectively avoided. The detailed implementation steps of this algorithm are given, and some running instances are presented to illustrate the results.

View interpolation networks for reproducing the material appearance of specular objects

Background In this study, we propose view interpolation networks to reproduce changes in the brightness of an object′s surface depending on the viewing direction, which is important for reproducing the material appearance of a real object. Method We used an original and modified version of U-Net for image transformation. The networks were trained to generate images from the intermediate viewpoints of four cameras placed at the corners of a square. We conducted an experiment using with three different combinations of methods and training data formats. Result We determined that inputting the coordinates of the viewpoints together with the four camera images and using images from random viewpoints as the training data produces the best results.

基于LabVIEW的大视场激光视频图像采集系统

针对激光视频图像采集过程中视角不足、图像呈现效果不佳问题,设计基于LabVIEW的大视场激光视频图像采集系统。该系统利用帧触发器和串行接口与摄像机相连,控制摄像机拍摄大视场激光视频图像;摄像机依据IEEE-1394总线协议将拍摄的大视场激光视频图像,传输到视频图像编码器内,利用该编码器对其实施压缩编码处理后,将大视场激光视频图像传输到视频图像处理器内;该处理器采用LabVIEW软件编程形式,将视频图像处理算法程序写入其中,通过运行该程序对激光视频图像进行亮度差异调整、图像配准等处理,将处理后的图像存储到存储器内,并利用USB控制器连接显示屏,为用户程序大视场激光视频图像采集结果。实验表明:该系统的中断时间为2.0 min左右,采集的激光视频图像水平视场角由48°增加到83°,且压缩激光视频图像帧频率波动区间为33 f/s-34 f/s,系统具备较强的应用效果。

Integrating Highly Spatial Satellite Image for 3D Buildings Modelling Using Geospatial Algorithms and Architecture Environment

The growing demand for current and precise geographic information that pertains to urban areas has given rise to a significant interest in digital surface models that exhibit a high level of detail. Traditional methods for creating digital surface models are insufficient to reflect the details of earth’s features. These models only represent three-dimensional objects in a single texture and fail to offer a realistic depiction of the real world. Furthermore, the need for current and precise geographic information regarding urban areas has been increasing significantly. This study proposes a new technique to address this problem, which involves integrating remote sensing, Geographic Information Systems (GIS), and Architecture Environment software environments to generate a detailed three-dimensional model. The processing of this study starts with: 1) Downloading high-resolution satellite imagery; 2) Collecting ground truth datasets from fieldwork; 3) Imaging nose removing; 4) Generating a Two-dimensional Model to create a digital surface model in GIS using the extracted building outlines; 5) Converting the model into multi-patch layers to construct a 3D model for each object separately. The results show that the 3D model obtained through this method is highly detailed and effective for various applications, including environmental studies, urban development, expansion planning, and shape understanding tasks.

大口径爆炸激波管出口冲击波流场图像测量

为了获取大视场下爆炸冲击波的纹影图像以及冲击波与被测模型相互作用后的流场演化特征,开展了基于聚焦纹影的反射式高速纹影测试。利用激光光源和高反射膜建立了系统所需的光源输入,并通过简化刀口栅设计,实现了远距离大口径爆炸激波管出口冲击波流场图像演化特征以及与固体模型相互作用的高时空分辨特征。研究结果表明,设计的聚焦式反射纹影系统在80 m以上距离处获取了大口径大当量爆炸激波管出口处6 m×3 m视场的冲击波特征,以及与固体相互作用的高时空分辨图像和状态数据;相比传统聚焦纹影系统,该系统具有结构简单、可实现性强、测试距离远,覆盖视场大等特点;通过设计不同光源输入,探讨了激光光源在远距离拍摄中的优势;通过冲击波阵面与固体模型的相互作用特征,揭示了冲击波作用于被测固体模型后的形成、演化和绕流状态。该测量结果能够为武器装备在受到冲击波作用后的状态评估和响应特性分析提供直观的图像数据支撑。

基于多年份街景图像对大理古城街道绿视率提升设计策略研究

文章以绿视率作为评价指标,探讨如何通过提升街道和公共空间的绿视率,达到改善城市生态环境、提升居民心理健康与生活质量的目的。选定云南省大理古城作为研究区域,分析古城绿视率的现状、变化趋势,探究其绿视率影响因素并提出优化策略。研究采用量化分析方法,对大理古城2016年与2020年的街道绿视率进行对比评价,同时利用深度学习全卷积网络技术,对街景图像中的树、草和其他植物进行语义分割,实现绿视率的精确量化。研究结果表明,2016—2020年,大理古城街道的平均绿视率有所下降,绿化水平未能达到预期目标。通过进一步分类对比分析,揭示街道宽度、绿化形式、建筑特色等因素对绿视率的影响。最后结合大理古城的具体情况,提出一系列改进绿化的措施,可有效提升城市绿视率,增强城市生态环境和文化特色。

焊接熔池图像采集及边缘几何形态研究

基于MAG焊电弧光谱特点,用视觉传感配合CCD相机和滤波减光系统,采集MAG焊熔池图像;通过同步对比试验,研究熔池图像圆形度与边缘形态关系。结果表明:正常工艺时,熔池边缘较规则、光滑,熔池图像圆形度介于0.56~0.65;焊接电流过大或保护气体不足时,熔池图像圆形度比正常值小,图像边缘凹凸不平。熔池图像圆形度越小,意味着熔池边缘更不规则或锯齿状,通过圆形度数值大小可预判熔池边缘信息,为焊接过程的控制和焊接质量的评估提供思路。