Metasurfaces for near-eye display applications

Virtual reality(VR)and augmented reality(AR)are revolutionizing our lives.Near-eye displays are crucial technologies for VR and AR.Despite the rapid advances in near-eye display technologies,there are still challenges such as large field of view,high resolution,high image quality,natural free 3D effect,and compact form factor.Great efforts have been devoted to striking a balance between visual performance and device compactness.While traditional optics are nearing their limitations in addressing these challenges,ultra-thin metasurface optics,with their high light-modulating capabilities,may present a promising solution.In this review,we first introduce VR and AR near-eye displays,and then briefly explain the working principles of light-modulating metasurfaces,review recent developments in metasurface devices geared toward near-eye display applications,delved into several advanced natural 3D near-eye display technologies based on metasurfaces,and finally discuss about the remaining challenges and future perspectives associated with metasurfaces for near-eye display applications.

Source Camera Identification Algorithm Based on Multi-Scale Feature Fusion

The widespread availability of digital multimedia data has led to a new challenge in digital forensics.Traditional source camera identification algorithms usually rely on various traces in the capturing process.However,these traces have become increasingly difficult to extract due to wide availability of various image processing algorithms.Convolutional Neural Networks(CNN)-based algorithms have demonstrated good discriminative capabilities for different brands and even different models of camera devices.However,their performances is not ideal in case of distinguishing between individual devices of the same model,because cameras of the same model typically use the same optical lens,image sensor,and image processing algorithms,that result in minimal overall differences.In this paper,we propose a camera forensics algorithm based on multi-scale feature fusion to address these issues.The proposed algorithm extracts different local features from feature maps of different scales and then fuses them to obtain a comprehensive feature representation.This representation is then fed into a subsequent camera fingerprint classification network.Building upon the Swin-T network,we utilize Transformer Blocks and Graph Convolutional Network(GCN)modules to fuse multi-scale features from different stages of the backbone network.Furthermore,we conduct experiments on established datasets to demonstrate the feasibility and effectiveness of the proposed approach.

Ultrafast pulse-dilation framing camera and its application for time-resolved X-ray diagnostic

An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation device and gated MCP imager,and a spatial resolution of 100μm by using an electronic imaging system comprising combined magnetic lenses.The spatial resolution characteristics of the camera were studied both theoretically and experimentally.The results showed that the camera with combined magnetic lenses reduced the field curvature and acquired a larger working area.A working area with a diameter of 53 mm was created by applying four magnetic lenses to the camera.Furthermore,the camera was used to detect the X-rays produced by the laser-targeting device.The diagnostic results indicated that the width of the X-ray pulse was approximately 18 ps.

Monocular Distance Estimated Based on PTZ Camera

This paper introduces an intelligent computational approach for extracting salient objects fromimages and estimatingtheir distance information with PTZ (Pan-Tilt-Zoom) cameras. PTZ cameras have found wide applications innumerous public places, serving various purposes such as public securitymanagement, natural disastermonitoring,and crisis alarms, particularly with the rapid development of Artificial Intelligence and global infrastructuralprojects. In this paper, we combine Gauss optical principles with the PTZ camera’s capabilities of horizontal andpitch rotation, as well as optical zoom, to estimate the distance of the object.We present a novel monocular objectdistance estimation model based on the Focal Length-Target Pixel Size (FLTPS) relationship, achieving an accuracyrate of over 95% for objects within a 5 km range. The salient object extraction is achieved through a simplifiedconvolution kernel and the utilization of the object’s RGB features, which offer significantly faster computingspeeds compared to Convolutional Neural Networks (CNNs). Additionally, we introduce the dark channel beforethe fog removal algorithm, resulting in a 20 dB increase in image definition, which significantly benefits distanceestimation. Our system offers the advantages of stability and low device load, making it an asset for public securityaffairs and providing a reference point for future developments in surveillance hardware.

Automatic Miscalibration Detection and Correction of LiDAR and Camera Using Motion Cues

This paper aims to develop an automatic miscalibration detection and correction framework to maintain accurate calibration of LiDAR and camera for autonomous vehicle after the sensor drift.First,a monitoring algorithm that can continuously detect the miscalibration in each frame is designed,leveraging the rotational motion each individual sensor observes.Then,as sensor drift occurs,the projection constraints between visual feature points and LiDAR 3-D points are used to compute the scaled camera motion,which is further utilized to align the drifted LiDAR scan with the camera image.Finally,the proposed method is sufficiently compared with two representative approaches in the online experiments with varying levels of random drift,then the method is further extended to the offline calibration experiment and is demonstrated by a comparison with two existing benchmark methods.

Imaging simulation and analysis of attitude jitter effect on topographic mapping for lunar orbiter stereo optical cameras

The geometric accuracy of topographic mapping with high-resolution remote sensing images is inevita-bly affected by the orbiter attitude jitter.Therefore,it is necessary to conduct preliminary research on the stereo mapping camera equipped on lunar orbiter before launching.In this work,an imaging simulation method consid-ering the attitude jitter is presented.The impact analysis of different attitude jitter on terrain undulation is conduct-ed by simulating jitter at three attitude angles,respectively.The proposed simulation method is based on the rigor-ous sensor model,using the lunar digital elevation model(DEM)and orthoimage as reference data.The orbit and attitude of the lunar stereo mapping camera are simulated while considering the attitude jitter.Two-dimensional simulated stereo images are generated according to the position and attitude of the orbiter in a given orbit.Experi-mental analyses were conducted by the DEM with the simulated stereo image.The simulation imaging results demonstrate that the proposed method can ensure imaging efficiency without losing the accuracy of topographic mapping.The effect of attitude jitter on the stereo mapping accuracy of the simulated images was analyzed through a DEM comparison.

Analyzing the Impact of Scene Transitions on Indoor Camera Localization through Scene Change Detection in Real-Time

Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.

Anger-camera型中子探测器位置分辨性能研究

本文描述用于中国散裂中子源(CSNS)谱仪上,基于Anger-camera位置重建原理的闪烁体中子探测器样机位置分辨性能研究。在BL20中子测试束线上完成了探测器关键器件性能测试,包括硅光电倍增管(Silicon Photon Multiplier Tube, SiPM)阵列位置重建能力测试和耐辐照特性研究,同时对不同光导厚度下探测器位置分辨能力开展测试,发现基于SiPM阵列读出的Anger-camera型闪烁体中子探测器采用300μm的^(6)LiF/ZnS(Ag)闪烁屏和5 mm空气作为光导,其位置分辨最佳可达到0.6 mm。该探测器样机后期可通过大面积阵列拼接,实现中子衍射实验对大面积高位置分辨探测器的需求,其成功研制为加快谱仪建设提供有力的技术支撑。

Blackmagic Camera 8.5公测版更新发布

2023年12月,Blackmagic Camera8.5公测版正式发布。安装更新后,为Blackmagic URSA Broadcast G2添加了Blackmagic Cloud工作流程支持。可以从摄影机的新媒体池向Blackmagic Cloud上传片段,也可以直接上传到DaVinci Resolve项目。

Blackmagic Camera 8.5.1正式发布

针对Blackmagic URSA Broadcast G2的Blackmagic Camera 8.5.1版本,提供了Blackmagic Cloud流程支持,用户可从摄影机的新媒体池向Blackmagic Cloud上传片段,也可以直接上传到Da Vinci Resolve项目。新添加的同时代理记录功能加上Blackmagic RAW或ProRes能够助力影像迅速送进新闻演播室或剪辑室,提高工作流程的效率。

Pocket Cinema Camera系列和全画幅6K摄影机加入推流等新功能

Blackmagic Design最新发布的摄影机软件Blackmagic Camera 8.6公共测试版为Blackmagic Pocket Cinema Camera和Cinema Camera 6K机型增加了云流程支持,让用户可以将素材从摄影机媒体池上传到Blackmagic Cloud,甚至直接上传到DaVinci Resolve项目中。并为两款机型的USB-C接口增加了网络摄像头功能,即可把摄影机连接到电脑,并使用任何主流推流软件或平台以全高清1080P质量推流直播。

Blackmagic Camera iOS 2.1版软件更新

Blackmagic Camera iOS 2.1版软件更新,为Blackmagic Camera结合使用iPhone 16最新的相机控制功能添加了支持,可以通过单击或双击将其打开。还可以通过控制中心、锁定屏幕或操作按钮打开Blackmagic Camera,获得更多快速进入Blackmagic Camera并开始录制的方式。此外,可以使用iPhone 16内置的相机控制更轻松地导航显示并调整变焦、曝光、对焦、ISO和选择LUT等功能。

安卓版Blackmagic Camera发布

Blackmagic Design日前发布了安卓版Blackmagic Camera,将大幅改进拍摄效果,拍摄成果可用于影视制作。安卓版Blackmagic Camera采用和Blackmagic Design获奖摄影机一样的操作界面,直观易懂且对用户友好,可提供如同使用专业级数字电影摄影机一般的操控体验。通过简单的手指点按操作,就可以调整帧率、快门角度、白平衡以及ISO等设置。同时,还支持使用行业标准文件格式直接录制到Blackmagic Cloud,上至8K。

基于Camera Link的高速图像采集处理器

设计了基于Camera Link标准的高速图像采集处理器,可以对高速的数字相机进行图像采集及实时图像处理。系统采用FPGA和DSP作为主要的内核处理单元,FGPA完成图像的采集和预处理,DSP完成复杂的图像处理任务。详细给出了处理器的结构设计和一些关键技术,如Camera Link接口技术、高速缓存以及显示技术、图像处理和输出接口设计等。经过调试,系统最终可以实时完成1000帧/s的图像采集和处理任务。

基于FPGA的Camera Link转HD-SDI接口转换系统

由于Camera Link相机具有接口复杂、传输距离近等局限性,设计并实现了一种基于FPGA的Camera Link转HD-SDI接口转换系统。该系统采用Altera公司的EP2S60F1020高性能FPGA完成图像数据的采集并按SMPTE274M标准编码;为解决Camera Link相机输出数据同HD-SDI输出图像行、场时间不同的问题,采用3片SDRAM作为帧缓存模块,延迟1帧输出;编码完成的数据输出到并串转换芯片LMH0030,从而得到HD-SDI格式的视频输出。由于Camera Link相机输出数据同HD-SDI输出图像的帧频并不绝对相同,每隔708帧必须丢去一帧数据,从而导致输出时固定丢帧,但FPGA对图像的处理并不会丢帧。实验结果表明,本系统能够将Camera Link相机输出的图像数据转换成HD-SDI输出,并用采集卡采集到图像数据。

Camera Link硬件接口电路设计

介绍了Camera Link接口的工作原理及Camera Link协议的主要内容,阐述了Camera Link硬件接口电路的设计方案.接口电路为图像采集卡的前端部分,主要功能为低压差分信号(LVDS)至CMOS/TTL(LVCMOS/LVTTL)信号的转换,相机控制和图像采集卡与相机间的串行通信.系统以FPGA为主控制器,通过实验实现了上述功能,完成了Camera Link接口相机图像的采集和显示.

基于Cyclone IV的Camera Link-HDMI高清视频转换器设计

针对实际项目需求,在充分了解Camera Link接口协议和HDMI接口协议的基础上,给出了基于FPGA的Camera Link-HDMI高清视频转换器设计方案。选用Altera公司的Cyclone IV系列FPGA器件,完成了转换器的电路设计和性能测试。结果表明,图像转换实时性好,色彩和图形无失真,满足设计要求。该方案是一种解决Camera Link-HDMI转换的有效方法,为相似的技术设计问题提供了有益的参考。

Camera Link Full至HD-SDI接口的高清传输显示系统

为实现远距离、高可靠性传输,并减小复杂度,对Camera Link Full接口数据的HD-SDI传输显示进行了深入研究。采用FPGA作为核心处理器,考虑相机输出具有多种帧频,采取帧频检测及充分降频策略,并通过3个SRAM进行缓存以实现帧频转换,以满足HD-SDI帧频25Hz的要求。考虑到SRAM数据宽度,采取FIFO行缓存策略将Camera Link Full80输出的10tap、80bits图像数据转换成单通道的8bits图像数据。最后,完成系统设计并进行实验验证。实验结果表明:系统实现了图像数据从50Hz、100Hz、500 Hz等多种帧频的Camera Link Full80到25帧HD-SDI接口1080i的格式转换及实时显示,且图像层次丰富,无失真。

基于TMS320C6711的Camera Link相机控制的实现

在分析了面阵CCD相机1M30的Camera Link协议接口特点的基础上,设计了一种具有较强通用性的DSP系统对Camera Link相机的控制方案.采用定时器和软件编程等手段,解决了DSP芯片TMS320C6711的多通道缓存串口(MCBSP)与1M30间异步串行通信的传输速率及数据格式问题,成功设置相机参数;研究了在串行数据中产生帧同步接收信号(FSR)的可行性及失败原因.借助定时器产生的周期性脉冲信号及中断,使MCBSP可靠地接收相机反馈信息;根据相机曝光时序特点,用程序实现对相机的正常曝光控制.

基于FPGA实现由多路复合信号传输到Camera Link传输的研究

针对传统的复合视频信号直接传输图象信息具有抗干扰能力差,噪声大等缺点,提出了一个视频信号传输方式变换的新方案,利用Camera Link通信协议在数字信息领域具有传递距离远、抗干扰能力强的优点,实现了由4路实时的复合视频信号转换为1路高速的Camera Link格式的信号。这种方法改变了传统的复合视频信号直接传输图象信息的思维,从而为数字信息领域远距离多路实时视频信号的快速传送和处理提供了平台。