Astrometric calibration and source characterisation of the latest generation neuromorphic event-based cameras for space imaging

As an emerging approach to space situational awareness and space imaging,the practical use of an event-based camera(EBC)in space imaging for precise source analysis is still in its infancy.The nature of event-based space imaging and data collection needs to be further explored to develop more effective event-based space imaging systems and advance the capabilities of event-based tracking systems with improved target measurement models.Moreover,for event measurements to be meaningful,a framework must be investigated for EBC calibration to project events from pixel array coordinates in the image plane to coordinates in a target resident space object’s reference frame.In this paper,the traditional techniques of conventional astronomy are reconsidered to properly utilise the EBC for space imaging and space situational awareness.This paper presents the techniques and systems used for calibrating an EBC for reliable and accurate measurement acquisition.These techniques are vital in building event-based space imaging systems capable of real-world space situational awareness tasks.By calibrating sources detected using the EBC,the spatiotemporal characteristics of detected sources or“event sources”can be related to the photometric characteristics of the underlying astrophysical objects.Finally,these characteristics are analysed to establish a foundation for principled processing and observing techniques which appropriately exploit the capabilities of the EBC.

NeuroBiometric:An Eye Blink Based Biometric Authentication System Using an Event-Based Neuromorphic Vision Sensor

The rise of the Internet and identity authentication systems has brought convenience to people's lives but has also introduced the potential risk of privacy leaks.Existing biometric authentication systems based on explicit and static features bear the risk of being attacked by mimicked data.This work proposes a highly efficient biometric authentication system based on transient eye blink signals that are precisely captured by a neuromorphic vision sensor with microsecond-level temporal resolution.The neuromorphic vision sensor only transmits the local pixel-level changes induced by the eye blinks when they occur,which leads to advantageous characteristics such as an ultra-low latency response.We first propose a set of effective biometric features describing the motion,speed,energy and frequency signal of eye blinks based on the microsecond temporal resolution of event densities.We then train the ensemble model and non-ensemble model with our Neuro Biometric dataset for biometrics authentication.The experiments show that our system is able to identify and verify the subjects with the ensemble model at an accuracy of 0.948 and with the non-ensemble model at an accuracy of 0.925.The low false positive rates(about 0.002)and the highly dynamic features are not only hard to reproduce but also avoid recording visible characteristics of a user's appearance.The proposed system sheds light on a new path towards safer authentication using neuromorphic vision sensors.

Using Event-Based Method to Estimate Cybersecurity Equilibrium

Estimating the global state of a networked system is an important problem in many application domains.The classical approach to tackling this problem is the periodic(observation)method,which is inefficient because it often observes states at a very high frequency.This inefficiency has motivated the idea of event-based method,which leverages the evolution dynamics in question and makes observations only when some rules are triggered(i.e.,only when certain conditions hold).This paper initiates the investigation of using the event-based method to estimate the equilibrium in the new application domain of cybersecurity,where equilibrium is an important metric that has no closed-form solutions.More specifically,the paper presents an event-based method for estimating cybersecurity equilibrium in the preventive and reactive cyber defense dynamics,which has been proven globally convergent.The presented study proves that the estimated equilibrium from our trigger rule i)indeed converges to the equilibrium of the dynamics and ii)is Zeno-free,which assures the usefulness of the event-based method.Numerical examples show that the event-based method can reduce 98%of the observation cost incurred by the periodic method.In order to use the event-based method in practice,this paper investigates how to bridge the gap between i)the continuous state in the dynamics model,which is dubbed probability-state because it measures the probability that a node is in the secure or compromised state,and ii)the discrete state that is often encountered in practice,dubbed sample-state because it is sampled from some nodes.This bridge may be of independent value because probability-state models have been widely used to approximate exponentially-many discrete state systems.

Ultrafast pulse-dilation framing camera and its application for time-resolved X-ray diagnostic

An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation device and gated MCP imager,and a spatial resolution of 100μm by using an electronic imaging system comprising combined magnetic lenses.The spatial resolution characteristics of the camera were studied both theoretically and experimentally.The results showed that the camera with combined magnetic lenses reduced the field curvature and acquired a larger working area.A working area with a diameter of 53 mm was created by applying four magnetic lenses to the camera.Furthermore,the camera was used to detect the X-rays produced by the laser-targeting device.The diagnostic results indicated that the width of the X-ray pulse was approximately 18 ps.

Source Camera Identification Algorithm Based on Multi-Scale Feature Fusion

The widespread availability of digital multimedia data has led to a new challenge in digital forensics.Traditional source camera identification algorithms usually rely on various traces in the capturing process.However,these traces have become increasingly difficult to extract due to wide availability of various image processing algorithms.Convolutional Neural Networks(CNN)-based algorithms have demonstrated good discriminative capabilities for different brands and even different models of camera devices.However,their performances is not ideal in case of distinguishing between individual devices of the same model,because cameras of the same model typically use the same optical lens,image sensor,and image processing algorithms,that result in minimal overall differences.In this paper,we propose a camera forensics algorithm based on multi-scale feature fusion to address these issues.The proposed algorithm extracts different local features from feature maps of different scales and then fuses them to obtain a comprehensive feature representation.This representation is then fed into a subsequent camera fingerprint classification network.Building upon the Swin-T network,we utilize Transformer Blocks and Graph Convolutional Network(GCN)modules to fuse multi-scale features from different stages of the backbone network.Furthermore,we conduct experiments on established datasets to demonstrate the feasibility and effectiveness of the proposed approach.

Monocular Distance Estimated Based on PTZ Camera

This paper introduces an intelligent computational approach for extracting salient objects fromimages and estimatingtheir distance information with PTZ (Pan-Tilt-Zoom) cameras. PTZ cameras have found wide applications innumerous public places, serving various purposes such as public securitymanagement, natural disastermonitoring,and crisis alarms, particularly with the rapid development of Artificial Intelligence and global infrastructuralprojects. In this paper, we combine Gauss optical principles with the PTZ camera’s capabilities of horizontal andpitch rotation, as well as optical zoom, to estimate the distance of the object.We present a novel monocular objectdistance estimation model based on the Focal Length-Target Pixel Size (FLTPS) relationship, achieving an accuracyrate of over 95% for objects within a 5 km range. The salient object extraction is achieved through a simplifiedconvolution kernel and the utilization of the object’s RGB features, which offer significantly faster computingspeeds compared to Convolutional Neural Networks (CNNs). Additionally, we introduce the dark channel beforethe fog removal algorithm, resulting in a 20 dB increase in image definition, which significantly benefits distanceestimation. Our system offers the advantages of stability and low device load, making it an asset for public securityaffairs and providing a reference point for future developments in surveillance hardware.

Automatic Miscalibration Detection and Correction of LiDAR and Camera Using Motion Cues

This paper aims to develop an automatic miscalibration detection and correction framework to maintain accurate calibration of LiDAR and camera for autonomous vehicle after the sensor drift.First,a monitoring algorithm that can continuously detect the miscalibration in each frame is designed,leveraging the rotational motion each individual sensor observes.Then,as sensor drift occurs,the projection constraints between visual feature points and LiDAR 3-D points are used to compute the scaled camera motion,which is further utilized to align the drifted LiDAR scan with the camera image.Finally,the proposed method is sufficiently compared with two representative approaches in the online experiments with varying levels of random drift,then the method is further extended to the offline calibration experiment and is demonstrated by a comparison with two existing benchmark methods.

Imaging simulation and analysis of attitude jitter effect on topographic mapping for lunar orbiter stereo optical cameras

The geometric accuracy of topographic mapping with high-resolution remote sensing images is inevita-bly affected by the orbiter attitude jitter.Therefore,it is necessary to conduct preliminary research on the stereo mapping camera equipped on lunar orbiter before launching.In this work,an imaging simulation method consid-ering the attitude jitter is presented.The impact analysis of different attitude jitter on terrain undulation is conduct-ed by simulating jitter at three attitude angles,respectively.The proposed simulation method is based on the rigor-ous sensor model,using the lunar digital elevation model(DEM)and orthoimage as reference data.The orbit and attitude of the lunar stereo mapping camera are simulated while considering the attitude jitter.Two-dimensional simulated stereo images are generated according to the position and attitude of the orbiter in a given orbit.Experi-mental analyses were conducted by the DEM with the simulated stereo image.The simulation imaging results demonstrate that the proposed method can ensure imaging efficiency without losing the accuracy of topographic mapping.The effect of attitude jitter on the stereo mapping accuracy of the simulated images was analyzed through a DEM comparison.

A stepwise camera calibration method incorporating compensation for eccentricity error

In visual measurement,high-precision camera calibration often employs circular targets.To address issues in mainstream methods,such as the eccentricity error of the circle from using the circle’s center for calibration,overfitting or local minimum from fullparameter optimization,and calibration errors due to neglecting the center of distortion,a stepwise camera calibration method incorporating compensation for eccentricity error was proposed to enhance monocular camera calibration precision.Initially,the multiimage distortion correction method calculated the common center of distortion and coefficients,improving precision,stability,and efficiency compared to single-image distortion correction methods.Subsequently,the projection point of the circle’s center was compared with the center of the contour’s projection to iteratively correct the eccentricity error,leading to more precise and stable calibration.Finally,nonlinear optimization refined the calibration parameters to minimize reprojection error and boosts precision.These processes achieved stepwise camera calibration,which enhanced robustness.In addition,the module comparison experiment showed that both the eccentricity error compensation and the camera parameter optimization could improve the calibration precision,but the latter had a greater impact.The combined use of the two methods further improved the precision and stability.Simulations and experiments confirmed that the proposed method achieved high precision,stability,and robustness,suitable for high-precision visual measurements.

Analyzing the Impact of Scene Transitions on Indoor Camera Localization through Scene Change Detection in Real-Time

Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.

Anger-camera型中子探测器位置分辨性能研究

本文描述用于中国散裂中子源(CSNS)谱仪上,基于Anger-camera位置重建原理的闪烁体中子探测器样机位置分辨性能研究。在BL20中子测试束线上完成了探测器关键器件性能测试,包括硅光电倍增管(Silicon Photon Multiplier Tube, SiPM)阵列位置重建能力测试和耐辐照特性研究,同时对不同光导厚度下探测器位置分辨能力开展测试,发现基于SiPM阵列读出的Anger-camera型闪烁体中子探测器采用300μm的^(6)LiF/ZnS(Ag)闪烁屏和5 mm空气作为光导,其位置分辨最佳可达到0.6 mm。该探测器样机后期可通过大面积阵列拼接,实现中子衍射实验对大面积高位置分辨探测器的需求,其成功研制为加快谱仪建设提供有力的技术支撑。

Blackmagic Camera 8.5公测版更新发布

2023年12月,Blackmagic Camera8.5公测版正式发布。安装更新后,为Blackmagic URSA Broadcast G2添加了Blackmagic Cloud工作流程支持。可以从摄影机的新媒体池向Blackmagic Cloud上传片段,也可以直接上传到DaVinci Resolve项目。

Blackmagic Camera 8.5.1正式发布

针对Blackmagic URSA Broadcast G2的Blackmagic Camera 8.5.1版本,提供了Blackmagic Cloud流程支持,用户可从摄影机的新媒体池向Blackmagic Cloud上传片段,也可以直接上传到Da Vinci Resolve项目。新添加的同时代理记录功能加上Blackmagic RAW或ProRes能够助力影像迅速送进新闻演播室或剪辑室,提高工作流程的效率。

Pocket Cinema Camera系列和全画幅6K摄影机加入推流等新功能

Blackmagic Design最新发布的摄影机软件Blackmagic Camera 8.6公共测试版为Blackmagic Pocket Cinema Camera和Cinema Camera 6K机型增加了云流程支持,让用户可以将素材从摄影机媒体池上传到Blackmagic Cloud,甚至直接上传到DaVinci Resolve项目中。并为两款机型的USB-C接口增加了网络摄像头功能,即可把摄影机连接到电脑,并使用任何主流推流软件或平台以全高清1080P质量推流直播。

Blackmagic Camera iOS 2.1版软件更新

Blackmagic Camera iOS 2.1版软件更新,为Blackmagic Camera结合使用iPhone 16最新的相机控制功能添加了支持,可以通过单击或双击将其打开。还可以通过控制中心、锁定屏幕或操作按钮打开Blackmagic Camera,获得更多快速进入Blackmagic Camera并开始录制的方式。此外,可以使用iPhone 16内置的相机控制更轻松地导航显示并调整变焦、曝光、对焦、ISO和选择LUT等功能。

安卓版Blackmagic Camera发布

Blackmagic Design日前发布了安卓版Blackmagic Camera,将大幅改进拍摄效果,拍摄成果可用于影视制作。安卓版Blackmagic Camera采用和Blackmagic Design获奖摄影机一样的操作界面,直观易懂且对用户友好,可提供如同使用专业级数字电影摄影机一般的操控体验。通过简单的手指点按操作,就可以调整帧率、快门角度、白平衡以及ISO等设置。同时,还支持使用行业标准文件格式直接录制到Blackmagic Cloud,上至8K。

基于双目立体视觉的多分辨率图像匹配方法研究

在双目立体视觉系统中,面对复杂场景时噪声会损害图像特征,增加提取难度,导致匹配精度和鲁棒性下降。因此,文中提出基于双目立体视觉的多分辨率图像匹配方法,旨在从不同尺度图像中有效获取信息并实现高精度匹配。该方法利用双目立体视觉模型的双目旋转相机扫描目标并进行成像,根据内、外空间标定提升双目旋转相机的位置精度,保证目标的多分辨率成像效果;将其输入金字塔立体匹配网络中,通过网络中的类金字塔多空洞卷积操作提取双目图像特征,在此基础上,基于可变卷积增强其纹理特征细节;结合细粒度特征和互注意力机制完成双目图像匹配。测试结果显示,空间标定后,左、右两个相机的成像误差最小值分别为0.6 Pixel和0.4 Pixel;匹配点坐标偏差均值和坐标偏差方差值分别低于0.012和0.011,匹配效果良好。

基于Camera Link的高速图像采集处理器

设计了基于Camera Link标准的高速图像采集处理器,可以对高速的数字相机进行图像采集及实时图像处理。系统采用FPGA和DSP作为主要的内核处理单元,FGPA完成图像的采集和预处理,DSP完成复杂的图像处理任务。详细给出了处理器的结构设计和一些关键技术,如Camera Link接口技术、高速缓存以及显示技术、图像处理和输出接口设计等。经过调试,系统最终可以实时完成1000帧/s的图像采集和处理任务。

基于特征间几何约束的指针仪表读数识别方法

在指针式仪表示值监控系统中,倾斜拍摄仪表图像时会导致识别结果出现偏差,为此提出一种基于仪表特征间几何约束的识别方法。首先利用一幅平铺于仪表上表面的平面标定板图像实现相机参数标定,生成仪表在标定平面上的虚拟图像;然后利用表壳上表面、刻度平面、指针平面与虚拟像平面间的平行关系,确定表壳圆的圆心、仪表刻度圆心、指针转轴中心特征间的透视投影约束关系,利用图像的极坐标变换和离散傅里叶变换提取仪表刻度圆心的最优位置及起始刻度线的角度,利用Hough变换的投票原理估计指针的转动角度;最后利用角度法实现仪表读数的解算。以某型号指针式温度计为测试对象进行实验验证,识别结果的平均误差为0.23℃,最大误差为0.7℃,本文方法能够准确识别仪表读数且识别精度优于人工读数。

基于FPGA的Camera Link转HD-SDI接口转换系统

由于Camera Link相机具有接口复杂、传输距离近等局限性,设计并实现了一种基于FPGA的Camera Link转HD-SDI接口转换系统。该系统采用Altera公司的EP2S60F1020高性能FPGA完成图像数据的采集并按SMPTE274M标准编码;为解决Camera Link相机输出数据同HD-SDI输出图像行、场时间不同的问题,采用3片SDRAM作为帧缓存模块,延迟1帧输出;编码完成的数据输出到并串转换芯片LMH0030,从而得到HD-SDI格式的视频输出。由于Camera Link相机输出数据同HD-SDI输出图像的帧频并不绝对相同,每隔708帧必须丢去一帧数据,从而导致输出时固定丢帧,但FPGA对图像的处理并不会丢帧。实验结果表明,本系统能够将Camera Link相机输出的图像数据转换成HD-SDI输出,并用采集卡采集到图像数据。