Monocular Distance Estimated Based on PTZ Camera

This paper introduces an intelligent computational approach for extracting salient objects fromimages and estimatingtheir distance information with PTZ (Pan-Tilt-Zoom) cameras. PTZ cameras have found wide applications innumerous public places, serving various purposes such as public securitymanagement, natural disastermonitoring,and crisis alarms, particularly with the rapid development of Artificial Intelligence and global infrastructuralprojects. In this paper, we combine Gauss optical principles with the PTZ camera’s capabilities of horizontal andpitch rotation, as well as optical zoom, to estimate the distance of the object.We present a novel monocular objectdistance estimation model based on the Focal Length-Target Pixel Size (FLTPS) relationship, achieving an accuracyrate of over 95% for objects within a 5 km range. The salient object extraction is achieved through a simplifiedconvolution kernel and the utilization of the object’s RGB features, which offer significantly faster computingspeeds compared to Convolutional Neural Networks (CNNs). Additionally, we introduce the dark channel beforethe fog removal algorithm, resulting in a 20 dB increase in image definition, which significantly benefits distanceestimation. Our system offers the advantages of stability and low device load, making it an asset for public securityaffairs and providing a reference point for future developments in surveillance hardware.

Automatic Miscalibration Detection and Correction of LiDAR and Camera Using Motion Cues

This paper aims to develop an automatic miscalibration detection and correction framework to maintain accurate calibration of LiDAR and camera for autonomous vehicle after the sensor drift.First,a monitoring algorithm that can continuously detect the miscalibration in each frame is designed,leveraging the rotational motion each individual sensor observes.Then,as sensor drift occurs,the projection constraints between visual feature points and LiDAR 3-D points are used to compute the scaled camera motion,which is further utilized to align the drifted LiDAR scan with the camera image.Finally,the proposed method is sufficiently compared with two representative approaches in the online experiments with varying levels of random drift,then the method is further extended to the offline calibration experiment and is demonstrated by a comparison with two existing benchmark methods.

Anger-camera型中子探测器位置分辨性能研究

本文描述用于中国散裂中子源(CSNS)谱仪上,基于Anger-camera位置重建原理的闪烁体中子探测器样机位置分辨性能研究。在BL20中子测试束线上完成了探测器关键器件性能测试,包括硅光电倍增管(Silicon Photon Multiplier Tube, SiPM)阵列位置重建能力测试和耐辐照特性研究,同时对不同光导厚度下探测器位置分辨能力开展测试,发现基于SiPM阵列读出的Anger-camera型闪烁体中子探测器采用300μm的^(6)LiF/ZnS(Ag)闪烁屏和5 mm空气作为光导,其位置分辨最佳可达到0.6 mm。该探测器样机后期可通过大面积阵列拼接,实现中子衍射实验对大面积高位置分辨探测器的需求,其成功研制为加快谱仪建设提供有力的技术支撑。

Blackmagic Camera 8.5公测版更新发布

2023年12月,Blackmagic Camera8.5公测版正式发布。安装更新后,为Blackmagic URSA Broadcast G2添加了Blackmagic Cloud工作流程支持。可以从摄影机的新媒体池向Blackmagic Cloud上传片段,也可以直接上传到DaVinci Resolve项目。

Blackmagic Camera 8.5.1正式发布

针对Blackmagic URSA Broadcast G2的Blackmagic Camera 8.5.1版本,提供了Blackmagic Cloud流程支持,用户可从摄影机的新媒体池向Blackmagic Cloud上传片段,也可以直接上传到Da Vinci Resolve项目。新添加的同时代理记录功能加上Blackmagic RAW或ProRes能够助力影像迅速送进新闻演播室或剪辑室,提高工作流程的效率。

Pocket Cinema Camera系列和全画幅6K摄影机加入推流等新功能

Blackmagic Design最新发布的摄影机软件Blackmagic Camera 8.6公共测试版为Blackmagic Pocket Cinema Camera和Cinema Camera 6K机型增加了云流程支持,让用户可以将素材从摄影机媒体池上传到Blackmagic Cloud,甚至直接上传到DaVinci Resolve项目中。并为两款机型的USB-C接口增加了网络摄像头功能,即可把摄影机连接到电脑,并使用任何主流推流软件或平台以全高清1080P质量推流直播。

K-nearest neighborhood based integration of time-of-flight cameras and passive stereo for high-accuracy depth maps?

Both time-of-flight(ToF) cameras and passive stereo can provide the depth information for their corresponding captured real scenes, but they have innate limitations. ToF cameras and passive stereo are intrinsically complementary for certain tasks. It is desirable to appropriately leverage all the available information by ToF cameras and passive stereo. Although some fusion methods have been presented recently, they fail to consider ToF reliability detection and ToF based improvement of passive stereo. As a result, this study proposes an approach to integrating ToF cameras and passive stereo to obtain high-accuracy depth maps. The main contributions are:(1) An energy cost function is devised to use data from ToF cameras to boost the stereo matching of passive stereo;(2) A fusion method is used to combine the depth information from both ToF cameras and passive stereo to obtain high-accuracy depth maps. Experiments show that the proposed approach achieves improved results with high accuracy and robustness.

Transient imaging with a time-of-flight camera and its applications

瞬态成像是一种记录光从开始照射直到稳定状态全过程的摄像技术,这使得光速量级的事件可以被观测。介绍了采用飞行时间(time-of-flight,To F)相机进行瞬态成像的三种数学模型,即相关函数模型、频域模型和压缩感知模型。瞬态图像应用主要基于光传输解析和不同光路光线分离。讨论了两种应用,即对散射介质内的物体进行成像和恢复被拐角遮挡物体的形状和纹理。

基于Camera Link的视频图像信号源设计

针对给某智能图像信息处理终端提供可靠的图像信号源,设计了一种基于Camera Link接口的视频图像信号源。该文对图像信号源进行了总体方案设计、硬件电路设计以及帧同步算法设计并进行了验证。该图像信号源通过PCIe总线连接到上位机,并利用DDR3高速缓存图像。通过Camera Link接口与智能图像信息处理终端之间进行通信。结果表明,该设备可用于生产过程中智能图像信息处理终端的相关试验,完成了测试图像的输出,输出图像有效像素为2 560×720,采集到的画面40帧/秒,带宽可达1.9 Gbps,具有一定的工程应用价值。

Direct measurement of an energy-dependent single-event-upset cross-section with time-of-flight method at CSNS

To predict the soft error rate for applications, it is essential to study the energy dependence of the single-event-upset(SEU) cross-section. In this work, we present a direct measurement of the SEU cross-section with the Back-n white neutron source at the China Spallation Neutron Source. The measured cross section is consistent with the soft error data from the manufacturer and the result suggests that the threshold energy of the SEU is about 0.5 Me V, which confirms the statement in Iwashita’s report that the threshold energy for neutron soft error is much below that of the(n, α) cross-section of silicon.In addition, an index of the effective neutron energy is suggested to characterize the similarity between a spallation neutron beam and the standard atmospheric neutron environment.

GPU-accelerated three-dimensional reconstruction method of the Compton camera and its application in radionuclide imaging

A novel and fast three-dimensional reconstruction method for a Compton camera and its performance in radionuclide imaging is proposed and analyzed in this study. The conical surface sampling back-projection method with scattering angle correction(CSS-BP-SC) can quickly perform the back-projection process of the Compton cone and can be used to precompute the list-mode maximum likelihood expectation maximization(LM-MLEM). A dedicated parallel architecture was designed for the graphics processing unit acceleration of the back-projection and iteration stage of the CSS-BP-SC-based LM-MLEM. The imaging results of the two-point source Monte Carlo(MC) simulation demonstrate that by analyzing the full width at half maximum along the three coordinate axes, the CSS-BP-SC-based LM-MLEM can obtain imaging results comparable to those of the traditional reconstruction algorithm, that is, the simple back-projection-based LM-MLEM. The imaging results of the mouse phantom MC simulation and experiment demonstrate that the reconstruction results obtained by the proposed method sufficiently coincide with the set radioactivity distribution, and the speed increased by more than 664 times compared to the traditional reconstruction algorithm in the mouse phantom experiment. The proposed method will further advance the imaging applications of Compton cameras.

Dose reconstruction with Compton camera during proton therapy via subset-driven origin ensemble and double evolutionary algorithm

Compton camera-based prompt gamma(PG) imaging has been proposed for range verification during proton therapy. However, a deviation between the PG and dose distributions, as well as the difference between the reconstructed PG and exact values, limit the effectiveness of the approach in accurate range monitoring during clinical applications. The aim of the study was to realize a PG-based dose reconstruction with a Compton camera, thereby further improving the prediction accuracy of in vivo range verification and providing a novel method for beam monitoring during proton therapy. In this paper, we present an approach based on a subset-driven origin ensemble with resolution recovery and a double evolutionary algorithm to reconstruct the dose depth profile(DDP) from the gamma events obtained by a cadmium-zinc-telluride Compton camera with limited position and energy resolution. Simulations of proton pencil beams with clinical particle rate irradiating phantoms made of different materials and the CT-based thoracic phantom were used to evaluate the feasibility of the proposed method. The results show that for the monoenergetic proton pencil beam irradiating homogeneous-material box phantom,the accuracy of the reconstructed DDP was within 0.3 mm for range prediction and within 5.2% for dose prediction. In particular, for 1.6-Gy irradiation in the therapy simulation of thoracic tumors, the range deviation of the reconstructed spreadout Bragg peak was within 0.8 mm, and the relative dose deviation in the peak area was less than 7% compared to the exact values. The results demonstrate the potential and feasibility of the proposed method in future Compton-based accurate dose reconstruction and range verification during proton therapy.

Time-of-Flight透散射介质成像技术综述

Time-of-Flight (ToF)成像是利用光在目标和相机之间的飞行时间来获取场景的深度信息,具有体积小、成本低、实时成像等优势。在散射环境中,由于散射介质对光的散射作用,ToF成像受到多径干扰的影响,深度测量误差较大,限制了ToF相机在散射场景中的应用。ToF透散射介质成像技术是校正因散射光引起的多径干扰效应,从传感器接收到的混叠信号中分离出目标分量,实现散射场景中的深度信息恢复,其在雾天自动驾驶、水下勘测、生物医学等领域具有广阔的应用前景。依据ToF成像系统的不同,详细介绍了PL-ToF和CW-ToF成像的基本原理,阐述和分析了散射场景中ToF稳态成像和瞬态成像的机理和特点,分别回顾和总结了ToF稳态成像和瞬态成像的透散射介质成像研究现状,并介绍了ToF透散射介质成像的应用前景,最后依据现有ToF透散射介质成像技术的优缺点,对未来发展趋势进行了展望。

Development and preliminary results of a large-pixel two-layer LaBr_(3) Compton camera prototype

Lanthanum bromide(LaBr_(3))crystal has a high energy resolution and time resolution and has been used in Compton cameras(CCs)over the past few decades.However,LaBr_(3) crystal arrays are difficult to process because LaBr_(3) is easy to crack and break;thus,few LaBr_(3)-based CC prototypes have been built.In this study,we designed and fabricated a large-pixel LaBr_(3) CC prototype and evaluated its performance with regard to position,energy,and angular resolution.We used two 10×10 LaBr_(3) crystal arrays with a pixel size of 5 mm×5 mm,silicon photomultipliers(SiPMs),and corresponding decoding circuits to construct our prototype.Additionally,a framework based on a Voronoi diagram and a lookup table was developed for list-mode projection data acquisition.Monte Carlo(MC)simulations based on Geant4 and experiments were conducted to evaluate the performance of our CC prototype.The lateral position resolution was 5 mm,and the maximum deviation in the depth direction was 2.5 and 5 mm for the scatterer and absorber,respectively.The corresponding measured energy resolu-tions were 7.65%and 8.44%,respectively,at 511 keV.The experimental results of ^(137)Cs point-like sources were consistent with the MC simulation results with regard to the spatial positions and full widths at half maximum(FWHMs).The angular resolution of the fabricated prototype was approximately 6°when a point-like ^(137)Cs source was centrally placed at a distance of 5 cm from the scatterer.We proposed and investigated a large-pixel LaBr_(3) CC for the first time and verified its feasibility for use in accurate spatial positioning of radiative sources with a high angular resolution.The proposed CC can satisfy the requirements of radiative source imaging and positioning in the nuclear industry and medical applications.

Study on Color Information Degradation Induced byγ-ray Radiation in CMOS Cameras

Theγ-rays are widely and abundantly present in strong nuclear radiation environments,and when they act on the camera equipment used to obtain environmental visual information on nuclear robots,radiation effects will occur,which will degrade the performance of the camera system,reduce the imaging quality,and even cause catastrophic consequences.Color reducibility is an important index for evaluating the imaging quality of color camera,but its degradation mechanism in a nuclear radiation environment is still unclear.In this paper,theγ-ray irradiation experiments of CMOS cameras were carried out to analyse the degradation law of the camera’s color reducibility with cumulative irradiation and reveal the degradation mechanism of the color information of the CMOS camera underγ-ray irradiation.The results show that the spectral response of CMOS image sensor(CIS)and the spectral transmittance of lens after irradiation affect the values of a^(*)and b^(*)in the LAB color model.While the full well capacity(FWC)of CIS and transmittance of lens affect the value of L^(*)in the LAB color model,thus increase color difference and reduce brightness,the combined effect of color difference and brightness degradation will reduce the color reducibility of CMOS cameras.Therefore,the degradation of the color information of the CMOS camera afterγ-ray irradiation mainly comes from the changes in the FWC and spectral response of CIS,and the spectral transmittance of lens.

Novel camera calibration method based on invariance of collinear points and pole-polar constraint

To address the eccentric error of circular marks in camera calibration,a circle location method based on the invariance of collinear points and pole–polar constraint is proposed in this paper.Firstly,the centers of the ellipses are extracted,and the real concentric circle center projection equation is established by exploiting the cross ratio invariance of the collinear points.Subsequently,since the infinite lines passing through the centers of the marks are parallel,the other center projection coordinates are expressed as the solution problem of linear equations.The problem of projection deviation caused by using the center of the ellipse as the real circle center projection is addressed,and the results are utilized as the true image points to achieve the high precision camera calibration.As demonstrated by the simulations and practical experiments,the proposed method performs a better location and calibration performance by achieving the actual center projection of circular marks.The relevant results confirm the precision and robustness of the proposed approach.

Methodology for Automatically Setting Camera View to Mile Marker for Traffic Incident Management

Traffic incident management (TIM) is a FHWA Every Day Counts initiative with the objective of reducing secondary crashes, improving travel reliability, and ensuring safety of responders. Agency roadside cameras play a critical role in TIM by helping dispatchers quickly identify the precise location of incidents when receiving reports from motorists with varying levels of spatial accuracy. Reconciling position reports that are often mile marker based, with cameras that operate in a Pan-Tilt-Zoom coordinate system relies on dispatchers having detailed knowledge for hundreds of cameras and perhaps some presets. During real-time incident dispatching, reducing the time it takes to identify the most relevant cameras and setting their view on the incident is an important opportunity to improve incident management dispatch times. This research develops a camera-to-mile marker mapping technique that automatically sets the camera view to a specified mile marker within the field-of-view of the camera. Over 350 traffic cameras along Indiana’s 2250 directional miles of interstate were mapped to approximately 5000 discrete locations that correspond to approximately 780 directional miles (~35% of interstate) of camera coverage. This newly developed technique will allow operators to quickly identify the nearest camera and set them to the reported location. This research also identifies segments on the interstate system with limited or no camera coverage for decision makers to prioritize future capital investments. This paper concludes with brief discussion on future research to automate the mapping using LiDAR data and to set the cameras after automatically detecting the events using connected vehicle trajectory data.

Stereoscopic Camera-Sensor Model for the Development of Highly Automated Driving Functions within a Virtual Test Environment

The need for efficient and reproducible development processes for sensor and perception systems is growing with their increased use in modern vehicles. Such processes can be achieved by using virtual test environments and virtual sensor models. In the context of this, the present paper documents the development of a sensor model for depth estimation of virtual three-dimensional scenarios. For this purpose, the geometric and algorithmic principles of stereoscopic camera systems are recreated in a virtual form. The model is implemented as a subroutine in the Epic Games Unreal Engine, which is one of the most common Game Engines. Its architecture consists of several independent procedures that enable a local depth estimation, but also a reconstruction of a whole three-dimensional scenery. In addition, a separate programme for calibrating the model is presented. In addition to the basic principles, the architecture and the implementation, this work also documents the evaluation of the model created. It is shown that the model meets specifically defined requirements for real-time capability and the accuracy of the evaluation. Thus, it is suitable for the virtual testing of common algorithms and highly automated driving functions.

Haemoglobin Measurement from Eye Anterior Ciliary Arteries through Borescope Camera

Nowadays,smartphones are used as self-health monitoring devices for humans.Self-health monitoring devices help clinicians with big data for accurate diagnosis and guidance for treatment through repetitive measurement.Repetitive measurement of haemoglobin requires for pregnant women,pediatric,pulmonary hypertension and obstetric patients.Noninvasive haemoglobin measurement through conjunctiva leads to inaccurate measurement.The inaccuracy is due to a decrease in the density of goblet cells and acinar units in Meibomian glands in the human eye as age increases.Furthermore,conjunctivitis is a disease in the eye due to inflammation or infection at the conjunctiva.Conjunctivitis is in the form of lines in the eyelid and covers the white part of the eyeball.Moreover,small blood vessels in eye regions of conjunctiva inflammations are not visible to the human eye or standard camera.This paper proposes smartphone-based hae-moglobin(SBH)measurement through a borescope camera from anterior ciliary arteries of the eye for the above problem.The proposed SBH method acquires images from the anterior ciliary arteries region of the eye through a smartphone attached with a high megapixel borescope camera.The anterior ciliary arteries are projected through transverse dyadic wavelet transform(TDyWT)and applied with delta segmentation to obtain blood cells from the ciliary arteries of the eye.Furthermore,the Gaussian regression algorithm measures haemoglobin(Hb)with more accuracy based on the person,eye arteries,red pixel statistical parameters obtained from the left and right eye,age,and weight.Furthermore,the experimen-tal result of the proposed SBH method has an accuracy of 96%in haemoglobin measurement.

Image Recognition Based on Deep Learning with Thermal Camera Sensing

As the COVID-19 epidemic spread across the globe,people around the world were advised or mandated to wear masks in public places to prevent its spreading further.In some cases,not wearing a mask could result in a fine.To monitor mask wearing,and to prevent the spread of future epidemics,this study proposes an image recognition system consisting of a camera,an infrared thermal array sensor,and a convolutional neural network trained in mask recognition.The infrared sensor monitors body temperature and displays the results in real-time on a liquid crystal display screen.The proposed system reduces the inefficiency of traditional object detection by providing training data according to the specific needs of the user and by applying You Only Look Once Version 4(YOLOv4)object detection technology,which experiments show has more efficient training parameters and a higher level of accuracy in object recognition.All datasets are uploaded to the cloud for storage using Google Colaboratory,saving human resources and achieving a high level of efficiency at a low cost.