Traffic light detection and recognition in intersections based on intelligent vehicle

To ensure revulsive driving of intelligent vehicles at intersections, a method is presented to detect and recognize the traffic lights. First, the stabling siding at intersections is detected by applying Hough transformation. Then, the colors of traffic lights are detected with color space transformation. Finally, self-associative memory is used to recognize the countdown characters of the traffic lights. Test results at 20 real intersections show that the ratio of correct stabling siding recognition reaches up to 90%;and the ratios of recognition of traffic lights and divided characters are 85% and 97%, respectively. The research proves that the method is efficient for the detection of stabling siding and is robust enough to recognize the characters from images with noise and broken edges.

Volumetric assessment of hepatic grafts using a light detection and ranging system for 3D scanning:Preliminary data

BACKGROUND Liver transplantation has evolved into a safe life-saving operation and remains the golden standard in the treatment of end stage liver disease.The main limiting factor in the application of liver transplantation is graft shortage.Many strategies have been developed in order to alleviate graft shortage,such as living donor partial liver transplantation and split liver transplantation for adult and pediatric patients.In these strategies,liver volume assessment is of paramount importance,as size mismatch can have severe consequences in the success of liver transplantation.AIM To evaluate the safety,feasibility,and accuracy of light detection and ranging(LIDAR)3D photography in the prediction of whole liver graft volume and mass.METHODS Seven liver grafts procured for orthotopic liver transplantation from brain deceased donors were prospectively measured with an LIDAR handheld camera and their mass was calculated and compared to their actual weight.RESULTS The mean error of all measurements was 17.03 g(range 3.56-59.33 g).Statistical analysis of the data yielded a Pearson correlation coefficient index of 0.9968,indicating a strong correlation between the values and a Student’s t-test P value of 0.26.Mean accuracy of the measurements was calculated at 97.88%.CONCLUSION Our preliminary data indicate that LIDAR scanning of liver grafts is a safe,cost-effective,and feasible method of ex vivo determination of whole liver volume and mass.More data are needed to determine the precision and accuracy of this method.

Rail-Pillar Net:A 3D Detection Network for Railway Foreign Object Based on LiDAR

Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,we propose Rail-PillarNet,a three-dimensional(3D)LIDAR(Light Detection and Ranging)railway foreign object detection method based on the improvement of PointPillars.Firstly,the parallel attention pillar encoder(PAPE)is designed to fully extract the features of the pillars and alleviate the problem of local fine-grained information loss in PointPillars pillars encoder.Secondly,a fine backbone network is designed to improve the feature extraction capability of the network by combining the coding characteristics of LIDAR point cloud feature and residual structure.Finally,the initial weight parameters of the model were optimised by the transfer learning training method to further improve accuracy.The experimental results on the OSDaR23 dataset show that the average accuracy of Rail-PillarNet reaches 58.51%,which is higher than most mainstream models,and the number of parameters is 5.49 M.Compared with PointPillars,the accuracy of each target is improved by 10.94%,3.53%,16.96%and 19.90%,respectively,and the number of parameters only increases by 0.64M,which achieves a balance between the number of parameters and accuracy.

Traffic light detection and recognition for autonomous vehicles

Traffic light detection and recognition is essential for autonomous driving in urban environments. A camera based algorithm for real-time robust traffic light detection and recognition was proposed, and especially designed for autonomous vehicles. Although the current reliable traffic light recognition algorithms operate well under way, most of them are mainly designed for detection at a fixed position and the effect on autonomous vehicles under real-world conditions is still limited. Some methods achieve high accuracy on autonomous vehicle, but they can＇t work normally without the aid of high-precision priori map. The authors presented a camera-based algorithm for the problem. The image processing flow can be divided into three steps, including pre-processing, detection and recognition. Firstly, red-green-blue （RGB） color space is converted to hue-saturation-value （HSV） as main content of pre-processing. In detection step, the transcendental color threshold method is used for initial filterings, meanwhile, the prior knowledge is performed to scan the scene in order to quickly establish candidate regions. For recognition, this article use histogram of oriented gradients （HOG） features and support vector machine （SVM） as well to recognize the state of traffic light. The proposed system on our autonomous vehicle was evaluated. With voting schemes, the proposed can provide a sufficient accuracy for autonomous vehicles in urban enviroment.

Flexible and Reusable Non-woven Fabric Photodetector Based on Polypyrrole/Crystal Violate Lactone for NIR Light Detection and Writing

Rapid NIR light detection and/or writing has drawn much attention,but their practical applications have been limited by obtaining such NIR photodetectors.To address this problem,we have developed a simple and versatile strategy to prepare a non-woven fabric photodetector.The blue non-woven fabric photodetector has been prepared by coating photo-thermochromic ink(including crystal violet lactone(CVL)as the thermo-sensitive dye,polypyrrole(PPy)nanospheres as the photothermal component and hydroxyethyl cellulose(HEC)as the polymer matrix)on white non-woven fabric.When the blue fabric photodetector is irradiated by NIR(808-nm as model,0.75 W cm^(−2))laser,the discoloration occurs in 35 s,and higher laser intensity confers more rapid discoloration.This discoloration results from the photothermal effect of PPy which confers the elevation of temperature(>50℃)and then converts CVL to its leuco form(colorless).When the laser is turned off,the temperature drops to below the transition temperature(<43℃),and then CVL reverts to its initial blue color.Moreover,different figures and images can be easily printed on the fabric photodetector by 808 nm laser,and then they can be erased automatically under ambient conditions,with excellent cycling stability.Therefore,this fabric photodetector may act as a new platform for rapid NIR light detection and writing.

Experimental Detection of Depth of Field for a Thermal Light Lensless Ghost Imaging System

We propose optical experiments to study the depth of field for a thermal light lensless ghost imaging system. It is proved that the diaphragm is an important factor to influence the depth of field, and the ghost images of two detected objects with longitudinal distance less than the depth of field can be achieved simultaneously. The longitudinal coherence scale of the thermal light lensless ghost imaging determines the depth of field. Theoretical analysis can well explain the experimental results.

Development of vehicle-recognition method on water surfaces using LiDAR data:SPD^(2)(spherically stratified point projection with diameter and distance)

Swarm robot systems are an important application of autonomous unmanned surface vehicles on water surfaces.For monitoring natural environments and conducting security activities within a certain range using a surface vehicle,the swarm robot system is more efficient than the operation of a single object as the former can reduce cost and save time.It is necessary to detect adjacent surface obstacles robustly to operate a cluster of unmanned surface vehicles.For this purpose,a LiDAR(light detection and ranging)sensor is used as it can simultaneously obtain 3D information for all directions,relatively robustly and accurately,irrespective of the surrounding environmental conditions.Although the GPS(global-positioning-system)error range exists,obtaining measurements of the surface-vessel position can still ensure stability during platoon maneuvering.In this study,a three-layer convolutional neural network is applied to classify types of surface vehicles.The aim of this approach is to redefine the sparse 3D point cloud data as 2D image data with a connotative meaning and subsequently utilize this transformed data for object classification purposes.Hence,we have proposed a descriptor that converts the 3D point cloud data into 2D image data.To use this descriptor effectively,it is necessary to perform a clustering operation that separates the point clouds for each object.We developed voxel-based clustering for the point cloud clustering.Furthermore,using the descriptor,3D point cloud data can be converted into a 2D feature image,and the converted 2D image is provided as an input value to the network.We intend to verify the validity of the proposed 3D point cloud feature descriptor by using experimental data in the simulator.Furthermore,we explore the feasibility of real-time object classification within this framework.

A review of ToF-based LiDAR

In recent years,propelled by the rapid iterative advancements in digital imaging technology and the semiconductor industry,encompassing microelectronic design,manufacturing,packaging,and testing,time-of-flight(ToF)-based imaging systems for acquiring depth information have garnered considerable attention from both academia and industry.This technology has emerged as a focal point of research within the realm of 3D imaging.Owing to its relatively straightforward principles and exceptional performance,ToF technology finds extensive applications across various domains including human−computer interaction,autonomous driving,industrial inspection,medical and healthcare,augmented reality,smart homes,and 3D reconstruction,among others.Notably,the increasing maturity of ToF-based LiDAR systems is evident in current developments.This paper comprehensively reviews the fundamental principles of ToF technology and LiDAR systems,alongside recent research advancements.It elucidates the innovative aspects and technical challenges encountered in both transmitter(TX)and receiver(RX),providing detailed discussions on corresponding solutions.Furthermore,the paper explores prospective avenues for future research,offering valuable insights for subsequent investigations.

Three-channel CMOS transimpedance amplifier for LiDAR sensor receiver

For time-of-flight(TOF)light detection and ranging(LiDAR),a three-channel high-performance transimpedance amplifier(TIA)with high immunity to input load capacitance is presented.A regulated cascade(RGC)as the input stage is at the core of the complementary metal oxide semiconductor(CMOS)circuit chip,giving it more immunity to input photodiode detectors.A simple smart output interface acting as a feedback structure,which is rarely found in other designs,reduces the chip size and power consumption simultaneously.The circuit is designed using a 0.5μm CMOS process technology to achieve low cost.The device delivers a 33.87 dB?transimpedance gain at 350 MHz.With a higher input load capacitance,it shows a-3 dB bandwidth of 461 MHz,indicating a better detector tolerance at the front end of the system.Under a 3.3 V supply voltage,the device consumes 5.2 mW,and the total chip area with three channels is 402.8×597.0μm2(including the test pads).

Detecting Spin Bias with Circularly Polarized Light

We theoretically study the spin transport through a two-terminal quantum dot device under the influence of a symmetric spin bias and circularly polarized light. It is found that the combination of the circularly polarized light and the applied spin bias can result in a net charge current. The resultant charge current is large enough to be measured when properly choosing the system parameters. The resultant charge current can be used to deduce the spin bias due to the fact that there exists a simple linear relation between them. When the external circuit is open, a charge bias instead of a charge current can be induced, which is also measurable by present technologies. These findings indicate a new approach to detect the spin bias by using circularly polarized light.

Multi-Scale Feature Extraction for Joint Classification of Hyperspectral and LiDAR Data

With the development of sensors,the application of multi-source remote sensing data has been widely concerned.Since hyperspectral image(HSI)contains rich spectral information while light detection and ranging(LiDAR)data contains elevation information,joint use of them for ground object classification can yield positive results,especially by building deep networks.Fortu-nately,multi-scale deep networks allow to expand the receptive fields of convolution without causing the computational and training problems associated with simply adding more network layers.In this work,a multi-scale feature fusion network is proposed for the joint classification of HSI and LiDAR data.First,we design a multi-scale spatial feature extraction module with cross-channel connections,by which spatial information of HSI data and elevation information of LiDAR data are extracted and fused.In addition,a multi-scale spectral feature extraction module is employed to extract the multi-scale spectral features of HSI data.Finally,joint multi-scale features are obtained by weighting and concatenation operations and then fed into the classifier.To verify the effective-ness of the proposed network,experiments are carried out on the MUUFL Gulfport and Trento datasets.The experimental results demonstrate that the classification performance of the proposed method is superior to that of other state-of-the-art methods.

Intelligent Risk-Identification Algorithm with Vision and 3D LiDAR Patterns at Damaged Buildings

Existingfirefighting robots are focused on simple storage orfire sup-pression outside buildings rather than detection or recognition.Utilizing a large number of robots using expensive equipment is challenging.This study aims to increase the efficiency of search and rescue operations and the safety offirefigh-ters by detecting and identifying the disaster site by recognizing collapsed areas,obstacles,and rescuers on-site.A fusion algorithm combining a camera and three-dimension light detection and ranging(3D LiDAR)is proposed to detect and loca-lize the interiors of disaster sites.The algorithm detects obstacles by analyzingfloor segmentation and edge patterns using a mask regional convolutional neural network(mask R-CNN)features model based on the visual data collected from a parallelly connected camera and 3D LiDAR.People as objects are detected using you only look once version 4(YOLOv4)in the image data to localize persons requiring rescue.The point cloud data based on 3D LiDAR cluster the objects using the density-based spatial clustering of applications with noise(DBSCAN)clustering algorithm and estimate the distance to the actual object using the center point of the clustering result.The proposed artificial intelligence(AI)algorithm was verified based on individual sensors using a sensor-mounted robot in an actual building to detectfloor surfaces,atypical obstacles,and persons requiring rescue.Accordingly,the fused AI algorithm was comparatively verified.

A star-like photodetector for angle-based light sensing in 3D space

The development of three-dimensional(3D)space light angle detection is vital in optical technology for applications such as 3D imaging,computer vision,and augmented reality.Current methods involve advanced sensors and algorithms,including time-offlight cameras,which need multiple cameras and light sources to improve accuracy.However,it is a great challenge to integrate these complex components into compact devices.Subwavelength semiconductor structures offer optical resonance characteristics,enabling precise light–matter interaction regulation.A 3D star-like photodetector,fabricated using a template assistant printing strategy,demonstrates optical resonances of the subwavelength facade and the shielding effect of spatial arrangement.It achieves light angle detection with the resolution of 10°in vertical space and the resolution of 36°in horizontal space,making it a promising prototype for various applications.

Mapping tree canopies in urban environments using airborne laser scanning (ALS):a Vancouver case study

Background: The distribution of forest vegetation within urban environments is critically important as it influences urban environmental conditions and the energy exchange through the absorption of solar radiation and modulation of evapotranspiration. It also plays an important role filtering urban water systems and reducing storm water runoff.Methods: We investigate the capacity of ALS data to individually detect, map and characterize large(taller than15 m) trees within the City of Vancouver. Large trees are critical for the function and character of Vancouver’s urban forest. We used an object-based approach for individual tree detection and segmentation to determine tree locations(position of the stem), to delineate the shape of the crowns and to categorize the latter either as coniferous or deciduous.Results: Results indicate a detection rate of 76.6% for trees > 15 m with a positioning error of 2.11 m(stem location). Extracted tree heights possessed a RMSE of 2.60 m and a bias of-1.87 m, whereas crown diameter was derived with a RMSE of 3.85 m and a bias of-2.06 m. Missed trees are principally a result of undetected treetops occurring in dense, overlapping canopies with more accurate detection and delineation of trees in open areas.Conclusion: By identifying key structural trees across Vancouver’s urban forests, we can better understand their role in providing ecosystem goods and services for city residents.

An evaluation of the role played by remote sensing technology following the World Trade Center attack

Remote sensing technology has been widely recognized for contributing to emergency response efforts after the World Trade Center attack on September 11th, 2001. The need to coordinate activities in the midst of a dense, yet relatively small area, made the combination of imagery and mapped data strategically useful. This paper reviews the role played by aerial photography, satellite imagery, and LIDAR data at Ground Zero. It examines how emergency managers utilized these datasets, and identifies significant problems that were encountered. It goes on to explore additional ways in which imagery could have been used, while presenting recommendations for more effective use in future disasters and Homeland Security applications. To plan adequately for future events, it was important to capture knowledge from individuals who responded to the World Trade Center attack. In recognition, interviews with key emergency management and geographic information system (GIS) personnel provide the basis of this paper. Successful techniques should not be forgotten, or serious problems dismissed. Although widely used after September 11th, it is important to recognize that with better planning, remote sensing and GIS could have played an even greater role. Together with a data acquisition timeline, an expanded discussion of these issues is available in the MCEER/NSF report “Emergency Response in the Wake of the World Trade Center Attack; The Remote Sensing Perspective” (Huyck and Adams, 2002) Keywords World Trade Center (WTC) - terrorism - emergency response - emergency management - ground zero - remote sensing - emergency operations - disasters - geographic information systems (GIS) - satellite imagery - synthetic aperture radar (SAR) - light detection and ranging imagery (LIDAR)

Predicting the provisioning potential of forest ecosystem services using airborne laser scanning data and forest resource maps

Background: Remote sensing-based mapping of forest Ecosystem Service(ES) indicators has become increasingly popular. The resulting maps may enable to spatially assess the provisioning potential of ESs and prioritize the land use in subsequent decision analyses. However, the mapping is often based on readily available data, such as land cover maps and other publicly available databases, and ignoring the related uncertainties.Methods: This study tested the potential to improve the robustness of the decisions by means of local model fitting and uncertainty analysis. The quality of forest land use prioritization was evaluated under two different decision support models: either using the developed models deterministically or in corporation with the uncertainties of the models.Results: Prediction models based on Airborne Laser Scanning(ALS) data explained the variation in proxies of the suitability of forest plots for maintaining biodiversity, producing timber, storing carbon, or providing recreational uses(berry picking and visual amenity) with RMSEs of 15%–30%, depending on the ES. The RMSEs of the ALS-based predictions were 47%–97%of those derived from forest resource maps with a similar resolution. Due to applying a similar field calibration step on both of the data sources, the difference can be attributed to the better ability of ALS to explain the variation in the ES proxies.Conclusions: Despite the different accuracies, proxy values predicted by both the data sources could be used for a pixel-based prioritization of land use at a resolution of 250 m~2, i.e., in a considerably more detailed scale than required by current operational forest management. The uncertainty analysis indicated that maps of the ES provisioning potential should be prepared separately based on expected and extreme outcomes of the ES proxy models to fully describe the production possibilities of the landscape under the uncertainties in the models.

Laser diode drive method with narrow-width and high-peak current for multi-line LIDAR

Light detection and ranging (LIDAR) based on time of flight (TOF) method is widely used in many fields related to distance measurement. LIDAR generally uses laser diode (LD) to emit the pulsed laser with high peak power and short duration to ensure a large distance measurement range and eye safety. To achieve this goal, we propose a pulsed LD drive method producing the drive current with high peak and narrow pulse width. We analyze the key issues and related theories of the drive current generation based on this method and design an LD driver. A model of drive current generation is established and the influence of operating frequency on drive current is discussed. The LD driver is simulated by software and verified by experiments. The working frequency of the driver changes from 20 kHz to 100 kHz and the charging voltage is set at 130 V. The current produced by this driver has a duration of 8.8 ns and a peak of about 35 A, and the peak output optical power of the LD exceeds 75 W.

On the potential to predetermine dominant tree species based on sparse-density airborne laser scanning data for improving subsequent predictions of species-specific timber volumes

Background： Tree species recognition is the main bottleneck in remote sensing based inventories aiming to produce an input for species-specific growth and yield models. We hypothesized that a stratification of the target data according to the dominant species could improve the subsequent predictions of species-specific attributes in particular in study areas strongly dominated by certain species. Methods： We tested this hypothesis and an operational potential to improve the predictions of timber volumes, stratified to Scots pine, Norway spruce and deciduous trees, in a conifer forest dominated by the pine species. We derived predictor features from airborne laser scanning （ALS） data and used Most Similar Neighbor （MSN） and Seemingly Unrelated Regression （SUR） as examples of non-parametric and parametric prediction methods, respectively Results： The relationships between the ALS features and the volumes of the aforementioned species were considerably different depending on the dominant species. Incorporating the observed dominant species inthe predictions improved the root mean squared errors by 13.3-16.4 % and 12.6-28.9 % based on MSN and SUR, respectively, depending on the species. Predicting the dominant species based on a linear discriminant analysis had an overall accuracy of only 76 % at best, which degraded the accuracies of the predicted volumes. Consequently, the predictions that did not consider the dominant species were more accurate than those refined with the predicted species. The MSN method gave slightly better results than models fitted with SUR. Conclusions： According to our results, incorporating information on the dominant species has a clear potential to improve the subsequent predictions of species-specific forest attributes. Determining the dominant species based solely on ALS data is deemed challenging, but important in particular in areas where the species composition is otherwise seemingly homogeneous except being dominated by certain species.

Next Generation Scanning LIDAR Systems for Optimizing Wake Turbulence Separation Minima

Numerous studies have been performed to better understand the behavior of wake vortices with regards to aircraft characteristics and weather conditionsover the pastten years. These studies have led to the development of the aircraft RECATegorization(RECAT) programs in Europe and in USA. Its phase one focused on redefining distance separation matrix with six static aircraft wake turbulence categories instead of three with the current International Civil Aviation Organization(ICAO) regulations. In Europe, the RECAT-EU regulation is now entering under operational implementation atseveral key airports. As proven by several research projects in the past, LIght Detection And Ranging(LIDAR) sensors are considered as the ground truth wake vortex measurements for assessing the safety impact of a new wake turbulence regulation at an airport in quantifying the risks given the local specificities. LIDAR's can also be used to perform risk monitoring after the implementation. In this paper, the principle to measure wake vortices with scanning coherent Doppler LIDARs is described as well as its dedicated post-processing. Finally the use of WINDCUBELIDAR based solution for supporting the implementation of new wake turbulenceregulation is described along with satisfyingresults that have permitted the monitoring of the wake vortex encounter risk after the implementation of a new wake turbulence regulation.

Effects of laser beam divergence angle on airborne LIDAR positioning errors

The influence of laser beam divergence angle on the positioning accuracy of scanning airborne light detection and ranging （LIDAR） is analyzed and simulated. Based on the data process and positioning principle of airborne LIDAR, the errors from pulse broadening induced by laser beam di vergence angle are modeled and qualitatively analyzed for different terrain surfaces. Simulated results of positioning errors and suggestions to reduce them are given for the flat surface, the downhill of slope surface, and the uphill surface.