Imaging simulation and analysis of attitude jitter effect on topographic mapping for lunar orbiter stereo optical cameras

The geometric accuracy of topographic mapping with high-resolution remote sensing images is inevita-bly affected by the orbiter attitude jitter.Therefore,it is necessary to conduct preliminary research on the stereo mapping camera equipped on lunar orbiter before launching.In this work,an imaging simulation method consid-ering the attitude jitter is presented.The impact analysis of different attitude jitter on terrain undulation is conduct-ed by simulating jitter at three attitude angles,respectively.The proposed simulation method is based on the rigor-ous sensor model,using the lunar digital elevation model(DEM)and orthoimage as reference data.The orbit and attitude of the lunar stereo mapping camera are simulated while considering the attitude jitter.Two-dimensional simulated stereo images are generated according to the position and attitude of the orbiter in a given orbit.Experi-mental analyses were conducted by the DEM with the simulated stereo image.The simulation imaging results demonstrate that the proposed method can ensure imaging efficiency without losing the accuracy of topographic mapping.The effect of attitude jitter on the stereo mapping accuracy of the simulated images was analyzed through a DEM comparison.

Spatial resolution and image processing for pinhole camera-based X-ray fluorescence imaging: a simulation study

Spatial resolution and image-processing methods for full-field X-ray fluorescence(FF-XRF)imaging using X-ray pinhole cameras were studied using Geant4simulations with different geometries and algorithms for image reconstruction.The main objectives were:(1)calculating the quantum efficiency curves of specific cameras,(2)studying the relationships between the spatial resolution and the pinhole diameter,magnification,and camera binning value,and(3)comparing image-processing methods for pinhole camera systems.Several results were obtained using a point and plane source as the X-ray fluorescence emitter and an array of 100×100 silicon pixel detectors as the X-ray camera.The quantum efficiency of a back-illuminated deep depletion(BI-DD)structure was above 30%for the XRF energies in the 0.8–9 keV range,with the maximum of 93.7%at 4 keV.The best spatial resolution of the pinhole camera was 24.7μm and 31.3 lp/mm when measured using the profile function of the point source,with the diameter of 20μm,magnification of 3.16,and camera bin of 1.A blind deconvolution algorithm with Gaussian filtering performed better than the Wiener filter and Richardson iterative methods on FF-XRF images,with the signal-to-noise ratio of 7.81 dB and improved signalto-noise ratio of 7.24 dB at the diameter of 120μm,magnification of 1.0,and camera bin of 1.

A Skeletal Camera Network for Close-range Images with a Data Driven Approach in Analyzing Stereo Configuration

Structure-from-Motion(SfM)techniques have been widely used for 3D geometry reconstruction from multi-view images.Nevertheless,the efficiency and quality of the reconstructed geometry depends on multiple factors,i.e.,the base-height ratio,intersection angle,overlap,and ground control points,etc.,which are rarely quantified in real-world applications.To answer this question,in this paper,we take a data-driven approach by analyzing hundreds of terrestrial stereo image configurations through a typical SfM algorithm.Two main meta-parameters with respect to base-height ratio and intersection angle are analyzed.Following the results,we propose a Skeletal Camera Network(SCN)and embed it into the SfM to lead to a novel SfM scheme called SCN-SfM,which limits tie-point matching to the remaining connected image pairs in SCN.The proposed method was applied in three terrestrial datasets.Experimental results have demonstrated the effectiveness of the proposed SCN-SfM to achieve 3D geometry with higher accuracy and fast time efficiency compared to the typical SfM method,whereas the completeness of the geometry is comparable.

A novel enhancement method for low illumination images based on microarray camera

It is difficult but important to get clear information from the low illumination images. In recent years the research of the low illumination image enhancement has become a hot topic in image processing and computer vision. The Retinex algorithm is one of the most popular methods in the field and uniform illumination is necessary to enhance low illumination image quality by using this algorithm. However, for the different areas of an image with contrast brightness differences, the illumination image is not smooth and causes halo artifacts so that it cannot retain the detail information of the original images. To solve the problem, we generalize the multi-scale Retinex algorithm and propose a new enhancement method for the low illumination images based on the microarray camera. The proposed method can well make up for the deficiency of imbalanced illumination and significantly inhibit the halo artifacts as well. Experimental results show that the proposed method can get better image enhancement effect compared to the multi-scale Retinex algorithm of a single image enhancement. Advantages of the method also include that it can significantly inhibit the halo artifacts and thus retain the details of the original images, it can improve the brightness and contrast of the image as well. The newly developed method in this paper has application potential to the images captured by pad and cell phone in the low illumination environment.

Image Motion Compensation of Off-Axis TMA Three-Line ArrayAerospace Mapping Cameras

To enhance the image motion compensation accuracy of off-axis three-mirror anastigmatic( TMA)three-line array aerospace mapping cameras,a new method of image motion velocity field modeling is proposed in this paper. Firstly,based on the imaging principle of mapping cameras,an analytical expression of image motion velocity of off-axis TMA three-line array aerospace mapping cameras is deduced from different coordinate systems we established and the attitude dynamics principle. Then,the case of a three-line array mapping camera is studied,in which the simulation of the focal plane image motion velocity fields of the forward-view camera,the nadir-view camera and the backward-view camera are carried out,and the optimization schemes for image motion velocity matching and drift angle matching are formulated according the simulation results. Finally,this method is verified with a dynamic imaging experimental system. The results are indicative of that when image motion compensation for nadir-view camera is conducted using the proposed image motion velocity field model,the line pair of target images at Nyquist frequency is clear and distinguishable. Under the constraint that modulation transfer function( MTF) reduces by 5%,when the horizontal frequencies of the forward-view camera and the backward-view camera are adjusted uniformly according to the proposed image motion velocity matching scheme,the time delay integration( TDI) stages reach 6 at most. When the TDI stages are more than 6,the three groups of camera will independently undergo horizontal frequency adjustment. However, when the proposed drift angle matching scheme is adopted for uniform drift angle adjustment,the number of TDI stages will not exceed 81. The experimental results have demonstrated the validity and accuracy of the proposed image motion velocity field model and matching optimization scheme,providing reliable basis for on-orbit image motion compensation of aerospace mapping cameras.

Leakage Currents of Zinc Oxide Surge Arresters in 22 kV Distribution System Using Thermal Image Camera

Zinc Oxide (ZnO) surge arresters (SAs) experience thermal runaway when the temperature exceeds the acceptable limit. This phenomenon is associated with the increase in resistive leakage current due to degradation. This paper presents the electrical performance of ZnO SAs in 22 kV distribution systems using thermal image camera under the power frequency AC operating voltages. When ZnO surge arresters are installation takes a long time in distribution system over more than 5 years. For the experimental study, as ZnO installation takes a long time over 6 years the leakage current is 63.9 mA, temperature differences were measured over a period of time over 14 degree Celsius. This data will be useful as a guideline for solving problems and reducing power loss from leakage current. Moreover, it will be useful in predicting lifetime of ZnO SAs.

Modeling Camera Image Formation Using a Feedforward Neural Network

One fundamental problem in computer vision and image processing is modeling the image formation of a camera, i.e., mapping a point in three-dimensional space to its projected position on the camera’s image plane. If the relationship between the space and the image plane is assumed to be linear, the relationship can be expressed in terms of a transfor-mation matrix and the matrix is often identified by regression. In this paper, we show that the space-to-image relation-ship in a camera can be modeled by a simple neural network. Unlike most other cases employing neural networks, the structure of the network is optimized so as for each link between neurons to have a physical meaning. This makes it possible to effectively initialize link weights and quickly train the network.

Image Recognition Based on Deep Learning with Thermal Camera Sensing

As the COVID-19 epidemic spread across the globe,people around the world were advised or mandated to wear masks in public places to prevent its spreading further.In some cases,not wearing a mask could result in a fine.To monitor mask wearing,and to prevent the spread of future epidemics,this study proposes an image recognition system consisting of a camera,an infrared thermal array sensor,and a convolutional neural network trained in mask recognition.The infrared sensor monitors body temperature and displays the results in real-time on a liquid crystal display screen.The proposed system reduces the inefficiency of traditional object detection by providing training data according to the specific needs of the user and by applying You Only Look Once Version 4(YOLOv4)object detection technology,which experiments show has more efficient training parameters and a higher level of accuracy in object recognition.All datasets are uploaded to the cloud for storage using Google Colaboratory,saving human resources and achieving a high level of efficiency at a low cost.

Research on black-and-white image processing method of smart car camera

In view of the images collection and processing problems of the smart car camera, the paper introduces a method which deals with field and line synchronization signal separation and binarization processing of the video signal collected from track fields, and which is capable to extract and position black border trajectory images effectively. According to the experiment results of the method, the camera images can be collected and processed effectively, and the accurate image information can be provided for the smart cars to travel along the track. The method has the advantages of being easy to use, strong adaptability, ideal performance and high practical value. On the basis of advantages the method is of high practical value in smart car races.

A New Method of Mosaicking Context Camera (CTX) Images for the Geomorphological Study of Martian Landscape

Various spacecraft and satellites from the world’s best space agencies are exploring Mars since 1970, constantly with great ability to capture the maximum amount of dataset for a better understanding of the red planet. In this paper, we propose a new method for making a mosaic of Mars Reconnaissance Orbiter (MRO) spacecraft payload Context Camera (CTX) images. In this procedure, we used ERDAS Imagine for image rectification and mosaicking as a tool for image processing, which is a new and unique method of generating a mosaic of thousands of CTX images to visualize the large-scale areas. The output product will be applicable for mapping of Martian geomorphological features, 2D mapping of the linear feature with high resolution, crater counting, and morphometric analysis to a certain extent.

Study on Focusing of Area Array Camera by Using Frequency of Images

Focusing of an area array camera is an important step in making a high precision imaging camera. Its testing method needs special study. In this paper, a method of camera focusing is introduced. The defocusing depth of camera is calculated by using the frequency spectrum of defocused image. This method is especially suitable for the focusing of the Planar Array Camera, and avoids the complicated work of adjusting the focus plane of the planar array camera in the focusing process.

Near-Infrared Imaging Using a High-Speed Monitoring Near Infrared Hyperspectral Camera(Compovision)

This review paper reports near-infrared(NIR)imaging studies using a newly-developed NIR camera,Compovision.Compovision can measure a significantly wide area of 150mm×250mm at high speed of between 2and 5s.It enables a wide spectral region measurement in the 1 000~2 350nm range at 6nm intervals.We investigated the potential of Compovision in the applications to industrial problems such as the evaluation of pharmaceutical tablets and polymers.Our studies have demonstrated that NIR imaging based on Compovision can solve several issues such as long acquisition times and relatively low sensitivity of detection.NIR imaging with Compovision is strongly expected to be applied not only to pharmaceutical tablet monitoring and polymer characterization but also to various applications such as those to food products,biomedical substances and organic and inorganic materials.

Auto-registration and Orthorecification Algorithm for the Time Series HJ-1A/B CCD Images

How to deal with geometric distortion is an open problem when using the massive amount of satellite images at a national or global scale, especially for multi-temporal image analysis. In this paper, an algorithm is proposed to automatically rectify the geometric distortion of time-series CCD multi- spectral data of small constellation for environmental and disaster mitigation （HJ-1A/B） which was launched by China in 2008. In this algorithm, the area-based matching method was used to automatically search tie points firstly, and then the polynomial function was introduced to correct the systematic errors caused by the satellite motion along the roll, pitch and yaw direction. The improved orthorectification method was finally used to correct pixel displacement caused by off-nadir viewing of topography, which are random errors in the images and cannot be corrected by the polynomial equation. Nine scenes of level 2 HJ CCD images from one path/row were taken as the warp images to test the algorithm. The test result showed that the overall accuracy of the proposed algorithm was within 2 pixels （the average residuals were 37.8 m, and standard deviations were 19.8 m）. The accuracies of 45.96% validation points （VPs） were within 1 pixel and 90.33% VPs were within 2 pixels. The discussion showed that three main factors including the distortion patterns of HJ CCD images, pereent of cloud cover and the varying altitude of the satellite orbit may affect the search of tie points and the accuracy of results. Although the influence of varying altitude of the satellite orbits is less than the other factors, it is noted that detailed satellite altitude information should be given in the future to get a more precise result. The proposed algorithm should be an efficient tool for the geo-correction of HJ CCD multi-spectral images.

An Introduction to 2-CCD Digital Particle Image Velocimetry System and Its Application in Ocean Engineering

The basic principle of particle image velocinmetry (PIV) is described. When a PIV image is analyzed by the method of auto-correlation, there is a direction ambiguity of 180 degrees iii velocity measurement. The problem can be solved by using 'Image Shifting Technique', but this makes devices much complicated and difficult to control. A new arrangement of 2-CCD (Charge Coupled Device) fully digitized PIV system, which can also solve the problem successfully, is introduced in the paper. As an example of application of the system, an experimental result of flow field around a horizontal cylinder in wave is presented.

3D Motion Parameters Determination Based on Binocular Sequence Images

Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s ystem and a method for determining 3D motion parameters of an object from binocu lar sequence images are introduced. The main steps include camera calibration, t he matching of motion and stereo images, 3D feature point correspondences and re solving the motion parameters. Finally, the experimental results of acquiring th e motion parameters of the objects with uniform velocity and acceleration in the straight line based on the real binocular sequence images by the mentioned meth od are presented.

Single-shot mid-infrared incoherent holography using Lucy-Richardson-Rosen algorithm

In recent years,there has been a significant transformation in the field of incoherent imaging with new possibilities of compressing three-dimensional(3D)information into a two-dimensional intensity distribution without two-beam interference(TBI).Most of the incoherent 3D imagers without TBI are based on scattering by a random phase mask exhibiting sharp autocorrelation and low cross-correlation along the depth.Consequently,during reconstruction,high lateral and axial resolutions are obtained.Imaging based on scattering requires an astronomical photon budget and is therefore precluded in many power-sensitive applications.In this study,a proof-of-concept 3D imaging method without TBI using deterministic fields has been demonstrated.A new reconstruction method called the Lucy-Richardson-Rosen algorithm has been developed for this imaging concept.We believe that the proposed approach will cause a paradigm-shift in the current state-of-the-art incoherent imaging,fluorescence microscopy,mid-infrared fingerprinting,astronomical imaging,and fast object recognition applications.

GPU-accelerated three-dimensional reconstruction method of the Compton camera and its application in radionuclide imaging

A novel and fast three-dimensional reconstruction method for a Compton camera and its performance in radionuclide imaging is proposed and analyzed in this study. The conical surface sampling back-projection method with scattering angle correction(CSS-BP-SC) can quickly perform the back-projection process of the Compton cone and can be used to precompute the list-mode maximum likelihood expectation maximization(LM-MLEM). A dedicated parallel architecture was designed for the graphics processing unit acceleration of the back-projection and iteration stage of the CSS-BP-SC-based LM-MLEM. The imaging results of the two-point source Monte Carlo(MC) simulation demonstrate that by analyzing the full width at half maximum along the three coordinate axes, the CSS-BP-SC-based LM-MLEM can obtain imaging results comparable to those of the traditional reconstruction algorithm, that is, the simple back-projection-based LM-MLEM. The imaging results of the mouse phantom MC simulation and experiment demonstrate that the reconstruction results obtained by the proposed method sufficiently coincide with the set radioactivity distribution, and the speed increased by more than 664 times compared to the traditional reconstruction algorithm in the mouse phantom experiment. The proposed method will further advance the imaging applications of Compton cameras.

Rapid Texture Mapping from Image Sequences for Building Geometry Model

An effective approach, mapping the texture for building model based on the digital photogrammetric theory, is proposed. The easily-acquired image sequences from digital video camera on helicopter are used as texture resource, and the correspondence between the space edge in building geometry model and its line feature in image sequences is determined semi-automatically. The experimental results in production of three-dimensional data for car navigation show us an attractive future both in efficiency and effect.

A Fast Aerial Image Matching Method Using Airborne LiDAR Point Cloud and POS Data

A novel tie point matching algorithm of aerial images with the assistance of airborne LiDAR point clouds and POS data is proposed Firstly,the conjugate point searching strategy used in traditional correlation coefficient matching is improved and a fast algorithm is presented.Secondly,an automatic camera boresight misalignment calibration method based on virtual ground control points is proposed,and then the searching range of image matching is adaptively determined and applied to the image matching of the entire surveying area.Test results verified that the fast correlation coefficient matching algorithm proposed in this paper can reduce approximately 25% of the matching time without the loss of matching accuracy.The camera boresight misalignment calibration method can effectively increase the accuracy of exterior orientation elements of images calculated from POS data,and thus can significantly improve the predicted position of conjugate point for tie point matching.Our proposed image matching algorithm can achieve superior matching accuracy with multi-scale,multi-view,and cross-flight aerial images.

Frequency domain based super-resolution method for mixed-resolution multi-view images

Super-resolution (SR) techniques, which are based on single or multi-frame low-resolution (LR) images, have been extensively investigated in the last two decades. Mixed-resolution multiview video format plays an important role in three-dimensional television (3DTV) coding scheme. Previous work considers multiview or multi-camera images and videos at the same resolution, which performs well under the planar model without or with little projection error among the videos captured by different cameras. In recent years, several researchers have discussed the SR problem in mixed-resolution multi-view video format, where the superresolved image is created using the up-sampled version of the LR image and the high frequency components extracted from the warped image in the adjacent high-resolution (HR) views. Unfortunately, the output HR images suffer from artifacts caused by depth error. To obtain the detailed texture and edge information from the HR image as much as possible, while preserving the structure of the LR image, a novel SR reconstruction algorithm is proposed. The algorithm is composed of three components: the structure term, the detail information term, and the regularization term. The first term preserves the structure similarity of the LR image; the second term extracts detailed information from the adjacent HR image; and the last term ensures the uniqueness of the solution. Experimental results show the effectiveness and robustness of the proposed algorithm, which achieves high performance both subjectively and objectively. © 2016 Beijing Institute of Aerospace Information.