A Visual Indoor Localization Method Based on Efficient Image Retrieval

The task of indoor visual localization, utilizing camera visual information for user pose calculation, was a core component of Augmented Reality (AR) and Simultaneous Localization and Mapping (SLAM). Existing indoor localization technologies generally used scene-specific 3D representations or were trained on specific datasets, making it challenging to balance accuracy and cost when applied to new scenes. Addressing this issue, this paper proposed a universal indoor visual localization method based on efficient image retrieval. Initially, a Multi-Layer Perceptron (MLP) was employed to aggregate features from intermediate layers of a convolutional neural network, obtaining a global representation of the image. This approach ensured accurate and rapid retrieval of reference images. Subsequently, a new mechanism using Random Sample Consensus (RANSAC) was designed to resolve relative pose ambiguity caused by the essential matrix decomposition based on the five-point method. Finally, the absolute pose of the queried user image was computed, thereby achieving indoor user pose estimation. The proposed indoor localization method was characterized by its simplicity, flexibility, and excellent cross-scene generalization. Experimental results demonstrated a positioning error of 0.09 m and 2.14° on the 7Scenes dataset, and 0.15 m and 6.37° on the 12Scenes dataset. These results convincingly illustrated the outstanding performance of the proposed indoor localization method.

Correlations between mineral composition and mechanical properties of granite using digital image processing and discrete element method

This study investigated the correlations between mechanical properties and mineralogy of granite using the digital image processing(DIP) and discrete element method(DEM). The results showed that the X-ray diffraction(XRD)-based DIP method effectively analyzed the mineral composition contents and spatial distributions of granite. During the particle flow code(PFC2D) model calibration phase, the numerical simulation exhibited that the uniaxial compressive strength(UCS) value, elastic modulus(E), and failure pattern of the granite specimen in the UCS test were comparable to the experiment. By establishing 351 sets of numerical models and exploring the impacts of mineral composition on the mechanical properties of granite, it indicated that there was no negative correlation between quartz and feldspar for UCS, tensile strength(σ_(t)), and E. In contrast, mica had a significant negative correlation for UCS, σ_(t), and E. The presence of quartz increased the brittleness of granite, whereas the presence of mica and feldspar increased its ductility in UCS and direct tensile strength(DTS) tests. Varying contents of major mineral compositions in granite showed minor influence on the number of cracks in both UCS and DTS tests.

Adaptive Boundary and Semantic Composite Segmentation Method for Individual Objects in Aerial Images

There are two types of methods for image segmentation.One is traditional image processing methods,which are sensitive to details and boundaries,yet fail to recognize semantic information.The other is deep learning methods,which can locate and identify different objects,but boundary identifications are not accurate enough.Both of them cannot generate entire segmentation information.In order to obtain accurate edge detection and semantic information,an Adaptive Boundary and Semantic Composite Segmentation method(ABSCS)is proposed.This method can precisely semantic segment individual objects in large-size aerial images with limited GPU performances.It includes adaptively dividing and modifying the aerial images with the proposed principles and methods,using the deep learning method to semantic segment and preprocess the small divided pieces,using three traditional methods to segment and preprocess original-size aerial images,adaptively selecting traditional results tomodify the boundaries of individual objects in deep learning results,and combining the results of different objects.Individual object semantic segmentation experiments are conducted by using the AeroScapes dataset,and their results are analyzed qualitatively and quantitatively.The experimental results demonstrate that the proposed method can achieve more promising object boundaries than the original deep learning method.This work also demonstrates the advantages of the proposed method in applications of point cloud semantic segmentation and image inpainting.

Three-dimensional color particle image velocimetry based on a cross-correlation and optical flow method

Rainbow particle image velocimetry(PIV)can restore the three-dimensional velocity field of particles with a single camera;however,it requires a relatively long time to complete the reconstruction.This paper proposes a hybrid algorithm that combines the fast Fourier transform(FFT)based co-correlation algorithm and the Horn–Schunck(HS)optical flow pyramid iterative algorithm to increase the reconstruction speed.The Rankine vortex simulation experiment was performed,in which the particle velocity field was reconstructed using the proposed algorithm and the rainbow PIV method.The average endpoint error and average angular error of the proposed algorithm were roughly the same as those of the rainbow PIV algorithm;nevertheless,the reconstruction time was 20%shorter.Furthermore,the effect of velocity magnitude and particle density on the reconstruction results was analyzed.In the end,the performance of the proposed algorithm was verified using real experimental single-vortex and double-vortex datasets,from which a similar particle velocity field was obtained compared with the rainbow PIV algorithm.The results show that the reconstruction speed of the proposed hybrid algorithm is approximately 25%faster than that of the rainbow PIV algorithm.

A Content-Based Medical Image Retrieval Method Using Relative Difference-Based Similarity Measure

Content-based medical image retrieval(CBMIR)is a technique for retrieving medical images based on automatically derived image features.There are many applications of CBMIR,such as teaching,research,diagnosis and electronic patient records.Several methods are applied to enhance the retrieval performance of CBMIR systems.Developing new and effective similarity measure and features fusion methods are two of the most powerful and effective strategies for improving these systems.This study proposes the relative difference-based similarity measure(RDBSM)for CBMIR.The new measure was first used in the similarity calculation stage for the CBMIR using an unweighted fusion method of traditional color and texture features.Furthermore,the study also proposes a weighted fusion method for medical image features extracted using pre-trained convolutional neural networks(CNNs)models.Our proposed RDBSM has outperformed the standard well-known similarity and distance measures using two popular medical image datasets,Kvasir and PH2,in terms of recall and precision retrieval measures.The effectiveness and quality of our proposed similarity measure are also proved using a significant test and statistical confidence bound.

A Single Image Derain Method Based on Residue Channel Decomposition in Edge Computing

The numerous photos captured by low-price Internet of Things(IoT)sensors are frequently affected by meteorological factors,especially rainfall.It causes varying sizes of white streaks on the image,destroying the image texture and ruining the performance of the outdoor computer vision system.Existing methods utilise training with pairs of images,which is difficult to cover all scenes and leads to domain gaps.In addition,the network structures adopt deep learning to map rain images to rain-free images,failing to use prior knowledge effectively.To solve these problems,we introduce a single image derain model in edge computing that combines prior knowledge of rain patterns with the learning capability of the neural network.Specifically,the algorithm first uses Residue Channel Prior to filter out the rainfall textural features then it uses the Feature Fusion Module to fuse the original image with the background feature information.This results in a pre-processed image which is fed into Half Instance Net(HINet)to recover a high-quality rain-free image with a clear and accurate structure,and the model does not rely on any rainfall assumptions.Experimental results on synthetic and real-world datasets show that the average peak signal-to-noise ratio of the model decreases by 0.37 dB on the synthetic dataset and increases by 0.43 dB on the real-world dataset,demonstrating that a combined model reduces the gap between synthetic data and natural rain scenes,improves the generalization ability of the derain network,and alleviates the overfitting problem.

Analysis of morphological characteristics of gravels based on digital image processing technology and self-organizing map

A comprehensive understanding of spatial distribution and clustering patterns of gravels is of great significance for ecological restoration and monitoring.However,traditional methods for studying gravels are low-efficiency and have many errors.This study researched the spatial distribution and cluster characteristics of gravels based on digital image processing technology combined with a self-organizing map(SOM)and multivariate statistical methods in the grassland of northern Tibetan Plateau.Moreover,the correlation of morphological parameters of gravels between different cluster groups and the environmental factors affecting gravel distribution were analyzed.The results showed that the morphological characteristics of gravels in northern region(cluster C)and southern region(cluster B)of the Tibetan Plateau were similar,with a low gravel coverage,small gravel diameter,and elongated shape.These regions were mainly distributed in high mountainous areas with large topographic relief.The central region(cluster A)has high coverage of gravels with a larger diameter,mainly distributed in high-altitude plains with smaller undulation.Principal component analysis(PCA)results showed that the gravel distribution of cluster A may be mainly affected by vegetation,while those in clusters B and C could be mainly affected by topography,climate,and soil.The study confirmed that the combination of digital image processing technology and SOM could effectively analyzed the spatial distribution characteristics of gravels,providing a new mode for gravel research.

Image reconstruction based on total-variation minimization and alternating direction method in linear scan computed tomography

Linear scan computed tomography （LCT） is of great benefit to online industrial scanning and security inspection due to its characteristics of straight-line source trajectory and high scanning speed. However, in practical applications of LCT, there are challenges to image reconstruction due to limited-angle and insufficient data. In this paper, a new reconstruction algorithm based on total-variation （TV） minimization is developed to reconstruct images from limited-angle and insufficient data in LCT. The main idea of our approach is to reformulate a TV problem as a linear equality constrained problem where the objective function is separable, and then minimize its augmented Lagrangian function by using alternating direction method （ADM） to solve subproblems. The proposed method is robust and efficient in the task of reconstruction by showing the convergence of ADM. The numerical simulations and real data reconstructions show that the proposed reconstruction method brings reasonable performance and outperforms some previous ones when applied to an LCT imaging problem.

Performances of conventional fusion methods evaluated for inland water body observation using GF-1 image

Satellite remote sensing of inland water body requires a high spatial resolution and a multiband narrow spectral resolution, which makes the fusion between panchromatic(PAN) and multi-spectral(MS) images particularly important. Taking the Daquekou section of the Qiantang River as an observation target, four conventional fusion methods widely accepted in satellite image processing, including pan sharpening(PS), principal component analysis(PCA), Gram-Schmidt(GS), and wavelet fusion(WF), are utilized to fuse MS and PAN images of GF-1.The results of subjective and objective evaluation methods application indicate that GS performs the best,followed by the PCA, the WF and the PS in the order of descending. The existence of a large area of the water body is a dominant factor impacting the fusion performance. Meanwhile, the ability of retaining spatial and spectral informations is an important factor affecting the fusion performance of different fusion methods. The fundamental difference of reflectivity information acquisition between water and land is the reason for the failure of conventional fusion methods for land observation such as the PS to be used in the presence of the large water body. It is suggested that the adoption of the conventional fusion methods in the observing water body as the main target should be taken with caution. The performances of the fusion methods need re-assessment when the large-scale water body is present in the remote sensing image or when the research aims for the water body observation.

Characterization for elastic constants of fused deposition modelling-fabricated materials based on the virtual fields method and digital image correlation

Fused deposition modelling(FDM), a widely used rapid prototyping process, is a promising technique in manufacturing engineering. In this work, a method for characterizing elastic constants of FDM-fabricated materials is proposed. First of all, according to the manufacturing process of FDM, orthotropic constitutive model is used to describe the mechanical behavior. Then the virtual fields method(VFM) is applied to characterize all the mechanical parameters(Q, Q, Q, Q) using the full-field strain,which is measured by digital image correlation(DIC). Since the principal axis of the FDM-fabricated structure is sometimes unknown due to the complexity of the manufacturing process, a disk in diametrical compression is used as the load configuration so that the loading angle can be changed conveniently. To verify the feasibility of the proposed method, finite element method(FEM) simulation is conducted to obtain the strain field of the disk. The simulation results show that higher accuracy can be achieved when the loading angle is close to 30?. Finally, a disk fabricated by FDM was used for the experiment. By rotating the disk, several tests with different loading angles were conducted. To determine the position of the principal axis in each test, two groups of parameters(Q, Q, Q, Q) are calculated by two different groups of virtual fields. Then the corresponding loading angle can be determined by minimizing the deviation between two groups of the parameters. After that, the four constants(Q, Q, Q, Q) were determined from the test with an angle of 27?.

A METHOD TO APPROACH OPTIMAL RESTORATION IN IMAGE RESTORATION PROBLEMS WITHOUT NOISE ENERGY INFORMATION

This paper proposes a new image restoration technique, in which the resulting regularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and upper band energy of the residue of the regularized image is theoretically analyzed by employing wavelet transform. This paper shows that regularization operator should generally be lowstop and highpass. So this paper chooses a lowstop and highpass operator as regularization operator, and construct an optimization model which minimizes the mean squares residue of regularized solution to determine regularization parameter. Although the model is random, on the condition of this paper, it can be solved and yields regularization parameter and regularized solution. Otherwise, the technique has a mechanism to predict noise energy. So, without noise information, it can also work and yield good restoration results.

Preconditioned Iterative Methods for Algebraic Systems from Multiplicative Half-Quadratic Regularization Image Restorations

Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term. A regularized convex term can usually preserve the image edges well in the restored image. In this paper, we consider a class of convex and edge-preserving regularization functions, I.e., multiplicative half-quadratic regularizations, and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations. At each Newton iterate, the preconditioned conjugate gradient method, incorporated with a constraint preconditioner, is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix.The igenvalue bounds of the preconditioned matrix are deliberately derived, which can be used to estimate the convergence speed of the preconditioned conjugate gradient method. We use experimental results to demonstrate that this new approach is efficient,and the effect of image restoration is r0easonably well.

Reconstruction of electrical capacitance tomography images based on fast linearized alternating direction method of multipliers for two-phase flow system

Electrical capacitance tomography(ECT)has been applied to two-phase flow measurement in recent years.Image reconstruction algorithms play an important role in the successful applications of ECT.To solve the ill-posed and nonlinear inverse problem of ECT image reconstruction,a new ECT image reconstruction method based on fast linearized alternating direction method of multipliers(FLADMM)is proposed in this paper.On the basis of theoretical analysis of compressed sensing(CS),the data acquisition of ECT is regarded as a linear measurement process of permittivity distribution signal of pipe section.A new measurement matrix is designed and L1 regularization method is used to convert ECT inverse problem to a convex relaxation problem which contains prior knowledge.A new fast alternating direction method of multipliers which contained linearized idea is employed to minimize the objective function.Simulation data and experimental results indicate that compared with other methods,the quality and speed of reconstructed images are markedly improved.Also,the dynamic experimental results indicate that the proposed algorithm can ful fill the real-time requirement of ECT systems in the application.

Hyperspectral Image Sharpening Based on Deep Convolutional Neural Network and Spatial-Spectral Spread Transform Models

In order to improve the spatial resolution of hyperspectral(HS)image and minimize the spectral distortion,an HS and multispectral(MS)image fusion approach based on convolutional neural network(CNN)is proposed.The proposed approach incorporates the linear spectral mixture model and spatial-spectral spread transform model into the learning phase of network,aiming to fully exploit the spatial-spectral information of HS and MS images,and improve the spectral fidelity of fusion images.Experiments on two real remote sensing data under different resolutions demonstrate that compared with some state-of-the-art HS and MS image fusion methods,the proposed approach achieves superior spectral fidelities and lower fusion errors.

New normalized nonlocal hybrid level set method for image segmentation

This article introduces a new normalized nonlocal hybrid level set method for image segmentation.Due to intensity overlapping,blurred edges with complex backgrounds,simple intensity and texture information,such kind of image segmentation is still a challenging task.The proposed method uses both the region and boundary information to achieve accurate segmentation results.The region information can help to identify rough region of interest and prevent the boundary leakage problem.It makes use of normalized nonlocal comparisons between pairs of patches in each region,and a heuristic intensity model is proposed to suppress irrelevant strong edges and constrain the segmentation.The boundary information can help to detect the precise location of the target object,it makes use of the geodesic active contour model to obtain the target boundary.The corresponding variational segmentation problem is implemented by a level set formulation.We use an internal energy term for geometric active contours to penalize the deviation of the level set function from a signed distance function.At last,experimental results on synthetic images and real images are shown in the paper with promising results.

The State-of-the-Art Review on Applications of Intrusive Sensing,Image Processing Techniques,and Machine Learning Methods in Pavement Monitoring and Analysis

In modern transportation,pavement is one of the most important civil infrastructures for the movement of vehicles and pedestrians.Pavement service quality and service life are of great importance for civil engineers as they directly affect the regular service for the users.Therefore,monitoring the health status of pavement before irreversible damage occurs is essential for timely maintenance,which in turn ensures public transportation safety.Many pavement damages can be detected and analyzed by monitoring the structure dynamic responses and evaluating road surface conditions.Advanced technologies can be employed for the collection and analysis of such data,including various intrusive sensing techniques,image processing techniques,and machine learning methods.This review summarizes the state-ofthe-art of these three technologies in pavement engineering in recent years and suggests possible developments for future pavement monitoring and analysis based on these approaches.

A review of the wave gradiometry method for seismic imaging

As dense seismic arrays at different scales are deployed,the techniques to make full use of array data with low computing cost become increasingly needed.The wave gradiometry method(WGM)is a new branch in seismic tomography,which utilizes the spatial gradients of the wavefield to determine the phase velocity,wave propagation direction,geometrical spreading,and radiation pattern.Seismic wave propagation parameters obtained using the WGM can be further applied to invert 3D velocity models,Q values,and anisotropy at lithospheric(crust and/or mantle)and smaller scales(e.g.,industrial oilfield or fault zone).Herein,we review the theoretical foundation,technical development,and major applications of the WGM,and compared the WGM with other commonly used major array imaging methods.Future development of the WGM is also discussed.

Multi-Objective Image Optimization of Product Appearance Based on Improved NSGA-II

A second-generation fast Non-dominated Sorting Genetic Algorithm product shape multi-objective imagery optimization model based on degradation(DNSGA-II)strategy is proposed to make the product appearance optimization scheme meet the complex emotional needs of users for the product.First,the semantic differential method and K-Means cluster analysis are applied to extract the multi-objective imagery of users;then,the product multidimensional scale analysis is applied to classify the research objects,and again the reference samples are screened by the semantic differentialmethod,and the samples are parametrized in two dimensions by using elliptic Fourier analysis;finally,the fuzzy dynamic evaluation function is used as the objective function of the algorithm,and the coordinates of key points of product contours Finally,with the fuzzy dynamic evaluation function as the objective function of the algorithm and the coordinates of key points of the product profile as the decision variables,the optimal product profile solution set is solved by DNSGA-II.The validity of the model is verified by taking the optimization of the shape scheme of the hospital connection site as an example.For comparison with DNSGA-II,other multi-objective optimization algorithms are also presented.To evaluate the performance of each algorithm,the performance evaluation index values of the five multi-objective optimization algorithms are calculated in this paper.The results show that DNSGA-II is superior in improving individual diversity and has better overall performance.

Blind Image Quality Assessment by Pairwise Ranking Image Series

Image quality assessment(IQA)is constantly innovating,but there are still three types of stickers that have not been resolved:the“content sticker”-limitation of training set,the“annotation sticker”-subjective instability in opinion scores and the“distortion sticker”-disordered distortion settings.In this paper,a No-Reference Image Quality Assessment(NR IQA)approach is proposed to deal with the problems.For“content sticker”,we introduce the idea of pairwise comparison and generate a largescale ranking set to pre-train the network;For“annotation sticker”,the absolute noise-containing subjective scores are transformed into ranking comparison results,and we design an indirect unsupervised regression based on EigenValue Decomposition(EVD);For“distortion sticker”,we propose a perception-based distortion classification method,which makes the distortion types clear and refined.Experiments have proved that our NR IQA approach Experiments show that the algorithm performs well and has good generalization ability.Furthermore,the proposed perception based distortion classification method would be able to provide insights on how the visual related studies may be developed and to broaden our understanding of human visual system.

New Image Recognition Method Based on Rough-Sets and Fuzzy Theory

A new image recognition method based on fuzzy rough sets theory is proposed, and its implementation discussed. The performance of this method as applied to ferrography image recognition is evaluated. It is shown that the new method gives better results than fuzzy or rough sets method when used alone.