Towards complex scenes: A deep learning-based camouflaged people detection method for snapshot multispectral images

Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems, including spectral, polarization, and infrared technologies, there is still a lack of effective real-time method for accurately detecting small-size and high-efficient camouflaged people in complex real-world scenes. Here, this study proposes a snapshot multispectral image-based camouflaged detection model, multispectral YOLO(MS-YOLO), which utilizes the SPD-Conv and Sim AM modules to effectively represent targets and suppress background interference by exploiting the spatial-spectral target information. Besides, the study constructs the first real-shot multispectral camouflaged people dataset(MSCPD), which encompasses diverse scenes, target scales, and attitudes. To minimize information redundancy, MS-YOLO selects an optimal subset of 12 bands with strong feature representation and minimal inter-band correlation as input. Through experiments on the MSCPD, MS-YOLO achieves a mean Average Precision of 94.31% and real-time detection at 65 frames per second, which confirms the effectiveness and efficiency of our method in detecting camouflaged people in various typical desert and forest scenes. Our approach offers valuable support to improve the perception capabilities of unmanned aerial vehicles in detecting enemy forces and rescuing personnel in battlefield.

One-year results for myopia control of orthokeratology with different back optic zone diameters: a randomized trial using a novel multispectral-based topographer

AIM:To present the 1-year results of a prospective cohort study investigating the efficacy,potential mechanism,and safety of orthokeratology(ortho-k)with different back optic zone diameters(BOZD)for myopia control in children.METHODS:This randomized clinical study was performed between Dec.2020 and Dec.2021.Participants were randomly assigned to three groups wearing ortho-k:5 mm BOZD(5-MM group),5.5 mm BOZD(5.5-MM group),and 6 mm BOZD(6-MM group).The 1-year data were recorded,including axial length,relative peripheral refraction(RPR,measured by multispectral refractive topography,MRT),and visual quality.The contrast sensitivity(CS)was evaluated by CSV-1000 instrument with spatial frequencies of 3,6,12,and 18 cycles/degree(c/d);the corneal higher-order aberrations(HOAs)were measured by iTrace aberration analyzer.The one-way ANOVA was performed to assess the differences between the three groups.The correlation between the change in AL and RPR was calculated by Pearson’s correlation coefficient.RESULTS:The 1-year results of 20,21,and 21 subjects in the 5-MM,5.5-MM,and 6-MM groups,respectively,were presented.There were no statistical differences in baseline age,sex,or ocular parameters between the three groups(all P>0.05).At the 1-year visit,the 5-MM group had lower axial elongation than the 6-MM group(0.07±0.09 vs 0.18±0.11 mm,P=0.001).The 5-MM group had more myopic total RPR(TRPR,P=0.014),with RPR in the 15°–30°(RPR 15–30,P=0.015),30°–45°(RPR 30–45,P=0.011),temporal(RPR-T,P=0.008),and nasal area(RPR-N,P<0.001)than the 6-MM group.RPR 15–30 in the 5.5-MM group was more myopic than that in the 6-MM group(P=0.002),and RPR-N in the 5-MM group was more myopic than that in the 5.5-MM group(P<0.001).There were positive correlations between the axial elongation and the change in TRPR(r=0.756,P<0.001),RPR 15–30(r=0.364,P=0.004),RPR 30–45(r=0.306,P=0.016),and RPR-N(r=0.253,P=0.047).The CS decreased at 3 c/d(P<0.001),and the corneal HOAs increased in the 5-MM group(P=0.030).CONCLUSION:Ortho-k with 5 mm BOZD can control myopia progression more effectively.The mechanism may be associated with greater myopic shifts in RPR.

Lightweight Cross-Modal Multispectral Pedestrian Detection Based on Spatial Reweighted Attention Mechanism

Multispectral pedestrian detection technology leverages infrared images to provide reliable information for visible light images, demonstrating significant advantages in low-light conditions and background occlusion scenarios. However, while continuously improving cross-modal feature extraction and fusion, ensuring the model’s detection speed is also a challenging issue. We have devised a deep learning network model for cross-modal pedestrian detection based on Resnet50, aiming to focus on more reliable features and enhance the model’s detection efficiency. This model employs a spatial attention mechanism to reweight the input visible light and infrared image data, enhancing the model’s focus on different spatial positions and sharing the weighted feature data across different modalities, thereby reducing the interference of multi-modal features. Subsequently, lightweight modules with depthwise separable convolution are incorporated to reduce the model’s parameter count and computational load through channel-wise and point-wise convolutions. The network model algorithm proposed in this paper was experimentally validated on the publicly available KAIST dataset and compared with other existing methods. The experimental results demonstrate that our approach achieves favorable performance in various complex environments, affirming the effectiveness of the multispectral pedestrian detection technology proposed in this paper.

End-to-end computational design for an EUV solar corona multispectral imager with stray light suppression

An extreme ultraviolet solar corona multispectral imager can allow direct observation of high temperature coronal plasma,which is related to solar flares,coronal mass ejections and other significant coronal activities.This manuscript proposes a novel end-to-end computational design method for an extreme ultraviolet(EUV)solar corona multispectral imager operating at wavelengths near 100 nm,including a stray light suppression design and computational image recovery.To suppress the strong stray light from the solar disk,an outer opto-mechanical structure is designed to protect the imaging component of the system.Considering the low reflectivity(less than 70%)and strong-scattering(roughness)of existing extreme ultraviolet optical elements,the imaging component comprises only a primary mirror and a curved grating.A Lyot aperture is used to further suppress any residual stray light.Finally,a deep learning computational imaging method is used to correct the individual multi-wavelength images from the original recorded multi-slit data.In results and data,this can achieve a far-field angular resolution below 7",and spectral resolution below 0.05 nm.The field of view is±3 R_(☉)along the multi-slit moving direction,where R☉represents the radius of the solar disk.The ratio of the corona's stray light intensity to the solar center's irradiation intensity is less than 10-6 at the circle of 1.3 R_(☉).

Multiple omics datasets reveal significant physical and physiological dormancy in alfalfa hard seeds identified by multispectral imaging analysis

Physical dormancy(PY) commonly present in the seeds of higher plants is believed to be responsible for the germination failure by impermeable seed coat in hard seeds of legume species, instead of physiological dormancy(PD). In this study, a non-destructive approach involving multispectral imaging was used to successfully identify hard seeds from non-hard seeds in Medicago sativa, with accuracy as high as96.8%–99.0%. We further adopted multiple-omics strategies to investigate the differences of physiology,metabolomics, methylomics, and transcriptomics in alfalfa hard seeds, with non-hard seeds as control.The hard seeds showed dramatically increased antioxidants and 125 metabolites of significant differences in non-targeted metabolomics analysis, which are enriched in the biosynthesis pathways of flavonoids, lipids and hormones, especially with significantly higher ABA, a hormone known to induce dormancy. In our transcriptomics results, the enrichment pathway of “response to abscisic acid” of differential expressed genes(DEG) supported the key role of ABA in metabolomics results. The methylome analysis identified 54,899, 46,216 and 54,452 differential methylation regions for contexts of CpG, CHG and CHH, and 344 DEGs might be regulated by hypermethylation and hypomethylation of promoter and exon regions, including four ABA-and JA-responsive genes. Among 8% hard seeds in seed lots,24.5% still did not germinate after scarifying seed coat, and were named as non-PY hard seeds.Compared to hard seeds, significantly higher contents of ABA/IAA and ABA/JA were identified in nonPY hard seeds, which indicated the potential presence of PD. In summary, the significantly changed metabolites, gene expressions, and methylations all suggested involvement of ABA responses in hard seeds, and germination failure of alfalfa hard seeds was caused by combinational dormancy(PY + PD),rather than PY alone.

A double-layer model for improving the estimation of wheat canopy nitrogen content from unmanned aerial vehicle multispectral imagery

The accurate and rapid estimation of canopy nitrogen content(CNC)in crops is the key to optimizing in-season nitrogen fertilizer application in precision agriculture.However,the determination of CNC from field sampling data for leaf area index(LAI),canopy photosynthetic pigments(CPP;including chlorophyll a,chlorophyll b and carotenoids)and leaf nitrogen concentration(LNC)can be time-consuming and costly.Here we evaluated the use of high-precision unmanned aerial vehicle(UAV)multispectral imagery for estimating the LAI,CPP and CNC of winter wheat over the whole growth period.A total of 23 spectral features(SFs;five original spectrum bands,17 vegetation indices and the gray scale of the RGB image)and eight texture features(TFs;contrast,entropy,variance,mean,homogeneity,dissimilarity,second moment,and correlation)were selected as inputs for the models.Six machine learning methods,i.e.,multiple stepwise regression(MSR),support vector regression(SVR),gradient boosting decision tree(GBDT),Gaussian process regression(GPR),back propagation neural network(BPNN)and radial basis function neural network(RBFNN),were compared for the retrieval of winter wheat LAI,CPP and CNC values,and a double-layer model was proposed for estimating CNC based on LAI and CPP.The results showed that the inversion of winter wheat LAI,CPP and CNC by the combination of SFs+TFs greatly improved the estimation accuracy compared with that by using only the SFs.The RBFNN and BPNN models outperformed the other machine learning models in estimating winter wheat LAI,CPP and CNC.The proposed double-layer models(R^(2)=0.67-0.89,RMSE=13.63-23.71 mg g^(-1),MAE=10.75-17.59 mg g^(-1))performed better than the direct inversion models(R^(2)=0.61-0.80,RMSE=18.01-25.12 mg g^(-1),MAE=12.96-18.88 mg g^(-1))in estimating winter wheat CNC.The best winter wheat CNC accuracy was obtained by the double-layer RBFNN model with SFs+TFs as inputs(R^(2)=0.89,RMSE=13.63 mg g^(-1),MAE=10.75 mg g^(-1)).The results of this study can provide guidance for the accurate and rapid determination of winter wheat canopy nitrogen content in the field.

Shallow water bathymetry based on a back propagation neural network and ensemble learning using multispectral satellite imagery

The back propagation(BP)neural network method is widely used in bathymetry based on multispectral satellite imagery.However,the classical BP neural network method faces a potential problem because it easily falls into a local minimum,leading to model training failure.This study confirmed that the local minimum problem of the BP neural network method exists in the bathymetry field and cannot be ignored.Furthermore,to solve the local minimum problem of the BP neural network method,a bathymetry method based on a BP neural network and ensemble learning(BPEL)is proposed.First,the remote sensing imagery and training sample were used as input datasets,and the BP method was used as the base learner to produce multiple water depth inversion results.Then,a new ensemble strategy,namely the minimum outlying degree method,was proposed and used to integrate the water depth inversion results.Finally,an ensemble bathymetric map was acquired.Anda Reef,northeastern Jiuzhang Atoll,and Pingtan coastal zone were selected as test cases to validate the proposed method.Compared with the BP neural network method,the root-mean-square error and the average relative error of the BPEL method can reduce by 0.65–2.84 m and 16%–46%in the three test cases at most.The results showed that the proposed BPEL method could solve the local minimum problem of the BP neural network method and obtain highly robust and accurate bathymetric maps.

Adaptive Window Based 3-D Feature Selection for Multispectral Image Classification Using Firefly Algorithm

Feature extraction is the most critical step in classification of multispectral image.The classification accuracy is mainly influenced by the feature sets that are selected to classify the image.In the past,handcrafted feature sets are used which are not adaptive for different image domains.To overcome this,an evolu-tionary learning method is developed to automatically learn the spatial-spectral features for classification.A modified Firefly Algorithm(FA)which achieves maximum classification accuracy with reduced size of feature set is proposed to gain the interest of feature selection for this purpose.For extracting the most effi-cient features from the data set,we have used 3-D discrete wavelet transform which decompose the multispectral image in all three dimensions.For selecting spatial and spectral features we have studied three different approaches namely overlapping window(OW-3DFS),non-overlapping window(NW-3DFS)adaptive window cube(AW-3DFS)and Pixel based technique.Fivefold Multiclass Support Vector Machine(MSVM)is used for classification purpose.Experiments con-ducted on Madurai LISS IV multispectral image exploited that the adaptive win-dow approach is used to increase the classification accuracy.

Forest mapping:a comparison between hyperspectral and multispectral images and technologies

Mapping forests is an important process in managing natural resources.At present,due to spectral resolution limitations,multispectral images do not give a complete separation between different forest species.In contrast,advances in remote sensing technologies have provided hyperspectral tools and images as a solution for the determination of species.In this study,spectral signatures for stone pine（Pinus pinea L.） forests were collected using an advanced spectroradiometer ＂ASD FieldSpec 4 Hi-Res＂ with an accuracy of 1 nm.These spectral signatures are used to compare between different multispectral and hyperspectral satellite images.The comparison is based on processing satellite images： hyperspectral Hyperion,hyperspectral CHRIS-Proba,Advanced Land Imager（ALI）,and Landsat 8.Enhancement and classification methods for hyperspectral and multispectral images are investigated and analyzed.In addition,a well-known hyperspectral image classification algorithm,spectral angle mapper（SAM）,has been improved to perform the classification process efficiently based on collected spectral signatures.The results show that the modified SAM is 9% more accurate than the conventional SAM.In addition,experiments indicate that the CHRIS-Proba image is more accurate than Landsat 8（overall accuracy 82%,precision 93%,and Kappa coefficient 0.43 compared to 60,67%,and 0.035,respectively）.Similarly,Hyperion is better than ALI in mapping stone pine（overall accuracy 92%,precision 97%,and Kappa coefficient 0.74 compared to 52,56%,and -0.032,respectively）.

Novel application of multispectral refraction topography in the observation of myopic control effect by orthokeratology lens in adolescents

BACKGROUND Myopia,as one of the common ocular diseases,often occurs in adolescence.In addition to the harm from itself,it may also lead to serious complications.Thus,prevention and control of myopia are attracting more and more attention.Previous research revealed that single-focal glasses and orthokeratology lenses(OK lenses)played an important part in slowing down myopia and preventing high myopia.AIM To compare the clinical effects of OK lenses and frame glasses against the increase of diopter in adolescent myopia and further explore the mechanism of the OK lens.METHODS Changes in diopter and axial length were collected among 70 adolescent myopia patients(124 eyes)wearing OK lenses for 1 year(group A)and 59 adolescent myopia patients(113 eyes)wearing frame glasses(group B).Refractive states of their retina were inspected through multispectral refraction topography.The obtained hyperopic defocus was analyzed for the mechanism of OK lenses on slowing down the increase of myopic diopter by delaying the increase of ocular axis length and reducing the near hyperopia defocus.RESULTS Teenagers in groups A and B were divided into low myopia(0 D--3.00 D)and moderate myopia(-3.25 D--6.00 D),without statistical differences among gender and age.After 1-year treatment,the increase of diopter and axis length and changes of retinal hyperopic defocus amount of group A were significantly less than those of group B.According to the multiple linear analysis,the retinal defocus in the upper,lower,nasal,and temporal directions had almost the same effect on the total defocus.The amount of peripheral retinal defocus(15°-53°)in group A was significantly lower than that in group B.CONCLUSION Multispectral refraction topography is progressive and instructive in clinical prevention and control of myopia.

Optical detection of Prorocentrum donghaiense blooms based on multispectral reflectance

Prorocentrum donghaiense is one of the most common red tide causative dinoflagellates in the Changjiang （Yangtze） River Estuary and the adjacent area of the East China Sea. It causes large-scale blooms in late spring and early summer that lead to widespread ecologic and economic damage. A means for distinguish- ing dinoflagellate blooms from diatom （Skeletonema costatum） blooms is desired. On the basis of measure- ments of remote sensing refectance [Rrs（λ）] and inherent optical parameters, the potential of using a mul- tispectral approach is assessed for discriminating the algal blooms due to P. donghaiense from those due to S. costatum. The behavior of two reflectance ratios [R1 = Rrs（560）/Rrs（532） and Re = Rrs（708）/Rrs（665）], suggests that differentiation of P. donghaiense blooms from diatom bloom types is possible from the current band setup of ocean color sensors. It is found that there are two reflectance ratio regimes that indicate a bloom is dominated by P. donghaiense; （1） R1 〉 1.55 and R2 〈 1.0 or （2） R1 〉 1.75 and R2 ≥ 1.0. Various sensitivity analyses are conducted to investigate the effects of the variation in varying levels of chlorophyll concentration and colored dissolved organic matter （CDOM） as well as changes in the backscattering ratio （bbp/bp） on the efficacy of this muitispectral approach. Results indicate that the intensity and inherent op- tical properties of the algal species explain much of the behavior of the two ratios. Although backscattering influences the amplitude of Rrs（λ）, especially in the 530 and 560 nm bands, the discrimination between P. donghaiense and diatoms is not significantly affected by the variation of bbp/bp. Since aCDOM （440） in coastal areas of the ECS is typically lower than 1.0 m-1 in most situations, the presence of CDOM does not interfere with this discrimination, even as SCDOM varies from 0.01 to 0.026 nm-1. Despite all of these effects, the dis- crimination of P. donghaiense blooms from diatom blooms based on multispectral measurements of Rrs（λ） is feasible.

Optical design of common-aperture multispectral and polarization optical imaging system with wide field of view

Multispectral and polarization cameras that can simultaneously acquire the spatial,spectral,and polarization characteristics of an object have considerable potential applications in target detection,biomedical imaging,and remote sensing.In this work,we develop a common-aperture optical system that can capture multispectral and polarization information.An off-axis three-mirror optical system is mounted on the front end of the proposed system and used as a common-aperture telescope in the visible light(400 nm-750 nm)and long-wave infrared(LWIR,8μm-12μm)waveband.The system can maintain a wide field of view(4.5°)and it can demonstrate an enhanced identification ability.The off-axis three-mirror system gets rid of central obscuration while further yielding stable system resolution and energy.Light that has passed through the front-end common-aperture reflection system is divided into the visible light and LWIR waveband by a beamsplitter.The two wavebands then converge on two detectors through two groups of lenses.Our simulation results indicate that the proposed system can obtain clear images in each waveband to meet the diverse imaging requirements.

Estimating above-ground biomass by fusion of LiDAR and multispectral data in subtropical woody plant communities in topographically complex terrain in North-eastern Australia

We investigated a strategy to improve predicting capacity of plot-scale above-ground biomass （AGB） by fusion of LiDAR and Land- sat5 TM derived biophysical variables for subtropical rainforest and eucalypts dominated forest in topographically complex landscapes in North-eastern Australia. Investigation was carried out in two study areas separately and in combination. From each plot of both study areas, LiDAR derived structural parameters of vegetation and reflectance of all Landsat bands, vegetation indices were employed. The regression analysis was carded out separately for LiDAR and Landsat derived variables indi- vidually and in combination. Strong relationships were found with LiDAR alone for eucalypts dominated forest and combined sites compared to the accuracy of AGB estimates by Landsat data. Fusing LiDAR with Landsat5 TM derived variables increased overall performance for the eucalypt forest and combined sites data by describing extra variation （3% for eucalypt forest and 2% combined sites） of field estimated plot-scale above-ground biomass. In contrast, separate LiDAR and imagery data, andfusion of LiDAR and Landsat data performed poorly across structurally complex closed canopy subtropical minforest. These findings reinforced that obtaining accurate estimates of above ground biomass using remotely sensed data is a function of the complexity of horizontal and vertical structural diversity of vegetation.

Computer Identification of Multispectral Satellite Cloud Imagery

A dynamic clustering method based on multispectral satellite imagery to identify the different features is described. The channel combinations selected are for the different purposes in classification. Several cases are presented using the polar-orbiting satellite imageries.

D-SS Frame:deep spectral-spatial feature extraction and fusion for classification of panchromatic and multispectral images

Facing the very high-resolution( VHR) image classification problem,a feature extraction and fusion framework is presented for VHR panchromatic and multispectral image classification based on deep learning techniques. The proposed approach combines spectral and spatial information based on the fusion of features extracted from panchromatic( PAN) and multispectral( MS) images using sparse autoencoder and its deep version. There are three steps in the proposed method,the first one is to extract spatial information of PAN image,and the second one is to describe spectral information of MS image. Finally,in the third step,the features obtained from PAN and MS images are concatenated directly as a simple fusion feature. The classification is performed using the support vector machine( SVM) and the experiments carried out on two datasets with very high spatial resolution. MS and PAN images from WorldView-2 satellite indicate that the classifier provides an efficient solution and demonstrate that the fusion of the features extracted by deep learning techniques from PAN and MS images performs better than that when these techniques are used separately. In addition,this framework shows that deep learning models can extract and fuse spatial and spectral information greatly,and have huge potential to achieve higher accuracy for classification of multispectral and panchromatic images.

Robust Core Tensor Dictionary Learning with Modified Gaussian Mixture Model for Multispectral Image Restoration

The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust modified Gaussian mixture model for MS-RSI restoration.First,the multispectral patch is modeled by three-order tensor and high-order singular value decomposition is applied to the tensor.Then the task of MS-RSI restoration is formulated as a minimum sparse core tensor estimation problem.To improve the accuracy of core tensor coding,the core tensor estimation based on the robust modified Gaussian mixture model is introduced into the proposed model by exploiting the sparse distribution prior in image.When applied to MS-RSI restoration,our experimental results have shown that the proposed algorithm can better reconstruct the sharpness of the image textures and can outperform several existing state-of-the-art multispectral image restoration methods in both subjective image quality and visual perception.

Fusion of multispectral image and panchromatic image based on NSCT and NMF

A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform（NSCT） and non-negative matrix factorization（NMF） is presented,the aim of which is to preserve both spectral and spatial information simultaneously in fused image.NMF is a matrix factorization method,which can extract the local feature by choosing suitable dimension of the feature subspace.Firstly the multispectral image was represented in intensity hue saturation（IHS） system.Then the I component and panchromatic image were decomposed by NSCT.Next we used NMF to learn the feature of both multispectral and panchromatic images＇ low-frequency subbands,and the selection principle of the other coefficients was absolute maximum criterion.Finally the new coefficients were reconstructed to get the fused image.Experiments are carried out and the results are compared with some other methods,which show that the new method performs better in improving the spatial resolution and preserving the feature information than the other existing relative methods.

ASRNet: Adversarial Segmentation and Registration Networks for Multispectral Fundus Images

Multispectral imaging (MSI) technique is often used to capture imagesof the fundus by illuminating it with different wavelengths of light. However,these images are taken at different points in time such that eyeball movementscan cause misalignment between consecutive images. The multispectral imagesequence reveals important information in the form of retinal and choroidal bloodvessel maps, which can help ophthalmologists to analyze the morphology of theseblood vessels in detail. This in turn can lead to a high diagnostic accuracy of several diseases. In this paper, we propose a novel semi-supervised end-to-end deeplearning framework called “Adversarial Segmentation and Registration Nets”(ASRNet) for the simultaneous estimation of the blood vessel segmentation andthe registration of multispectral images via an adversarial learning process. ASRNet consists of two subnetworks: (i) A segmentation module S that fulfills theblood vessel segmentation task, and (ii) A registration module R that estimatesthe spatial correspondence of an image pair. Based on the segmention-drivenregistration network, we train the segmentation network using a semi-supervisedadversarial learning strategy. Our experimental results show that the proposedASRNet can achieve state-of-the-art accuracy in segmentation and registrationtasks performed with real MSI datasets.

Calculation of photosynthetically available radiation using multispectral data in the Arctic

Photosynthetically Available Radiation（PAR） is an important bio-optical parameter related to marine primary production.PAR is usually measured by a broadband sensor and can also be calculated by multispectral data.When the PAR is calculated by multispectral data in polar region,four factors are possible error sources.PAR could be overestimated as the wavelengths of multispectral instrument are usually chosen to evade main absorption zones of atmosphere. However,both PARs calculated by hyperspectral and multispectral data are consistent with an error less than 1%.By the fitting function proposed here,the PAR calculated by multispectral data could attain the same accuracy with that by hyperspectral data.To calculate the attenuation rate of the PAR needs PAR_0, the PAR just under the surface.Here,an approach is proposed to calculate PAR_0 by the best fit of the irradiance profile of 1-5 m with a content attenuation coefficient under surface.It is demonstrated by theory and observed data in different time at same location that the attenuation coefficient of PAR is independent of the intensity of radiation.But under sea ice,the attenuation coefficient of PAR is a little bit different,as the spectrum of the light has been changed by selective absorption by the sea ice.Therefore,the difference of inclusions inside the sea ice will result in different PAR,and impact on the attenuation of PAR.By the results of this paper,PAR can be calculated reliably by multispectral data.

MRF-Based Multispectral Image Fusion Using an Adaptive Approach Based on Edge-Guided Interpolation

In interpretation of remote sensing images, it is possible that some images which are supplied by different sensors become incomprehensible. For better visual perception of these images, it is essential to operate series of pre-processing and elementary corrections and then operate a series of main processing steps for more precise analysis on the images. There are several approaches for processing which are depended on the type of remote sensing images. The discussed approach in this article, i.e. image fusion, is the use of natural colors of an optical image for adding color to a grayscale satellite image which gives us the ability for better observation of the HR image of OLI sensor of Landsat-8. This process with emphasis on details of fusion technique has previously been performed;however, we are going to apply the concept of the interpolation process. In fact, we see many important software tools such as ENVI and ERDAS as the most famous remote sensing image processing tools have only classical interpolation techniques (such as bi-linear (BL) and bi-cubic/cubic convolution (CC)). Therefore, ENVI- and ERDAS-based researches in image fusion area and even other fusion researches often don’t use new and better interpolators and are mainly concentrated on the fusion algorithm’s details for achieving a better quality, so we only focus on the interpolation impact on fusion quality in Landsat-8 multispectral images. The important feature of this approach is to use a statistical, adaptive, and edge-guided interpolation method for improving the color quality in the images in practice. Numerical simulations show selecting the suitable interpolation techniques in MRF-based images creates better quality than the classical interpolators.